-- Logs begin at Wed 2022-07-20 18:35:48 UTC, end at Wed 2022-07-20 19:55:56 UTC. -- Jul 20 19:13:48.454797 dv-cinder-835384-16-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 20 19:13:48.463685 dv-cinder-835384-16-smb devstack@keystone.service[80387]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 20 19:13:48.465572 dv-cinder-835384-16-smb devstack@keystone.service[80387]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 19:13:48 2022] *** Jul 20 19:13:48.465572 dv-cinder-835384-16-smb devstack@keystone.service[80387]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 19:13:48.465572 dv-cinder-835384-16-smb devstack@keystone.service[80387]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 19:13:48.465572 dv-cinder-835384-16-smb devstack@keystone.service[80387]: nodename: dv-cinder-835384-16-smb Jul 20 19:13:48.465572 dv-cinder-835384-16-smb devstack@keystone.service[80387]: machine: x86_64 Jul 20 19:13:48.465572 dv-cinder-835384-16-smb devstack@keystone.service[80387]: clock source: unix Jul 20 19:13:48.465572 dv-cinder-835384-16-smb devstack@keystone.service[80387]: pcre jit disabled Jul 20 19:13:48.465572 dv-cinder-835384-16-smb devstack@keystone.service[80387]: detected number of CPU cores: 4 Jul 20 19:13:48.465572 dv-cinder-835384-16-smb devstack@keystone.service[80387]: current working directory: / Jul 20 19:13:48.465572 dv-cinder-835384-16-smb devstack@keystone.service[80387]: detected binary path: /usr/bin/uwsgi-core Jul 20 19:13:48.465572 dv-cinder-835384-16-smb devstack@keystone.service[80387]: your processes number limit is 47680 Jul 20 19:13:48.466300 dv-cinder-835384-16-smb devstack@keystone.service[80387]: your memory page size is 4096 bytes Jul 20 19:13:48.466300 dv-cinder-835384-16-smb devstack@keystone.service[80387]: detected max file descriptor number: 2048 Jul 20 19:13:48.466300 dv-cinder-835384-16-smb devstack@keystone.service[80387]: lock engine: pthread robust mutexes Jul 20 19:13:48.466300 dv-cinder-835384-16-smb devstack@keystone.service[80387]: thunder lock: enabled Jul 20 19:13:48.466300 dv-cinder-835384-16-smb devstack@keystone.service[80387]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 20 19:13:48.466300 dv-cinder-835384-16-smb devstack@keystone.service[80387]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 19:13:48.509785 dv-cinder-835384-16-smb devstack@keystone.service[80387]: Python main interpreter initialized at 0x5609a1e8f9c0 Jul 20 19:13:48.509785 dv-cinder-835384-16-smb devstack@keystone.service[80387]: python threads support enabled Jul 20 19:13:48.509785 dv-cinder-835384-16-smb devstack@keystone.service[80387]: your server socket listen backlog is limited to 100 connections Jul 20 19:13:48.509785 dv-cinder-835384-16-smb devstack@keystone.service[80387]: your mercy for graceful operations on workers is 90 seconds Jul 20 19:13:48.510136 dv-cinder-835384-16-smb devstack@keystone.service[80387]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 19:13:48.510211 dv-cinder-835384-16-smb devstack@keystone.service[80387]: *** Operational MODE: preforking *** Jul 20 19:13:48.510486 dv-cinder-835384-16-smb devstack@keystone.service[80387]: *** uWSGI is running in multiple interpreter mode *** Jul 20 19:13:48.510486 dv-cinder-835384-16-smb devstack@keystone.service[80387]: spawned uWSGI master process (pid: 80387) Jul 20 19:13:48.510743 dv-cinder-835384-16-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 20 19:13:48.511806 dv-cinder-835384-16-smb devstack@keystone.service[80387]: spawned uWSGI worker 1 (pid: 80398, cores: 1) Jul 20 19:13:48.511806 dv-cinder-835384-16-smb devstack@keystone.service[80387]: spawned uWSGI worker 2 (pid: 80399, cores: 1) Jul 20 19:13:48.511806 dv-cinder-835384-16-smb devstack@keystone.service[80387]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 19:13:53.995157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:13:53.995157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: from cryptography.utils import int_from_bytes Jul 20 19:13:53.995941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:13:53.995941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: from cryptography.utils import int_from_bytes Jul 20 19:13:53.996191 dv-cinder-835384-16-smb devstack@keystone.service[80399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:13:53.996191 dv-cinder-835384-16-smb devstack@keystone.service[80399]: from cryptography.utils import int_from_bytes Jul 20 19:13:53.996659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:13:53.996659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: from cryptography.utils import int_from_bytes Jul 20 19:13:54.045028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:13:54.045197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:13:54.045392 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] command line args: [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:13:54.045656 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:13:54.045828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ================================================================================ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:13:54.045908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:13:54.046084 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] admin_token = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.046170 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:13:54.046302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] command line args: [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:13:54.046391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config_dir = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.046499 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.046583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:13:54.046659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config_source = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.046808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ================================================================================ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:13:54.046901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] debug = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.047052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.048318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] admin_token = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.048318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] config_dir = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.048440 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.048499 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.048565 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.048629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] config_source = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.048693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.048757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] debug = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.048820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.048886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.048969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.049034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.049097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_config_append = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.049160 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.049228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.049228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_dir = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.049331 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.049394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.049457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.049520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.049588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.049588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_config_append = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.049701 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.049760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.049822 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.049885 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_dir = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.050093 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.050170 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.050170 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.050278 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.050398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.050485 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.050612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.050732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.050808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.050934 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.051048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.051139 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.051260 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.051375 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.051522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.051602 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.051753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.051887 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.052004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.052118 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.052232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.052345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.052466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.052594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.052719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.052877 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.053043 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.053162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.053328 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] publish_errors = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.053446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.053567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.053703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.053854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.053986 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.054098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] publish_errors = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.054217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.054337 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.054460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.054575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.054731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] standard_threads = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.054857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.054984 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.055107 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.055107 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.055329 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.055329 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.055555 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] standard_threads = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.055688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_journal = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.055805 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.055926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_json = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.056048 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.056165 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_stderr = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.056279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.056469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_syslog = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.056587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] use_journal = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.056708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.056824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] use_json = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.056824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] use_stderr = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.057050 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.057175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] use_syslog = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.057297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.057417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:13:54.057533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.057652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.057774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.057898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.058014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.058128 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.058249 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.058364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.058477 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.058602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.058732 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.058849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.058963 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.059087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.059087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.059312 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.059427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.059542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.060192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.060314 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.060622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.060754 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.060878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.061003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.061118 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.061236 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.061358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.061482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.061599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.061713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.061827 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.061827 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.062047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.062174 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.062297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.062414 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.062527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.062647 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.062790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.062982 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.063107 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.063223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.063337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.063458 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.063583 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.063705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.063821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.063935 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.064051 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.064165 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.064288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.064404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.064519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.064633 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.064748 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.064862 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.064985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.065107 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.065228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.065344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.065458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.065578 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.065702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.065817 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.065817 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.066030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.066144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.066257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.066389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.066507 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.066628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.066756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.066896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.067003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.067108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.067204 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.067298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.067392 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.067487 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.067582 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.067687 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.067803 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.067924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.068040 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.068154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.068269 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.068393 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.068510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.068625 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.068746 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.068863 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.068985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.069101 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.069223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.069346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.069463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.069578 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.069695 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.069809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.069940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.070058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.070167 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.070530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.070716 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.070830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.070956 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.071073 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.071178 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.071290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.071404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.071525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.071650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.071768 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.071882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.071996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.072110 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.072229 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.072356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.072472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.072592 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.072707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.072860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.072983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.073108 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.073234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.073363 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.073481 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.073596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.073700 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.073821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.073939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.074055 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.074178 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.074301 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.074417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.074608 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.074806 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.074925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.075040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.075155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.075270 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.075947 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.076071 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.076193 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.076313 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.076430 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.076555 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.076682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.076800 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.076924 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.077042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.077164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.077281 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.077397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.077512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.077636 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.077754 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.077876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.077999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.078118 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.078233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.078357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.078480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.078597 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.078753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.078872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.079041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.079164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.079280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.079396 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.079511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.079626 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.079749 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.079867 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.079982 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.080097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.080214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.080330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.080457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.080575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.080691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.080812 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.080929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.081043 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.081167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.081291 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.081291 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.081509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.081630 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.081747 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.081871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.081988 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.082103 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.082218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.082334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.082449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.082572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.082732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.082877 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.083042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.083162 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.083278 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.083406 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.083524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.083639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.083754 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.083875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.external = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.083992 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.external = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.084115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.084232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.084348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.084496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.084628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.084748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.084864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.password = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.084980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.password = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.085104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.token = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.085228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.token = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.085346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.085471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.085595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.085713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.085837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.085955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.086072 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.086188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.086307 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.086424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.086552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.086685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.086805 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.086921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.087037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.087153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.087285 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.087404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.087522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.087639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.087756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.087873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.087997 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.088121 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.088240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.088356 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.088479 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.088598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.088723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.088841 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.088958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.089074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.089199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.089306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.089494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.089616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.089733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.089849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.089966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.090082 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.090214 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.090334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.090450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.090567 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.090714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.090835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.090987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.091108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.091224 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.091341 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.091457 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.091574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.091704 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.091824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.091930 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.092046 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.092163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.092288 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.092413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.092530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.092646 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.092752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.092869 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.092994 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.093112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.093229 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.093346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.093462 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.093462 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.093692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.093812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.093928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.093928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.094146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.094262 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.094390 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.094508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.094625 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.094771 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.094892 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.095009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.095133 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.095252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.095368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.095484 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.095600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.095716 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.095843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.095963 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.096080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.096207 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.096326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.096442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.096565 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.096683 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.096799 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.096915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.097032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.097148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.097273 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.097391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.097508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.097624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.097740 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.097857 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.097984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.098102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.098219 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.098335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.098451 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.098573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.098749 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.098871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.098989 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.099106 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.099222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.099338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.099463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.099581 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.099697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.099813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.099929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.100044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.100170 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.100287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.100404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.100520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.100636 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.100752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.100876 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.100994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.101110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.101227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.101343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.101459 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.101583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.101707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.101824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.101940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.102056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.102181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.102299 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.102424 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.102542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.102658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.102794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.102922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.103041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.103157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.103275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.103391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.103513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.103639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.103757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.103874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.103990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.104107 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.104223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.104348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.104466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.104582 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.104698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.104814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.104931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.105055 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.105173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.105296 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.105415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.105531 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.105647 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.105771 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.105890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.106006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.106126 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.106243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.106360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.106489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.106654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.106829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.107068 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.107196 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.107315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.107447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.107568 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.107686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.107803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.107920 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.108037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.108162 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.108281 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.108398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.108517 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.108634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.108751 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.108880 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.109005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.109124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.109240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.109356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.109472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.109598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.109716 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.109833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.109950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.110066 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.110183 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.110308 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.110426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.110549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.110685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.110805 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.110921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.111053 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.111172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.111289 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.111405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.111521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.111637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.111761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.111879 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.111996 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.112112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.112227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.112343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.112534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.112656 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.112772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.112887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.113004 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.113119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.113244 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.113362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.113478 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.113594 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.113712 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.113828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.113953 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.114071 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.114188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.114304 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.114420 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.114536 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.114662 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.114817 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.114945 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.115064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.115181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.115297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.115421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.115540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.115657 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.115773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.115891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.116007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.116135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.116255 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.116372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.116488 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.116640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.116761 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.116888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.117006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.117123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.117239 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.117356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.117481 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.117600 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.117716 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] role.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.117833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.117957 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] role.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.118075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.118200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.118318 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.118435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.118551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.118687 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.118808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.118937 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.119057 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.119174 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.119291 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.119409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.119526 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.119651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.119770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.119870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.119967 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.119967 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.120185 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.120185 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.120414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.120530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.120646 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.120763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.120864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.120864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.121057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.121057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.121275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.121275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.121495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.121495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.121690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.121690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.121870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.121985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.122102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.122836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.123011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.123248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.123368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.123486 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.123613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.123732 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.123849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.123966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.124082 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.124200 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.124325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.124444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.124560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.124677 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.124793 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.124910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.125035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.125154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.125271 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.125388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.125504 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.125621 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.125746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.125864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.125980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.126097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.126213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.126331 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.126456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.126575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.126709 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.126828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.126945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.127062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.127190 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.127310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.127428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.127545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.127661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.127777 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.127903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.128021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.128138 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.128254 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.128371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.128488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.128613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.128731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.128854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.128973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.129089 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.129205 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.129330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.129449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.129566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.129682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.129799 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.129915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.130040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.130159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.130276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.130392 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.130510 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.130627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.130826 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.130959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.131078 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.131204 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.131331 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.131450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.131568 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.131686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.131803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.132000 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.132122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.132240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.132357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.132473 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.132591 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.132717 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.132835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.132952 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.133069 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.133186 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.133302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.133429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.133548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.133666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.133783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.133900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.133900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.134127 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.134247 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.134364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.134481 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.134598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.134729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.134861 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.134981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.135097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.135215 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:13:54.135333 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.135333 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:13:54.135333 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:13:54.163920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.164098 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.164238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.164320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.164418 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.164499 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.172994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.173105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.202451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.202698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.202789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.202972 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.348249 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.348492 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.398960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.399178 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.400060 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.400296 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.478102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.478311 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.478429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.478519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.478662 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.478766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.478909 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.478995 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.479130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.479222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.479344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.479562 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.504381 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.504615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.504711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.504844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.504928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.505059 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.505143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.505274 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.505357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.505486 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.505579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.505696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.505777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.505906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.517504 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.517696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.530390 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.530536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.530635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.530779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.530884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.531000 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.531082 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.531213 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.531296 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.531421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.531514 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.531631 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.531715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.531839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:13:54.549659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.549805 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 19:13:54.549891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.550047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 19:13:54.550131 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.550324 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 19:13:54.550416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.550594 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.550698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 19:13:54.550880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.550965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.551139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.551235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.551423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.551514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.551641 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.563297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.563431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.563566 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.563706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.563828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.563973 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.564107 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.564252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.572479 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.572633 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.575970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.576067 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.576241 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.576328 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.576516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.576600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.576904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.576997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.577188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.577271 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.577446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.577527 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.577713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.577804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.577990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.578081 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.578254 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.578336 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.578525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.578607 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.578817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.578897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.605109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.605504 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.607251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.607534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.607673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.607933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.612794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.613072 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.613203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.613348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.613482 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.613764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.620627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.620906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.621066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.621346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.625597 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.625880 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.626154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.626237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.626431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.626516 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.626721 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.626821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.626996 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.627079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.627260 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.627342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.627523 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.627606 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.627832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.628099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.647088 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.647365 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.647459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.647646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.651960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.652252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.655793 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.655985 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.656073 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.656279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.661083 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.661309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.664683 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.664965 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.668458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.668749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.668839 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.669572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.669663 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.669880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.669980 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.670162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.670250 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.670446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.670533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.670875 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.690344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.690542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.690760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.690959 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.691044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.691231 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.691320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.691495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.699444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.699733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.701335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.701603 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.701690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.701917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.704677 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.704951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.705097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.705229 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.705377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.705506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.705656 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.705833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.705919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.706202 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.720016 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.720288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.720375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.720651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.720754 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.720859 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.720945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.721142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.721237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.721425 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.721510 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.721697 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.721782 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.721980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.741841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.742260 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.745131 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.745573 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.748563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.749077 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.750163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.750749 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.751820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.752094 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.752341 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.752429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.752622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.752911 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.759849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.760401 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.761533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.762011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.764921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.765203 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.765288 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.765478 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.765560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.765772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.765859 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.766089 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.774965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.775249 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.775382 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.775530 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.775667 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.775942 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.783990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.784265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.784569 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:13:54.784682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.784762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.784837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.785006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.785100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.785286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.785379 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.785556 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.785638 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.785833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.785916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.786111 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.786193 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.786376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.786456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.786645 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.786838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.786923 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.787115 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.787197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.787387 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.787468 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.787649 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.787914 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.788181 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:13:54.826645 dv-cinder-835384-16-smb devstack@keystone.service[80398]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5609a1e8f9c0 pid: 80398 (default app) Jul 20 19:13:54.827527 dv-cinder-835384-16-smb devstack@keystone.service[80399]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5609a1e8f9c0 pid: 80399 (default app) Jul 20 19:13:54.829960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0e39e-09a4-460f-9800-d2a8b87c91ae None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:54.830251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0e39e-09a4-460f-9800-d2a8b87c91ae None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:54.830523 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0e39e-09a4-460f-9800-d2a8b87c91ae None None] PATH_INFO: `/v3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:54.834764 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Wed Jul 20 19:13:54 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:03.473158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a899-b021-4c94-b4c2-b09079f0c019 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:03.473727 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a899-b021-4c94-b4c2-b09079f0c019 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:03.473727 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a899-b021-4c94-b4c2-b09079f0c019 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:03.478080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:14:03.484078 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb20ab-51cc-4c51-adb7-5995b4adaeb7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:03.484509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb20ab-51cc-4c51-adb7-5995b4adaeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:03.484624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb20ab-51cc-4c51-adb7-5995b4adaeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:03.553610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: INFO dbcounter [None req-3ffb20ab-51cc-4c51-adb7-5995b4adaeb7 None None] Registered counter for database keystone Jul 20 19:14:03.575800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG oslo_db.sqlalchemy.engines [None req-3ffb20ab-51cc-4c51-adb7-5995b4adaeb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:03.582192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writer thread running {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:03.764955 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG passlib.handlers.bcrypt [None req-3ffb20ab-51cc-4c51-adb7-5995b4adaeb7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80398) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 19:14:03.765390 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG passlib.handlers.bcrypt [None req-3ffb20ab-51cc-4c51-adb7-5995b4adaeb7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80398) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 19:14:03.821416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3ffb20ab-51cc-4c51-adb7-5995b4adaeb7 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:03.822983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3ffb20ab-51cc-4c51-adb7-5995b4adaeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:03.945433 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 20 19:14:04.107107 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791a899-b021-4c94-b4c2-b09079f0c019 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:04.177455 dv-cinder-835384-16-smb devstack@keystone.service[80399]: INFO dbcounter [None req-4791a899-b021-4c94-b4c2-b09079f0c019 None None] Registered counter for database keystone Jul 20 19:14:04.197454 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG oslo_db.sqlalchemy.engines [None req-4791a899-b021-4c94-b4c2-b09079f0c019 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:04.204686 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writer thread running {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:04.327801 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791a899-b021-4c94-b4c2-b09079f0c019 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:04.332255 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ecc8b-49e9-412d-a9a2-25c6f8e79ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:04.332928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ecc8b-49e9-412d-a9a2-25c6f8e79ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:04.333212 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ecc8b-49e9-412d-a9a2-25c6f8e79ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:04.333487 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ecc8b-49e9-412d-a9a2-25c6f8e79ad5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:04.343119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ecc8b-49e9-412d-a9a2-25c6f8e79ad5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:04.396583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d17ecc8b-49e9-412d-a9a2-25c6f8e79ad5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 19:14:04.396845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ecc8b-49e9-412d-a9a2-25c6f8e79ad5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:04.408021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Jul 20 19:14:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:14:04.414170 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb20ab-51cc-4c51-adb7-5995b4adaeb7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:04.433131 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb20ab-51cc-4c51-adb7-5995b4adaeb7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:04.438425 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d50bb-beb6-470a-879c-0c6c50df2aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:04.439598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d50bb-beb6-470a-879c-0c6c50df2aec admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:04.439882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d50bb-beb6-470a-879c-0c6c50df2aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:04.440151 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d50bb-beb6-470a-879c-0c6c50df2aec admin admin] PATH_INFO: `/v3/projects/19ff1600e760429b9e38b7ac11d31b62` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:04.444679 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d50bb-beb6-470a-879c-0c6c50df2aec admin admin] RBAC: Authorizing `identity:get_project(project_id=19ff1600e760429b9e38b7ac11d31b62)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:04.498463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a48d50bb-beb6-470a-879c-0c6c50df2aec admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 19:14:04.499127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d50bb-beb6-470a-879c-0c6c50df2aec admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:04.503521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Jul 20 19:14:04 2022] GET /identity/v3/projects/19ff1600e760429b9e38b7ac11d31b62 => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:06.518308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f745b-bacc-4340-9a81-1ba02c5f13d3 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:06.518920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f745b-bacc-4340-9a81-1ba02c5f13d3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:06.518920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f745b-bacc-4340-9a81-1ba02c5f13d3 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:06.523005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:06.529383 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b2d49-bbb3-4ef5-8f66-930025265984 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:06.529802 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b2d49-bbb3-4ef5-8f66-930025265984 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:06.529935 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b2d49-bbb3-4ef5-8f66-930025265984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:06.549217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-623b2d49-bbb3-4ef5-8f66-930025265984 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:06.550798 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-623b2d49-bbb3-4ef5-8f66-930025265984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:06.558890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 19:14:06.581953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f745b-bacc-4340-9a81-1ba02c5f13d3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:06.595221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f745b-bacc-4340-9a81-1ba02c5f13d3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:06.599454 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d963dd-9a5d-4099-8d89-253ec3d428c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:06.600092 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d963dd-9a5d-4099-8d89-253ec3d428c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:06.600375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d963dd-9a5d-4099-8d89-253ec3d428c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:06.600649 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d963dd-9a5d-4099-8d89-253ec3d428c7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:06.608507 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d963dd-9a5d-4099-8d89-253ec3d428c7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:06.610298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d963dd-9a5d-4099-8d89-253ec3d428c7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:06.619166 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Jul 20 19:14:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:14:06.624975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b2d49-bbb3-4ef5-8f66-930025265984 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:06.634131 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b2d49-bbb3-4ef5-8f66-930025265984 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:06.639241 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710c203-b276-4b07-9c56-897b1c51e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:06.640107 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710c203-b276-4b07-9c56-897b1c51e380 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:06.640389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710c203-b276-4b07-9c56-897b1c51e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:06.640662 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710c203-b276-4b07-9c56-897b1c51e380 admin admin] PATH_INFO: `/v3/users/bc14ede82e87407488accc3a9acc26ad` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:06.642067 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710c203-b276-4b07-9c56-897b1c51e380 admin admin] RBAC: Authorizing `identity:get_user(user_id=bc14ede82e87407488accc3a9acc26ad)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:06.643947 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710c203-b276-4b07-9c56-897b1c51e380 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:06.645543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Wed Jul 20 19:14:06 2022] GET /identity/v3/users/bc14ede82e87407488accc3a9acc26ad => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:08.755792 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d75f37-fc00-44f1-9fc8-e26805fe949f None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:08.756330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d75f37-fc00-44f1-9fc8-e26805fe949f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:08.756330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d75f37-fc00-44f1-9fc8-e26805fe949f None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:08.757704 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:14:08.763356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca4331-8237-40e6-a08c-a6092030f0d4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:08.763803 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca4331-8237-40e6-a08c-a6092030f0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:08.764044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca4331-8237-40e6-a08c-a6092030f0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:08.766048 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928fdcc-0869-4a40-8a3b-f4dd50af9ee8 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:08.766333 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928fdcc-0869-4a40-8a3b-f4dd50af9ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:08.766611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928fdcc-0869-4a40-8a3b-f4dd50af9ee8 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:08.767939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:14:08.772928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bc3d0-84bc-4f06-bef6-d98a1021190d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:08.773219 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bc3d0-84bc-4f06-bef6-d98a1021190d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:08.773491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bc3d0-84bc-4f06-bef6-d98a1021190d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:08.780966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-fcca4331-8237-40e6-a08c-a6092030f0d4 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:08.782155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fcca4331-8237-40e6-a08c-a6092030f0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:08.815000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG passlib.handlers.bcrypt [None req-ee4bc3d0-84bc-4f06-bef6-d98a1021190d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80399) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 19:14:08.815426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG passlib.handlers.bcrypt [None req-ee4bc3d0-84bc-4f06-bef6-d98a1021190d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80399) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 19:14:08.861456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ee4bc3d0-84bc-4f06-bef6-d98a1021190d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:08.863102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ee4bc3d0-84bc-4f06-bef6-d98a1021190d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:08.865502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:08.889624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca4331-8237-40e6-a08c-a6092030f0d4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:08.914073 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:08.966056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:08.988862 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bc3d0-84bc-4f06-bef6-d98a1021190d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:08.996095 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca4331-8237-40e6-a08c-a6092030f0d4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:09.030706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa952bf5-35d1-4e43-8929-f0e020a7e94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:09.031443 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa952bf5-35d1-4e43-8929-f0e020a7e94e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:09.031725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa952bf5-35d1-4e43-8929-f0e020a7e94e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:09.032006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa952bf5-35d1-4e43-8929-f0e020a7e94e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:09.044345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa952bf5-35d1-4e43-8929-f0e020a7e94e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-fa952bf5-35d1-4e43-8929-f0e020a7e94e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:09.055756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:09.056865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:09.057932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:09.057932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:09.057932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:09.057932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:09.057932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:09.057932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:09.057932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:09.057932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:09.057932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:09.057932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:09.057932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:09.057932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:09.057932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:14:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:09.062811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa952bf5-35d1-4e43-8929-f0e020a7e94e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:09.090330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bc3d0-84bc-4f06-bef6-d98a1021190d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:09.092849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:09.128165 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5901d8-9b54-4cb1-b9f4-bff18da8ae3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:09.129321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5901d8-9b54-4cb1-b9f4-bff18da8ae3d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:09.129605 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5901d8-9b54-4cb1-b9f4-bff18da8ae3d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:09.129884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5901d8-9b54-4cb1-b9f4-bff18da8ae3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:09.144220 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:09.162611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa952bf5-35d1-4e43-8929-f0e020a7e94e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:09.196956 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1946a85-661a-4764-ad5f-2bda8958ee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:09.197625 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1946a85-661a-4764-ad5f-2bda8958ee55 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:09.197912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1946a85-661a-4764-ad5f-2bda8958ee55 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:09.198189 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1946a85-661a-4764-ad5f-2bda8958ee55 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:09.198290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5901d8-9b54-4cb1-b9f4-bff18da8ae3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:09.199152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1946a85-661a-4764-ad5f-2bda8958ee55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:09.199600 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1946a85-661a-4764-ad5f-2bda8958ee55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:09.199972 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5901d8-9b54-4cb1-b9f4-bff18da8ae3d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:09.201114 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1946a85-661a-4764-ad5f-2bda8958ee55 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:09.213068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:09.219383 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1946a85-661a-4764-ad5f-2bda8958ee55 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:09.305159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:14:09.311101 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5901d8-9b54-4cb1-b9f4-bff18da8ae3d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:09.313909 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:09.323670 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1946a85-661a-4764-ad5f-2bda8958ee55 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:09.360746 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69029a-970b-4516-9b0b-d8109d0b038b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:09.361615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69029a-970b-4516-9b0b-d8109d0b038b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:09.361891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69029a-970b-4516-9b0b-d8109d0b038b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:09.362166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69029a-970b-4516-9b0b-d8109d0b038b None admin] PATH_INFO: `/v3/users/bc14ede82e87407488accc3a9acc26ad` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:09.363529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69029a-970b-4516-9b0b-d8109d0b038b None admin] RBAC: Authorizing `identity:get_user(user_id=bc14ede82e87407488accc3a9acc26ad)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:09.364907 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69029a-970b-4516-9b0b-d8109d0b038b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:09.366564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:09 2022] GET /identity/v3/users/bc14ede82e87407488accc3a9acc26ad => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:09.374056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69029a-970b-4516-9b0b-d8109d0b038b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:09.389805 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:09.419216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5901d8-9b54-4cb1-b9f4-bff18da8ae3d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:09.453644 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d553a1-5f1c-4c24-b748-144b95fd5179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:09.454464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d553a1-5f1c-4c24-b748-144b95fd5179 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:09.454773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d553a1-5f1c-4c24-b748-144b95fd5179 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:09.455048 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d553a1-5f1c-4c24-b748-144b95fd5179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:09.474238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d553a1-5f1c-4c24-b748-144b95fd5179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:09.475742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d553a1-5f1c-4c24-b748-144b95fd5179 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:09.480248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69029a-970b-4516-9b0b-d8109d0b038b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:09.498926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-70d553a1-5f1c-4c24-b748-144b95fd5179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:09.498926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:09.498926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:09.498926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:09.498926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:09.498926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:09.498926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:09.498926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:09.498926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:09.498926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:09.498926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:09.498926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:09.498926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:09.498926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:09.498926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:09.499907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:09.500728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:09.500728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:09.500728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:09.500728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:09.500728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:09.506033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d553a1-5f1c-4c24-b748-144b95fd5179 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:09.515306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da118564-b45a-4f36-98f2-f0dee46a63c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:09.516103 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da118564-b45a-4f36-98f2-f0dee46a63c8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:09.516378 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da118564-b45a-4f36-98f2-f0dee46a63c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:09.516651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da118564-b45a-4f36-98f2-f0dee46a63c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:09.517830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da118564-b45a-4f36-98f2-f0dee46a63c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:09.519339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da118564-b45a-4f36-98f2-f0dee46a63c8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:09.520944 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:09.526558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da118564-b45a-4f36-98f2-f0dee46a63c8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:09.561885 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:09.606652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d553a1-5f1c-4c24-b748-144b95fd5179 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:09.607752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:09.626355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da118564-b45a-4f36-98f2-f0dee46a63c8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:09.640334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721901f-af19-4363-8b82-1a3a3e8beda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:09.641014 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721901f-af19-4363-8b82-1a3a3e8beda9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:09.641304 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721901f-af19-4363-8b82-1a3a3e8beda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:09.641577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721901f-af19-4363-8b82-1a3a3e8beda9 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:09.642317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721901f-af19-4363-8b82-1a3a3e8beda9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:09.642625 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721901f-af19-4363-8b82-1a3a3e8beda9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:09.644055 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721901f-af19-4363-8b82-1a3a3e8beda9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:09.662017 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:09.662638 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab5d5-40ce-41c3-a134-3bcfb06d1381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:09.663317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab5d5-40ce-41c3-a134-3bcfb06d1381 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:09.663599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab5d5-40ce-41c3-a134-3bcfb06d1381 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:09.663871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab5d5-40ce-41c3-a134-3bcfb06d1381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:09.664713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab5d5-40ce-41c3-a134-3bcfb06d1381 None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.domain.id=default, user.id=bc14ede82e87407488accc3a9acc26ad) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:09.665020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab5d5-40ce-41c3-a134-3bcfb06d1381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:09.666500 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab5d5-40ce-41c3-a134-3bcfb06d1381 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:09.675577 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Jul 20 19:14:09 2022] GET /identity/v3/role_assignments?user.id=bc14ede82e87407488accc3a9acc26ad&scope.domain.id=default&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:11.957460 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d03ed-f184-4669-bd98-5f2d8afcbada None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:11.957972 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d03ed-f184-4669-bd98-5f2d8afcbada None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:11.958070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d03ed-f184-4669-bd98-5f2d8afcbada None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:11.959786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:11.965727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685ea6f-13f0-4783-8550-968c3eceaa57 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:11.966735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685ea6f-13f0-4783-8550-968c3eceaa57 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:11.967234 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685ea6f-13f0-4783-8550-968c3eceaa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:11.991832 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1685ea6f-13f0-4783-8550-968c3eceaa57 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:11.993501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1685ea6f-13f0-4783-8550-968c3eceaa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:12.081901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:12.124234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d03ed-f184-4669-bd98-5f2d8afcbada None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:12.267446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d03ed-f184-4669-bd98-5f2d8afcbada None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:12.290638 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:12.315002 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9255d65-6795-43db-b326-baf60105705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:12.315811 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9255d65-6795-43db-b326-baf60105705d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:12.316088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9255d65-6795-43db-b326-baf60105705d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:12.316357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9255d65-6795-43db-b326-baf60105705d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:12.336026 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9255d65-6795-43db-b326-baf60105705d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d9255d65-6795-43db-b326-baf60105705d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:12.345680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:12.346542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:12.347344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:12.347344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:12.347344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:12.347344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:12.347344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:12.347344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:12.347344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:12.347344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:12.347344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:12.347344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:12.347344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:12.347344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:12.347344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 12/24] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:14:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:12.353306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685ea6f-13f0-4783-8550-968c3eceaa57 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:12.478926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:12.501904 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a41c4-eb20-45bf-860e-7e940eccdc6d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:12.502235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a41c4-eb20-45bf-860e-7e940eccdc6d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:12.502453 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a41c4-eb20-45bf-860e-7e940eccdc6d None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:12.503884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 13/25] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:14:12.512944 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811fc7e-b268-401e-aac0-1323abe51ae9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:12.513218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811fc7e-b268-401e-aac0-1323abe51ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:12.513493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811fc7e-b268-401e-aac0-1323abe51ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:12.522861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685ea6f-13f0-4783-8550-968c3eceaa57 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:12.544348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4811fc7e-b268-401e-aac0-1323abe51ae9 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:12.545579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4811fc7e-b268-401e-aac0-1323abe51ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:12.584960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1c4a2-7509-4c4e-a3a6-f7d4ee918393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:12.586104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1c4a2-7509-4c4e-a3a6-f7d4ee918393 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:12.586588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1c4a2-7509-4c4e-a3a6-f7d4ee918393 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:12.587091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1c4a2-7509-4c4e-a3a6-f7d4ee918393 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:12.588146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1c4a2-7509-4c4e-a3a6-f7d4ee918393 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:12.588659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1c4a2-7509-4c4e-a3a6-f7d4ee918393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:12.590381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1c4a2-7509-4c4e-a3a6-f7d4ee918393 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:12.614074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 13/26] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:12.620051 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1c4a2-7509-4c4e-a3a6-f7d4ee918393 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:12.660164 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:12.708914 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811fc7e-b268-401e-aac0-1323abe51ae9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:12.794753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1c4a2-7509-4c4e-a3a6-f7d4ee918393 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:12.832330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07338ea-ed11-4aaf-b154-ae24d08eb02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:12.833232 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07338ea-ed11-4aaf-b154-ae24d08eb02f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:12.833513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07338ea-ed11-4aaf-b154-ae24d08eb02f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:12.833786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07338ea-ed11-4aaf-b154-ae24d08eb02f None admin] PATH_INFO: `/v3/users/bc14ede82e87407488accc3a9acc26ad` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:12.835097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07338ea-ed11-4aaf-b154-ae24d08eb02f None admin] RBAC: Authorizing `identity:get_user(user_id=bc14ede82e87407488accc3a9acc26ad)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:12.836601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07338ea-ed11-4aaf-b154-ae24d08eb02f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:12.843034 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 14/28] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:12 2022] GET /identity/v3/users/bc14ede82e87407488accc3a9acc26ad => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:12.844480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407610d-3a8e-4e2e-8d44-4f996c5253ac None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:12.844800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407610d-3a8e-4e2e-8d44-4f996c5253ac None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:12.845079 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407610d-3a8e-4e2e-8d44-4f996c5253ac None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:12.846839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 15/29] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:12.848244 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773400fd-663f-4e05-a696-ccc0a75b02e2 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:12.848353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773400fd-663f-4e05-a696-ccc0a75b02e2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:12.848632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773400fd-663f-4e05-a696-ccc0a75b02e2 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:12.849919 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:12.850842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773400fd-663f-4e05-a696-ccc0a75b02e2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:12.855596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:12.864956 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811fc7e-b268-401e-aac0-1323abe51ae9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:12.902373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320a86b-e326-4b37-b80c-f9b938f882a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:12.903264 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320a86b-e326-4b37-b80c-f9b938f882a0 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:12.903555 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320a86b-e326-4b37-b80c-f9b938f882a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:12.903810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320a86b-e326-4b37-b80c-f9b938f882a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:12.904576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320a86b-e326-4b37-b80c-f9b938f882a0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:12.906103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320a86b-e326-4b37-b80c-f9b938f882a0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:12.915066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:12.967073 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773400fd-663f-4e05-a696-ccc0a75b02e2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:13.005306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc356b7e-120b-4e4f-9c19-0f20fda13ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:13.006113 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc356b7e-120b-4e4f-9c19-0f20fda13ede None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:13.006394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc356b7e-120b-4e4f-9c19-0f20fda13ede None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:13.006695 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc356b7e-120b-4e4f-9c19-0f20fda13ede None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:13.007890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc356b7e-120b-4e4f-9c19-0f20fda13ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:13.009378 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc356b7e-120b-4e4f-9c19-0f20fda13ede None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:13.011076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 17/31] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:13.012916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edac871-2b65-473d-b601-6651ee1aa6d1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:13.013207 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edac871-2b65-473d-b601-6651ee1aa6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:13.013481 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edac871-2b65-473d-b601-6651ee1aa6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:13.033475 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1edac871-2b65-473d-b601-6651ee1aa6d1 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:13.034849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1edac871-2b65-473d-b601-6651ee1aa6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:13.112942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 18/32] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:13.114262 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289012c-c5ca-446f-abcd-acbb64357513 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:13.114557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289012c-c5ca-446f-abcd-acbb64357513 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:13.114877 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289012c-c5ca-446f-abcd-acbb64357513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:13.120091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:13.133459 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9289012c-c5ca-446f-abcd-acbb64357513 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:13.134698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9289012c-c5ca-446f-abcd-acbb64357513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:13.178986 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 15/33] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jul 20 19:14:12 2022] POST /identity/v3/roles => generated 219 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:14:13.180733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320a86b-e326-4b37-b80c-f9b938f882a0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:13.258898 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 19/34] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:13.261668 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289012c-c5ca-446f-abcd-acbb64357513 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:13.411125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320a86b-e326-4b37-b80c-f9b938f882a0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:13.445650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289012c-c5ca-446f-abcd-acbb64357513 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:13.459956 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dc814-1705-4d49-9381-6cfdf2066b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:13.460860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dc814-1705-4d49-9381-6cfdf2066b3a None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:13.461146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dc814-1705-4d49-9381-6cfdf2066b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:13.461426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dc814-1705-4d49-9381-6cfdf2066b3a None admin] PATH_INFO: `/v3/domains/default/users/bc14ede82e87407488accc3a9acc26ad/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:13.464827 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dc814-1705-4d49-9381-6cfdf2066b3a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bc14ede82e87407488accc3a9acc26ad, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:13.466591 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dc814-1705-4d49-9381-6cfdf2066b3a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:13.485554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:13.491295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fc2e4-6d22-4b73-82e1-69eb066e1696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:13.492085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fc2e4-6d22-4b73-82e1-69eb066e1696 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:13.492413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fc2e4-6d22-4b73-82e1-69eb066e1696 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:13.492687 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fc2e4-6d22-4b73-82e1-69eb066e1696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:13.504420 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fc2e4-6d22-4b73-82e1-69eb066e1696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:13.505983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fc2e4-6d22-4b73-82e1-69eb066e1696 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:13.526021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f76fc2e4-6d22-4b73-82e1-69eb066e1696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:13.526021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:13.526021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:13.526021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:13.526021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:13.526021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:13.526021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:13.526021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:13.526021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:13.526021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:13.526021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:13.526021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:13.526021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:13.526021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:13.526021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:13.527735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:13.528629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:13.528629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:13.528629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:13.528629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:13.528629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 20/35] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:13.529233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fc2e4-6d22-4b73-82e1-69eb066e1696 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:13.580790 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 16/36] 10.222.0.16 () {58 vars in 1361 bytes} [Wed Jul 20 19:14:13 2022] PUT /identity/v3/domains/default/users/bc14ede82e87407488accc3a9acc26ad/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:14:13.581567 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dc814-1705-4d49-9381-6cfdf2066b3a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:13.643371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:13.684266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fc2e4-6d22-4b73-82e1-69eb066e1696 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:13.724376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6d8e5-e95f-4bd8-ad99-fff23fba8ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:13.725417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6d8e5-e95f-4bd8-ad99-fff23fba8ac0 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:13.725931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6d8e5-e95f-4bd8-ad99-fff23fba8ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:13.726462 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6d8e5-e95f-4bd8-ad99-fff23fba8ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:13.727873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6d8e5-e95f-4bd8-ad99-fff23fba8ac0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:13.729562 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6d8e5-e95f-4bd8-ad99-fff23fba8ac0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:13.760146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dc814-1705-4d49-9381-6cfdf2066b3a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:13.801706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a6a75-5075-4814-9215-12994bc538f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:13.802814 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a6a75-5075-4814-9215-12994bc538f8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:13.803307 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a6a75-5075-4814-9215-12994bc538f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:13.803927 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a6a75-5075-4814-9215-12994bc538f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:13.804875 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a6a75-5075-4814-9215-12994bc538f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:13.805430 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a6a75-5075-4814-9215-12994bc538f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:13.807186 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a6a75-5075-4814-9215-12994bc538f8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:13.824667 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 17/37] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:13.826296 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce92f0-0199-4c02-923c-526ce5851fdc None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:13.826589 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce92f0-0199-4c02-923c-526ce5851fdc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:13.834235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce92f0-0199-4c02-923c-526ce5851fdc None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:13.834235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 18/38] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:13.834235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce92f0-0199-4c02-923c-526ce5851fdc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:13.945639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:13.961500 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 21/39] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jul 20 19:14:13 2022] POST /identity/v3/roles => generated 225 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:14:13.963607 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861dc1a-568e-4567-9567-badfa32fe48a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:13.964265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861dc1a-568e-4567-9567-badfa32fe48a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:13.964923 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861dc1a-568e-4567-9567-badfa32fe48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:13.971812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce92f0-0199-4c02-923c-526ce5851fdc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:14.046523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0f610-3a44-4d63-b8a6-dc4e6d811daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:14.047255 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0f610-3a44-4d63-b8a6-dc4e6d811daa None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:14.047543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0f610-3a44-4d63-b8a6-dc4e6d811daa None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:14.047822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0f610-3a44-4d63-b8a6-dc4e6d811daa None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:14.049051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0f610-3a44-4d63-b8a6-dc4e6d811daa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:14.050623 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0f610-3a44-4d63-b8a6-dc4e6d811daa None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:14.123950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3861dc1a-568e-4567-9567-badfa32fe48a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:14.125670 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3861dc1a-568e-4567-9567-badfa32fe48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:14.182564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 19/40] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 20 19:14:13 2022] POST /identity/v3/projects => generated 301 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:14:14.184563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acb787-2c95-4fdc-9de8-8794e819d494 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:14.184853 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acb787-2c95-4fdc-9de8-8794e819d494 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:14.185128 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acb787-2c95-4fdc-9de8-8794e819d494 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:14.186443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 20/41] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:14.188447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:14.192106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061e6a8-4c3b-411d-8c73-a0371ea1c51d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:14.192449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061e6a8-4c3b-411d-8c73-a0371ea1c51d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:14.192663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061e6a8-4c3b-411d-8c73-a0371ea1c51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:14.223400 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5061e6a8-4c3b-411d-8c73-a0371ea1c51d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:14.226103 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 22/42] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:14.227208 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5061e6a8-4c3b-411d-8c73-a0371ea1c51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:14.252472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861dc1a-568e-4567-9567-badfa32fe48a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:14.368217 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 21/43] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:14.391876 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061e6a8-4c3b-411d-8c73-a0371ea1c51d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:14.431957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861dc1a-568e-4567-9567-badfa32fe48a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:14.471806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68b60f-a9e3-4e7d-abd3-d6817da84aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:14.472486 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68b60f-a9e3-4e7d-abd3-d6817da84aea None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:14.472767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68b60f-a9e3-4e7d-abd3-d6817da84aea None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:14.473048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68b60f-a9e3-4e7d-abd3-d6817da84aea None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:14.474725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68b60f-a9e3-4e7d-abd3-d6817da84aea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:14.476224 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68b60f-a9e3-4e7d-abd3-d6817da84aea None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:14.483802 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:14.523417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061e6a8-4c3b-411d-8c73-a0371ea1c51d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:14.556461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jul 20 19:14:14 2022] POST /identity/v3/roles => generated 223 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:14:14.559575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76278c8e-1154-4d01-8f2e-fbf5afbcb13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:14.560403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76278c8e-1154-4d01-8f2e-fbf5afbcb13c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:14.560687 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76278c8e-1154-4d01-8f2e-fbf5afbcb13c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:14.560967 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76278c8e-1154-4d01-8f2e-fbf5afbcb13c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:14.562295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76278c8e-1154-4d01-8f2e-fbf5afbcb13c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:14.565452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76278c8e-1154-4d01-8f2e-fbf5afbcb13c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:14.567595 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 22/45] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:14.574532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68b60f-a9e3-4e7d-abd3-d6817da84aea None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:14.619898 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:14.698011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68b60f-a9e3-4e7d-abd3-d6817da84aea None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:14.739519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e87e3-2118-4401-9b18-675fff55bb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:14.740117 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e87e3-2118-4401-9b18-675fff55bb45 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:14.740398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e87e3-2118-4401-9b18-675fff55bb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:14.740673 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e87e3-2118-4401-9b18-675fff55bb45 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:14.741701 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e87e3-2118-4401-9b18-675fff55bb45 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:14.742904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e87e3-2118-4401-9b18-675fff55bb45 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:14.843460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 20 19:14:14 2022] POST /identity/v3/projects => generated 312 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:14:15.866062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dc6d4-df42-42a4-b7e9-6c6e9d60caef None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:15.866614 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dc6d4-df42-42a4-b7e9-6c6e9d60caef None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:15.866614 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dc6d4-df42-42a4-b7e9-6c6e9d60caef None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:15.868031 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 23/47] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:15.873723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbf805-f82a-4f81-940c-7b415062f280 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:15.874221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbf805-f82a-4f81-940c-7b415062f280 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:15.874330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbf805-f82a-4f81-940c-7b415062f280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:15.891691 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5adbf805-f82a-4f81-940c-7b415062f280 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:15.892898 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5adbf805-f82a-4f81-940c-7b415062f280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:15.962833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:15.987171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dc6d4-df42-42a4-b7e9-6c6e9d60caef None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:16.091518 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dc6d4-df42-42a4-b7e9-6c6e9d60caef None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:16.125106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698b866-639b-4ebf-9bee-22f6d227ffb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:16.125821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698b866-639b-4ebf-9bee-22f6d227ffb9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:16.126106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698b866-639b-4ebf-9bee-22f6d227ffb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:16.126379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698b866-639b-4ebf-9bee-22f6d227ffb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:16.129105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:16.137636 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698b866-639b-4ebf-9bee-22f6d227ffb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-1698b866-639b-4ebf-9bee-22f6d227ffb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:16.145302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:16.146148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:16.146924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:16.146924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:16.146924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:16.146924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:16.146924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:16.146924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:16.146924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:16.146924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:16.146924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:16.146924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:16.146924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:16.146924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:16.146924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 24/49] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:14:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:16.153351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbf805-f82a-4f81-940c-7b415062f280 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:16.171080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:16.254196 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbf805-f82a-4f81-940c-7b415062f280 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:16.291185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab70ece-b312-4887-a7d4-7e59f1b0512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:16.291861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab70ece-b312-4887-a7d4-7e59f1b0512d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:16.292199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab70ece-b312-4887-a7d4-7e59f1b0512d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:16.292511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab70ece-b312-4887-a7d4-7e59f1b0512d None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:16.293232 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab70ece-b312-4887-a7d4-7e59f1b0512d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:16.293538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab70ece-b312-4887-a7d4-7e59f1b0512d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:16.294973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab70ece-b312-4887-a7d4-7e59f1b0512d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:16.303273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 26/50] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:16.308801 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698b866-639b-4ebf-9bee-22f6d227ffb9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:16.410426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698b866-639b-4ebf-9bee-22f6d227ffb9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:16.444063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6ba91-1102-44e8-8f65-432ad851b773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:16.444947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6ba91-1102-44e8-8f65-432ad851b773 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:16.445234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6ba91-1102-44e8-8f65-432ad851b773 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:16.445524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6ba91-1102-44e8-8f65-432ad851b773 None admin] PATH_INFO: `/v3/users/bc14ede82e87407488accc3a9acc26ad` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:16.446747 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6ba91-1102-44e8-8f65-432ad851b773 None admin] RBAC: Authorizing `identity:get_user(user_id=bc14ede82e87407488accc3a9acc26ad)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:16.448232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6ba91-1102-44e8-8f65-432ad851b773 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:16.450460 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 25/51] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:16 2022] GET /identity/v3/users/bc14ede82e87407488accc3a9acc26ad => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:16.455860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab70ece-b312-4887-a7d4-7e59f1b0512d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:16.535150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:16.558965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab70ece-b312-4887-a7d4-7e59f1b0512d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:16.595164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83362b6-0b02-4973-a70d-151d3b71fd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:16.595970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83362b6-0b02-4973-a70d-151d3b71fd6f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:16.596250 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83362b6-0b02-4973-a70d-151d3b71fd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:16.596527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83362b6-0b02-4973-a70d-151d3b71fd6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:16.597716 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83362b6-0b02-4973-a70d-151d3b71fd6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:16.599256 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83362b6-0b02-4973-a70d-151d3b71fd6f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:16.600848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 27/52] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:16.607075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6ba91-1102-44e8-8f65-432ad851b773 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:16.674022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:16.713802 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6ba91-1102-44e8-8f65-432ad851b773 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:16.752315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae31f43-837b-493d-b60b-7a9ac7b588cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:16.753013 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae31f43-837b-493d-b60b-7a9ac7b588cc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:16.753298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae31f43-837b-493d-b60b-7a9ac7b588cc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:16.753571 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae31f43-837b-493d-b60b-7a9ac7b588cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:16.754433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae31f43-837b-493d-b60b-7a9ac7b588cc None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.domain.id=default, user.id=bc14ede82e87407488accc3a9acc26ad) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:16.754760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae31f43-837b-493d-b60b-7a9ac7b588cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:16.756226 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae31f43-837b-493d-b60b-7a9ac7b588cc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:16.770930 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Jul 20 19:14:16 2022] GET /identity/v3/role_assignments?user.id=bc14ede82e87407488accc3a9acc26ad&scope.domain.id=default&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 530 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:16.907750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe8bdd-c8fe-4471-8952-c0f8ced92e46 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:16.908263 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe8bdd-c8fe-4471-8952-c0f8ced92e46 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:16.908337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe8bdd-c8fe-4471-8952-c0f8ced92e46 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:16.909879 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 28/54] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:16.916369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cc38d-e5dd-4a8b-9443-1c7139f285c1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:16.916869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cc38d-e5dd-4a8b-9443-1c7139f285c1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:16.917536 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cc38d-e5dd-4a8b-9443-1c7139f285c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:16.941706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-161cc38d-e5dd-4a8b-9443-1c7139f285c1 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:16.942866 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-161cc38d-e5dd-4a8b-9443-1c7139f285c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:17.015227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 27/55] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:17.039050 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe8bdd-c8fe-4471-8952-c0f8ced92e46 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:17.143703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe8bdd-c8fe-4471-8952-c0f8ced92e46 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:17.177032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d452f5-0ede-46cc-a014-16ba7e6ff7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:17.177822 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d452f5-0ede-46cc-a014-16ba7e6ff7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:17.178107 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d452f5-0ede-46cc-a014-16ba7e6ff7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:17.178385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d452f5-0ede-46cc-a014-16ba7e6ff7d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:17.179588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d452f5-0ede-46cc-a014-16ba7e6ff7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:17.181052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d452f5-0ede-46cc-a014-16ba7e6ff7d4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:17.183442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 29/56] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:17.194381 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cc38d-e5dd-4a8b-9443-1c7139f285c1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:17.368035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:17.411146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cc38d-e5dd-4a8b-9443-1c7139f285c1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:17.444151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d130cb-b6dd-418a-8283-c420b3ec1247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:17.444860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d130cb-b6dd-418a-8283-c420b3ec1247 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:17.445093 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d130cb-b6dd-418a-8283-c420b3ec1247 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:17.445367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d130cb-b6dd-418a-8283-c420b3ec1247 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:17.446085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d130cb-b6dd-418a-8283-c420b3ec1247 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:17.447572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d130cb-b6dd-418a-8283-c420b3ec1247 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:17.518987 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 28/57] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Jul 20 19:14:17 2022] POST /identity/v3/projects => generated 298 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:14:19.568345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c7a31-725d-4c23-bda3-b5466f990e00 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:19.568833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c7a31-725d-4c23-bda3-b5466f990e00 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:19.568833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c7a31-725d-4c23-bda3-b5466f990e00 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:19.570196 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 30/58] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:19.575712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86a202-e1a0-4392-b54e-093405dadc87 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:19.576123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86a202-e1a0-4392-b54e-093405dadc87 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:19.576261 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86a202-e1a0-4392-b54e-093405dadc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:19.593105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ab86a202-e1a0-4392-b54e-093405dadc87 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:19.594298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ab86a202-e1a0-4392-b54e-093405dadc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:19.660832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 29/59] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:19.685859 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c7a31-725d-4c23-bda3-b5466f990e00 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:19.702127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:19.786702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c7a31-725d-4c23-bda3-b5466f990e00 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:19.831427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4f6b6-3ca4-4816-8679-fc6f1efcd689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:19.832130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4f6b6-3ca4-4816-8679-fc6f1efcd689 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:19.832412 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4f6b6-3ca4-4816-8679-fc6f1efcd689 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:19.832684 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4f6b6-3ca4-4816-8679-fc6f1efcd689 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:19.833863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4f6b6-3ca4-4816-8679-fc6f1efcd689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:19.835368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4f6b6-3ca4-4816-8679-fc6f1efcd689 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:19.836994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 31/60] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:19.843506 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86a202-e1a0-4392-b54e-093405dadc87 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:19.883321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:19.939504 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86a202-e1a0-4392-b54e-093405dadc87 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:19.973956 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7e64f-9493-44df-9399-7415cb08af15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:19.974698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7e64f-9493-44df-9399-7415cb08af15 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:19.974970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7e64f-9493-44df-9399-7415cb08af15 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:19.975253 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7e64f-9493-44df-9399-7415cb08af15 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:19.976021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7e64f-9493-44df-9399-7415cb08af15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:19.977474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7e64f-9493-44df-9399-7415cb08af15 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:20.071775 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 30/61] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:14:19 2022] POST /identity/v3/users => generated 275 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:14:23.402841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b45bb-9c17-4793-ab9f-77d3dc74308c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:23.403809 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b45bb-9c17-4793-ab9f-77d3dc74308c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:23.404394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b45bb-9c17-4793-ab9f-77d3dc74308c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:23.405988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 32/62] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:14:23.411984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88511d41-69df-4fd1-896b-b7a9246a68af None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:23.412897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88511d41-69df-4fd1-896b-b7a9246a68af None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:23.413399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88511d41-69df-4fd1-896b-b7a9246a68af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:23.435576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-88511d41-69df-4fd1-896b-b7a9246a68af None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:23.437138 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-88511d41-69df-4fd1-896b-b7a9246a68af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:23.490708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dc223-bd11-4e56-9591-5ca5d7197efa None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:23.491324 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dc223-bd11-4e56-9591-5ca5d7197efa None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:23.491794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dc223-bd11-4e56-9591-5ca5d7197efa None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:23.493418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 33/63] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:14:23.499628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18200ed-8c8f-441f-af04-fcff7b0c3101 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:23.500218 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18200ed-8c8f-441f-af04-fcff7b0c3101 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:23.500701 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18200ed-8c8f-441f-af04-fcff7b0c3101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:23.525852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b18200ed-8c8f-441f-af04-fcff7b0c3101 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:23.527680 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b18200ed-8c8f-441f-af04-fcff7b0c3101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:23.538829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 31/64] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:23.540482 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78e725-e658-46b7-b9cd-c3585be681dd None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:23.543124 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78e725-e658-46b7-b9cd-c3585be681dd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:23.543990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78e725-e658-46b7-b9cd-c3585be681dd None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:23.546873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 32/65] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:23.554706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d082a-4110-42b1-a07f-642d6246645f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:23.554706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d082a-4110-42b1-a07f-642d6246645f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:23.554706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d082a-4110-42b1-a07f-642d6246645f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:23.578142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a42d082a-4110-42b1-a07f-642d6246645f None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:23.579442 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a42d082a-4110-42b1-a07f-642d6246645f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:23.601970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:23.627708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 34/66] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:23.628884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18200ed-8c8f-441f-af04-fcff7b0c3101 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:23.647292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:23.661337 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 33/67] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:23.664230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d082a-4110-42b1-a07f-642d6246645f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:23.767378 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18200ed-8c8f-441f-af04-fcff7b0c3101 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:23.793086 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d082a-4110-42b1-a07f-642d6246645f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:23.815164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf8df1-f291-4c45-bb99-d9a62e0f6232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:23.816553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf8df1-f291-4c45-bb99-d9a62e0f6232 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:23.816834 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf8df1-f291-4c45-bb99-d9a62e0f6232 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:23.817112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf8df1-f291-4c45-bb99-d9a62e0f6232 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:23.836393 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf8df1-f291-4c45-bb99-d9a62e0f6232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:23.845843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f071d3a-1eda-4d06-b38d-f35a0ed03c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:23.846971 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f071d3a-1eda-4d06-b38d-f35a0ed03c3a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:23.847482 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f071d3a-1eda-4d06-b38d-f35a0ed03c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:23.847955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f071d3a-1eda-4d06-b38d-f35a0ed03c3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-11bf8df1-f291-4c45-bb99-d9a62e0f6232 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:23.851105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:23.851979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:23.852766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:23.852766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:23.852766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:23.852766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:23.852766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:23.852766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:23.852766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:23.852766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:23.852766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:23.852766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:23.852766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:23.852766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:23.857369 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 35/68] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:23.858448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf8df1-f291-4c45-bb99-d9a62e0f6232 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:23.862800 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f071d3a-1eda-4d06-b38d-f35a0ed03c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5f071d3a-1eda-4d06-b38d-f35a0ed03c3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:23.870857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:23.871710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:23.872461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:23.872461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:23.872461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:23.872461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:23.872461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:23.872461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:23.872461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:23.872461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:23.872461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:23.872461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:23.872461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:23.872461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:23.872461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:14:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:23.873719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa4cec-39cb-4fc5-a87a-e7a32647f3f4 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:23.874199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa4cec-39cb-4fc5-a87a-e7a32647f3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:23.874763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa4cec-39cb-4fc5-a87a-e7a32647f3f4 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:23.876239 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 35/70] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:23.877097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa4cec-39cb-4fc5-a87a-e7a32647f3f4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:23.897832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:23.939052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:23.971014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf8df1-f291-4c45-bb99-d9a62e0f6232 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:23.998543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa4cec-39cb-4fc5-a87a-e7a32647f3f4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:24.005549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9397-7c35-440d-b1a6-54395fdfe3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:24.006367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9397-7c35-440d-b1a6-54395fdfe3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.006654 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9397-7c35-440d-b1a6-54395fdfe3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.006967 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9397-7c35-440d-b1a6-54395fdfe3d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.018098 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d9397-7c35-440d-b1a6-54395fdfe3d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-770d9397-7c35-440d-b1a6-54395fdfe3d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:24.026357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:24.027270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:24.028031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:24.028031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:24.028031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:24.028031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:24.028031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:24.028031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:24.028031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:24.028031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:24.028031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:24.028031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:24.028031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:14:24.028031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:24.028031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:14:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:24.028670 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9397-7c35-440d-b1a6-54395fdfe3d8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:24.054524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70cd2d-5771-48d2-9bf9-d1c3a600590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:24.055155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70cd2d-5771-48d2-9bf9-d1c3a600590a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.055433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70cd2d-5771-48d2-9bf9-d1c3a600590a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.055706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70cd2d-5771-48d2-9bf9-d1c3a600590a None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.056475 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70cd2d-5771-48d2-9bf9-d1c3a600590a None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:24.056777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70cd2d-5771-48d2-9bf9-d1c3a600590a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:24.058975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70cd2d-5771-48d2-9bf9-d1c3a600590a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:24.079277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 36/72] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:24.079277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d8dd-234b-4131-8c7c-78f22c247d50 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.079277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d8dd-234b-4131-8c7c-78f22c247d50 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.079277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d8dd-234b-4131-8c7c-78f22c247d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.094244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2b47d8dd-234b-4131-8c7c-78f22c247d50 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:24.095685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2b47d8dd-234b-4131-8c7c-78f22c247d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:24.146885 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9397-7c35-440d-b1a6-54395fdfe3d8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:24.164520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 37/73] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:24.165855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d210b-f036-4cc1-b83d-0c9c6512419d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.166152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d210b-f036-4cc1-b83d-0c9c6512419d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.166432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d210b-f036-4cc1-b83d-0c9c6512419d None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.167766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 38/74] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:24.168470 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d210b-f036-4cc1-b83d-0c9c6512419d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:24.181019 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:24.183617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:24.189523 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f87439-097a-4e97-b42e-655138b4f8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:24.195552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f87439-097a-4e97-b42e-655138b4f8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.195552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f87439-097a-4e97-b42e-655138b4f8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.195552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f87439-097a-4e97-b42e-655138b4f8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.195552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f87439-097a-4e97-b42e-655138b4f8a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:24.195552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f87439-097a-4e97-b42e-655138b4f8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:24.195552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f87439-097a-4e97-b42e-655138b4f8a3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:24.203447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:24.204332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f87439-097a-4e97-b42e-655138b4f8a3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:24.278101 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d210b-f036-4cc1-b83d-0c9c6512419d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:24.310645 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f87439-097a-4e97-b42e-655138b4f8a3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:24.318642 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb041db-c095-419f-a4cf-a2cbedef5303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:24.319338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb041db-c095-419f-a4cf-a2cbedef5303 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.319617 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb041db-c095-419f-a4cf-a2cbedef5303 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.319890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb041db-c095-419f-a4cf-a2cbedef5303 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.320642 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb041db-c095-419f-a4cf-a2cbedef5303 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:24.320940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb041db-c095-419f-a4cf-a2cbedef5303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:24.322320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb041db-c095-419f-a4cf-a2cbedef5303 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:24.333122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 39/76] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:24.335431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b064b47-605d-451b-8485-054bed80710f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.335943 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b064b47-605d-451b-8485-054bed80710f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.336443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b064b47-605d-451b-8485-054bed80710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.351892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a4d3f-71b1-452f-932d-937c69e3c1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:24.352775 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a4d3f-71b1-452f-932d-937c69e3c1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.353056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a4d3f-71b1-452f-932d-937c69e3c1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.353332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a4d3f-71b1-452f-932d-937c69e3c1a1 None admin] PATH_INFO: `/v3/users/fd100c82cfbd4bfaaffc9eee00a66751` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.353901 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3b064b47-605d-451b-8485-054bed80710f None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:24.355661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3b064b47-605d-451b-8485-054bed80710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:24.369124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a4d3f-71b1-452f-932d-937c69e3c1a1 None admin] RBAC: Authorizing `identity:get_user(user_id=fd100c82cfbd4bfaaffc9eee00a66751)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:24.371335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a4d3f-71b1-452f-932d-937c69e3c1a1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:24.373078 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 38/77] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:24 2022] GET /identity/v3/users/fd100c82cfbd4bfaaffc9eee00a66751 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:24.373853 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a4d3f-71b1-452f-932d-937c69e3c1a1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:24.423678 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:24.435213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 40/78] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:24.435213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b064b47-605d-451b-8485-054bed80710f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:24.437061 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:24.486495 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a4d3f-71b1-452f-932d-937c69e3c1a1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:24.521758 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173344e-4a0e-456a-8c04-814262758368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:24.522551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173344e-4a0e-456a-8c04-814262758368 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.522866 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173344e-4a0e-456a-8c04-814262758368 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.523145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173344e-4a0e-456a-8c04-814262758368 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.533000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b064b47-605d-451b-8485-054bed80710f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:24.533375 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173344e-4a0e-456a-8c04-814262758368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e173344e-4a0e-456a-8c04-814262758368 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:24.541217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:24.542068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:24.543928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:24.543928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:24.543928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:24.543928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:24.543928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:24.543928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:24.543928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:24.543928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:24.543928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:24.543928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:24.543928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:24.543928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:24.543928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 39/79] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:24.543928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173344e-4a0e-456a-8c04-814262758368 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:24.573418 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6f4f1-16a0-4524-9a76-743d3e3e6f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:24.574331 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6f4f1-16a0-4524-9a76-743d3e3e6f3f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.574611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6f4f1-16a0-4524-9a76-743d3e3e6f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.574916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6f4f1-16a0-4524-9a76-743d3e3e6f3f None admin] PATH_INFO: `/v3/users/bc14ede82e87407488accc3a9acc26ad` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.576130 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6f4f1-16a0-4524-9a76-743d3e3e6f3f None admin] RBAC: Authorizing `identity:get_user(user_id=bc14ede82e87407488accc3a9acc26ad)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:24.577603 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6f4f1-16a0-4524-9a76-743d3e3e6f3f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:24.579272 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 41/80] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:24 2022] GET /identity/v3/users/bc14ede82e87407488accc3a9acc26ad => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:24.580036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6f4f1-16a0-4524-9a76-743d3e3e6f3f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:24.649272 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:24.653024 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173344e-4a0e-456a-8c04-814262758368 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:24.666346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:24.686125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6f4f1-16a0-4524-9a76-743d3e3e6f3f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:24.689928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ae83b-d6fe-4274-8da5-7e53ca9891b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:24.690852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ae83b-d6fe-4274-8da5-7e53ca9891b1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.691139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ae83b-d6fe-4274-8da5-7e53ca9891b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.691416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ae83b-d6fe-4274-8da5-7e53ca9891b1 None admin] PATH_INFO: `/v3/users/fd100c82cfbd4bfaaffc9eee00a66751` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.693260 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ae83b-d6fe-4274-8da5-7e53ca9891b1 None admin] RBAC: Authorizing `identity:get_user(user_id=fd100c82cfbd4bfaaffc9eee00a66751)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:24.694574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ae83b-d6fe-4274-8da5-7e53ca9891b1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:24.696295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 40/81] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:24 2022] GET /identity/v3/users/fd100c82cfbd4bfaaffc9eee00a66751 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:24.697064 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ae83b-d6fe-4274-8da5-7e53ca9891b1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:24.722026 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a171b6-a820-4901-a760-007c6b925bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:24.722695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a171b6-a820-4901-a760-007c6b925bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.722990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a171b6-a820-4901-a760-007c6b925bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.723265 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a171b6-a820-4901-a760-007c6b925bf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.790318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a171b6-a820-4901-a760-007c6b925bf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:24.791839 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a171b6-a820-4901-a760-007c6b925bf9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:24.799358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ae83b-d6fe-4274-8da5-7e53ca9891b1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:24.833166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525f75a-6e38-49af-98b7-942f89677831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:24.833885 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525f75a-6e38-49af-98b7-942f89677831 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.834169 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525f75a-6e38-49af-98b7-942f89677831 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.834453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525f75a-6e38-49af-98b7-942f89677831 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.835703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525f75a-6e38-49af-98b7-942f89677831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:24.837194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525f75a-6e38-49af-98b7-942f89677831 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:24.838865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 41/82] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:24.840133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525f75a-6e38-49af-98b7-942f89677831 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:24.861626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:24.889550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:24.895280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 42/83] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:24.896134 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a171b6-a820-4901-a760-007c6b925bf9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:24.947250 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525f75a-6e38-49af-98b7-942f89677831 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:24.982145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420dd958-3857-4243-9b20-b5ca6b2a47e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:24.982844 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dd958-3857-4243-9b20-b5ca6b2a47e7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.983133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dd958-3857-4243-9b20-b5ca6b2a47e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.983416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dd958-3857-4243-9b20-b5ca6b2a47e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.984176 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420dd958-3857-4243-9b20-b5ca6b2a47e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:24.984483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420dd958-3857-4243-9b20-b5ca6b2a47e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:24.985884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420dd958-3857-4243-9b20-b5ca6b2a47e7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:24.993912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 42/84] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:24.994718 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420dd958-3857-4243-9b20-b5ca6b2a47e7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:24.995143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a171b6-a820-4901-a760-007c6b925bf9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:25.031665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe92b97-c27d-440a-9426-611cf7603e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:25.032313 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe92b97-c27d-440a-9426-611cf7603e68 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:25.032592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe92b97-c27d-440a-9426-611cf7603e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:25.032863 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe92b97-c27d-440a-9426-611cf7603e68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:25.066468 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:25.096212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420dd958-3857-4243-9b20-b5ca6b2a47e7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:25.105159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe92b97-c27d-440a-9426-611cf7603e68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:25.106645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe92b97-c27d-440a-9426-611cf7603e68 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:25.106782 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:25.130006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112a54d-3e4e-407c-851c-34bee9409c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:25.130661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a54d-3e4e-407c-851c-34bee9409c24 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:25.130969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a54d-3e4e-407c-851c-34bee9409c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:25.131239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a54d-3e4e-407c-851c-34bee9409c24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:25.201965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112a54d-3e4e-407c-851c-34bee9409c24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:25.203506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112a54d-3e4e-407c-851c-34bee9409c24 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:25.205149 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 43/85] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:25.209846 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe92b97-c27d-440a-9426-611cf7603e68 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:25.273128 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:25.308224 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 43/86] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:25.308772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe92b97-c27d-440a-9426-611cf7603e68 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:25.309131 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112a54d-3e4e-407c-851c-34bee9409c24 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:25.320973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:25.346491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859062a1-593e-439e-9d39-89ef503e48e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:25.347120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859062a1-593e-439e-9d39-89ef503e48e9 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:25.347399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859062a1-593e-439e-9d39-89ef503e48e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:25.347671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859062a1-593e-439e-9d39-89ef503e48e9 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:25.348394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859062a1-593e-439e-9d39-89ef503e48e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:25.349857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859062a1-593e-439e-9d39-89ef503e48e9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:25.410123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112a54d-3e4e-407c-851c-34bee9409c24 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:25.440760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 44/87] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:14:25 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:14:25.441609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859062a1-593e-439e-9d39-89ef503e48e9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:25.451317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d0170-e8e1-4153-92d7-8126dfd7d43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:25.454086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d0170-e8e1-4153-92d7-8126dfd7d43b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:25.454402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d0170-e8e1-4153-92d7-8126dfd7d43b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:25.454703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d0170-e8e1-4153-92d7-8126dfd7d43b None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:25.456144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d0170-e8e1-4153-92d7-8126dfd7d43b None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:25.460020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d0170-e8e1-4153-92d7-8126dfd7d43b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:25.467397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 44/88] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:25 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:25.467397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d0170-e8e1-4153-92d7-8126dfd7d43b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:25.560700 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:25.580600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859062a1-593e-439e-9d39-89ef503e48e9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:25.584761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d0170-e8e1-4153-92d7-8126dfd7d43b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:25.614219 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:25.625760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f13ff0-260e-46e7-959a-3a4134001ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:25.626932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f13ff0-260e-46e7-959a-3a4134001ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:25.627506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f13ff0-260e-46e7-959a-3a4134001ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:25.627506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f13ff0-260e-46e7-959a-3a4134001ee2 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:25.628334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6330e3-97f0-40c6-a945-35abd12b5ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:25.628666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f13ff0-260e-46e7-959a-3a4134001ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:25.629220 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6330e3-97f0-40c6-a945-35abd12b5ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:25.629505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6330e3-97f0-40c6-a945-35abd12b5ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:25.629784 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6330e3-97f0-40c6-a945-35abd12b5ec3 None admin] PATH_INFO: `/v3/users/fd100c82cfbd4bfaaffc9eee00a66751` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:25.630204 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f13ff0-260e-46e7-959a-3a4134001ee2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:25.631138 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6330e3-97f0-40c6-a945-35abd12b5ec3 None admin] RBAC: Authorizing `identity:get_user(user_id=fd100c82cfbd4bfaaffc9eee00a66751)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:25.631904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 45/89] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:25 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:25.632585 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6330e3-97f0-40c6-a945-35abd12b5ec3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:25.632703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f13ff0-260e-46e7-959a-3a4134001ee2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:25.634406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 45/90] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:25 2022] GET /identity/v3/users/fd100c82cfbd4bfaaffc9eee00a66751 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:25.635221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6330e3-97f0-40c6-a945-35abd12b5ec3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:25.765934 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6330e3-97f0-40c6-a945-35abd12b5ec3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:25.779438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f13ff0-260e-46e7-959a-3a4134001ee2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:25.807468 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fe782-5175-4d6e-8f1d-f62ee223fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:25.808956 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fe782-5175-4d6e-8f1d-f62ee223fe19 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:25.809391 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fe782-5175-4d6e-8f1d-f62ee223fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:25.809680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fe782-5175-4d6e-8f1d-f62ee223fe19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:25.810541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fe782-5175-4d6e-8f1d-f62ee223fe19 None admin] RBAC: Adding query filter params (role.id=9b386d2d84ef4d3b9f9401c95f06c53b, scope.project.id=dc870179720c49a5916bb6299e1ba91d, user.id=fd100c82cfbd4bfaaffc9eee00a66751) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:25.810895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fe782-5175-4d6e-8f1d-f62ee223fe19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:25.812621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fe782-5175-4d6e-8f1d-f62ee223fe19 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:25.819506 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 46/91] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:25 2022] GET /identity/v3/role_assignments?user.id=fd100c82cfbd4bfaaffc9eee00a66751&scope.project.id=dc870179720c49a5916bb6299e1ba91d&role.id=9b386d2d84ef4d3b9f9401c95f06c53b => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:25.822877 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fe782-5175-4d6e-8f1d-f62ee223fe19 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:25.826403 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489f9d7-f142-4984-a29c-998f39998b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:25.827348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489f9d7-f142-4984-a29c-998f39998b23 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:25.827633 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489f9d7-f142-4984-a29c-998f39998b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:25.827912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489f9d7-f142-4984-a29c-998f39998b23 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:25.829195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489f9d7-f142-4984-a29c-998f39998b23 None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:25.830921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489f9d7-f142-4984-a29c-998f39998b23 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:25.833163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 46/92] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:25 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:25.834054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489f9d7-f142-4984-a29c-998f39998b23 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:25.874567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:25.963092 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:26.003940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489f9d7-f142-4984-a29c-998f39998b23 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:26.021468 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fe782-5175-4d6e-8f1d-f62ee223fe19 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:26.045068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9be88-a6d8-46c1-8c46-0f2e61dc39de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:26.045733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9be88-a6d8-46c1-8c46-0f2e61dc39de None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:26.046014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9be88-a6d8-46c1-8c46-0f2e61dc39de None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:26.046287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9be88-a6d8-46c1-8c46-0f2e61dc39de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:26.082692 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9263b-b72e-4f45-82c9-277e95dbdff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:26.083463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9263b-b72e-4f45-82c9-277e95dbdff8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:26.083754 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9263b-b72e-4f45-82c9-277e95dbdff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:26.084030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9263b-b72e-4f45-82c9-277e95dbdff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:26.084948 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9263b-b72e-4f45-82c9-277e95dbdff8 None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=dc870179720c49a5916bb6299e1ba91d, user.id=bc14ede82e87407488accc3a9acc26ad) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:26.085361 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9263b-b72e-4f45-82c9-277e95dbdff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:26.087027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9263b-b72e-4f45-82c9-277e95dbdff8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:26.094420 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 47/93] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:25 2022] GET /identity/v3/role_assignments?user.id=bc14ede82e87407488accc3a9acc26ad&scope.project.id=dc870179720c49a5916bb6299e1ba91d&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:26.095404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9263b-b72e-4f45-82c9-277e95dbdff8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:26.150964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9be88-a6d8-46c1-8c46-0f2e61dc39de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:26.153273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9be88-a6d8-46c1-8c46-0f2e61dc39de None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:26.192309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:26.226546 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9263b-b72e-4f45-82c9-277e95dbdff8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:26.254405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:26.297324 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83babd-4ec6-4721-941b-2a4a64cd5d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:26.297992 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83babd-4ec6-4721-941b-2a4a64cd5d56 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:26.298269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83babd-4ec6-4721-941b-2a4a64cd5d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:26.298592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83babd-4ec6-4721-941b-2a4a64cd5d56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:26.299473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83babd-4ec6-4721-941b-2a4a64cd5d56 None admin] RBAC: Adding query filter params (role.id=d73c76bc61c44f3a94e66397b0d9c359, scope.project.id=dc870179720c49a5916bb6299e1ba91d, user.id=fd100c82cfbd4bfaaffc9eee00a66751) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:26.299829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83babd-4ec6-4721-941b-2a4a64cd5d56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:26.301310 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83babd-4ec6-4721-941b-2a4a64cd5d56 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:26.318297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 48/94] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:26 2022] GET /identity/v3/role_assignments?user.id=fd100c82cfbd4bfaaffc9eee00a66751&scope.project.id=dc870179720c49a5916bb6299e1ba91d&role.id=d73c76bc61c44f3a94e66397b0d9c359 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:26.388714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 47/95] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:26.394347 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83babd-4ec6-4721-941b-2a4a64cd5d56 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:26.534538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83babd-4ec6-4721-941b-2a4a64cd5d56 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:26.582404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e42f1-0601-47b8-a927-39810c0a77f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:26.583300 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e42f1-0601-47b8-a927-39810c0a77f4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:26.583582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e42f1-0601-47b8-a927-39810c0a77f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:26.583857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e42f1-0601-47b8-a927-39810c0a77f4 None admin] PATH_INFO: `/v3/projects/9b3ebf75b6b54ef78ffdbf33519cb97c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:26.587439 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e42f1-0601-47b8-a927-39810c0a77f4 None admin] RBAC: Authorizing `identity:get_project(project_id=9b3ebf75b6b54ef78ffdbf33519cb97c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:26.589538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e42f1-0601-47b8-a927-39810c0a77f4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:26.591378 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 49/96] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:26 2022] GET /identity/v3/projects/9b3ebf75b6b54ef78ffdbf33519cb97c => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:26.597402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9be88-a6d8-46c1-8c46-0f2e61dc39de None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:26.731057 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9be88-a6d8-46c1-8c46-0f2e61dc39de None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:26.756450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:26.788833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cf3aa-986c-4d6a-b908-79d758bbe1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:26.789806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cf3aa-986c-4d6a-b908-79d758bbe1ef None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:26.789806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cf3aa-986c-4d6a-b908-79d758bbe1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:26.789980 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cf3aa-986c-4d6a-b908-79d758bbe1ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:26.790853 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cf3aa-986c-4d6a-b908-79d758bbe1ef None admin] RBAC: Adding query filter params (role.id=9b386d2d84ef4d3b9f9401c95f06c53b, scope.project.id=9b3ebf75b6b54ef78ffdbf33519cb97c, user.id=fd100c82cfbd4bfaaffc9eee00a66751) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:26.791121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cf3aa-986c-4d6a-b908-79d758bbe1ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:26.792710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cf3aa-986c-4d6a-b908-79d758bbe1ef None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:26.803078 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 48/97] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:26 2022] GET /identity/v3/role_assignments?user.id=fd100c82cfbd4bfaaffc9eee00a66751&scope.project.id=9b3ebf75b6b54ef78ffdbf33519cb97c&role.id=9b386d2d84ef4d3b9f9401c95f06c53b => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:28.286371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbadcc7-e04f-4929-92ba-fb9f0c4f6421 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:28.286850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbadcc7-e04f-4929-92ba-fb9f0c4f6421 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:28.287054 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbadcc7-e04f-4929-92ba-fb9f0c4f6421 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:28.294694 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 50/98] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:28.304460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f6151-3d4a-41b7-9f32-d5e9dbd11963 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:28.304975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f6151-3d4a-41b7-9f32-d5e9dbd11963 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:28.305055 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f6151-3d4a-41b7-9f32-d5e9dbd11963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:28.332589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-900f6151-3d4a-41b7-9f32-d5e9dbd11963 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:28.333804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-900f6151-3d4a-41b7-9f32-d5e9dbd11963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:28.444637 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 49/99] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:28.481059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbadcc7-e04f-4929-92ba-fb9f0c4f6421 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:28.540485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cef73-9047-4e5d-94ed-e85872d415aa None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:28.541089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cef73-9047-4e5d-94ed-e85872d415aa None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:28.541553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cef73-9047-4e5d-94ed-e85872d415aa None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:28.544093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 50/100] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:28.550700 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5a368-ec39-4ab6-80df-efeece79947a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:28.550985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5a368-ec39-4ab6-80df-efeece79947a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:28.551262 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5a368-ec39-4ab6-80df-efeece79947a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:28.579041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:28.584322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-39b5a368-ec39-4ab6-80df-efeece79947a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:28.585510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-39b5a368-ec39-4ab6-80df-efeece79947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:28.675020 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbadcc7-e04f-4929-92ba-fb9f0c4f6421 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:28.729214 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 51/101] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:28.731327 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a3a5f-9659-4f1c-8269-1e79ec918e34 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:28.732085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08b8a-55c2-42f9-b4ac-54703c4f99f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:28.733053 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08b8a-55c2-42f9-b4ac-54703c4f99f2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:28.733493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a3a5f-9659-4f1c-8269-1e79ec918e34 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:28.733909 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a3a5f-9659-4f1c-8269-1e79ec918e34 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:28.734324 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08b8a-55c2-42f9-b4ac-54703c4f99f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:28.735793 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 52/102] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:28.736212 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08b8a-55c2-42f9-b4ac-54703c4f99f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:28.744165 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc2312-194f-430c-9e6a-84c937eff75f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:28.746461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc2312-194f-430c-9e6a-84c937eff75f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:28.746921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc2312-194f-430c-9e6a-84c937eff75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:28.770023 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d08b8a-55c2-42f9-b4ac-54703c4f99f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-06d08b8a-55c2-42f9-b4ac-54703c4f99f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:28.781293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:28.782358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:28.783355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:28.783355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:28.783355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:28.783355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:28.783355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:28.783355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:28.783355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:28.783355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:28.783355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:28.783355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:28.783355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:28.783355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:28.784957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-64bc2312-194f-430c-9e6a-84c937eff75f None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:28.786268 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-64bc2312-194f-430c-9e6a-84c937eff75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:28.787706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 51/103] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:28.790977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08b8a-55c2-42f9-b4ac-54703c4f99f2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:28.839195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:28.866002 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 53/104] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:28.868826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc2312-194f-430c-9e6a-84c937eff75f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:28.978837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc2312-194f-430c-9e6a-84c937eff75f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:29.015763 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85864fd8-3a88-4cf8-aeb9-97f2ad7c1bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:29.016806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85864fd8-3a88-4cf8-aeb9-97f2ad7c1bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.017306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85864fd8-3a88-4cf8-aeb9-97f2ad7c1bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.017782 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85864fd8-3a88-4cf8-aeb9-97f2ad7c1bf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.018791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85864fd8-3a88-4cf8-aeb9-97f2ad7c1bf7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:29.019304 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85864fd8-3a88-4cf8-aeb9-97f2ad7c1bf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:29.020961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85864fd8-3a88-4cf8-aeb9-97f2ad7c1bf7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:29.031135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 54/105] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:29.032345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85864fd8-3a88-4cf8-aeb9-97f2ad7c1bf7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:29.032621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08b8a-55c2-42f9-b4ac-54703c4f99f2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:29.070041 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:29.070346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:29.139403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9c3e7-af64-4a47-9f75-f19e8018a520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:29.139955 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85864fd8-3a88-4cf8-aeb9-97f2ad7c1bf7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:29.140222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9c3e7-af64-4a47-9f75-f19e8018a520 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.140511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9c3e7-af64-4a47-9f75-f19e8018a520 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.140797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9c3e7-af64-4a47-9f75-f19e8018a520 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.176536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b17781-f88a-4f7b-b45a-4685df22933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:29.177697 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b17781-f88a-4f7b-b45a-4685df22933d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.178181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b17781-f88a-4f7b-b45a-4685df22933d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.178644 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b17781-f88a-4f7b-b45a-4685df22933d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.180125 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b17781-f88a-4f7b-b45a-4685df22933d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:29.181792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b17781-f88a-4f7b-b45a-4685df22933d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:29.184470 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 55/106] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:29.185474 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b17781-f88a-4f7b-b45a-4685df22933d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:29.186179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9c3e7-af64-4a47-9f75-f19e8018a520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-fbf9c3e7-af64-4a47-9f75-f19e8018a520 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:29.194522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:29.195424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:29.196162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:29.196162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:29.196162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:29.196162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:29.196162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:29.196162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:29.196162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:29.196162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:29.196162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:29.196162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:29.196162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:29.196162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:29.207978 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 52/107] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:29.208807 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9c3e7-af64-4a47-9f75-f19e8018a520 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:29.295541 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b17781-f88a-4f7b-b45a-4685df22933d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:29.298862 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:29.346041 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab75c-fa50-4c79-8226-d012fd409080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:29.346888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab75c-fa50-4c79-8226-d012fd409080 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.347180 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab75c-fa50-4c79-8226-d012fd409080 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.347464 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab75c-fa50-4c79-8226-d012fd409080 None admin] PATH_INFO: `/v3/users/fd100c82cfbd4bfaaffc9eee00a66751` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.349309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ab75c-fa50-4c79-8226-d012fd409080 None admin] RBAC: Authorizing `identity:get_user(user_id=fd100c82cfbd4bfaaffc9eee00a66751)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:29.350906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ab75c-fa50-4c79-8226-d012fd409080 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:29.352607 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 56/108] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:29 2022] GET /identity/v3/users/fd100c82cfbd4bfaaffc9eee00a66751 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:29.353390 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab75c-fa50-4c79-8226-d012fd409080 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:29.427204 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9c3e7-af64-4a47-9f75-f19e8018a520 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:29.474175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883d44e-938c-4603-a4a0-4084084f4146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:29.475327 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883d44e-938c-4603-a4a0-4084084f4146 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.476073 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883d44e-938c-4603-a4a0-4084084f4146 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.476641 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883d44e-938c-4603-a4a0-4084084f4146 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.477622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883d44e-938c-4603-a4a0-4084084f4146 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:29.478774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab75c-fa50-4c79-8226-d012fd409080 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:29.479318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883d44e-938c-4603-a4a0-4084084f4146 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:29.519293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d498dd-5039-4446-840f-078848a7aa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:29.520221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d498dd-5039-4446-840f-078848a7aa7c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.520641 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d498dd-5039-4446-840f-078848a7aa7c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.521056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d498dd-5039-4446-840f-078848a7aa7c None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.521971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d498dd-5039-4446-840f-078848a7aa7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:29.522410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d498dd-5039-4446-840f-078848a7aa7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:29.524004 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d498dd-5039-4446-840f-078848a7aa7c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:29.533572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 57/109] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:29.534654 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d498dd-5039-4446-840f-078848a7aa7c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:29.567432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:29.595540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 53/110] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 20 19:14:29 2022] POST /identity/v3/projects => generated 302 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:14:29.596755 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f9325-f5c2-40a8-8e1f-c0608c2a9888 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.596990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f9325-f5c2-40a8-8e1f-c0608c2a9888 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.597263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f9325-f5c2-40a8-8e1f-c0608c2a9888 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.598813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 54/111] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:29.603614 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f9325-f5c2-40a8-8e1f-c0608c2a9888 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:29.643072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:29.673355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d498dd-5039-4446-840f-078848a7aa7c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:29.726478 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7718d-95c7-4300-9a10-ca6754203986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:29.727867 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7718d-95c7-4300-9a10-ca6754203986 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.728335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7718d-95c7-4300-9a10-ca6754203986 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.729137 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7718d-95c7-4300-9a10-ca6754203986 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.730991 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7718d-95c7-4300-9a10-ca6754203986 None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:29.734183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7718d-95c7-4300-9a10-ca6754203986 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:29.737329 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 58/112] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:29 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:29.739219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46900dc-9463-40ca-bd65-c5f34d4db014 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.739644 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46900dc-9463-40ca-bd65-c5f34d4db014 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.740068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46900dc-9463-40ca-bd65-c5f34d4db014 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.741892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 59/113] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:29.744497 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b238d-1f81-4974-8ed9-bd3fc50d8099 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.745078 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b238d-1f81-4974-8ed9-bd3fc50d8099 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.745573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b238d-1f81-4974-8ed9-bd3fc50d8099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.755344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f9325-f5c2-40a8-8e1f-c0608c2a9888 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:29.769862 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-610b238d-1f81-4974-8ed9-bd3fc50d8099 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:29.771739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-610b238d-1f81-4974-8ed9-bd3fc50d8099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:29.803088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271d50d-da83-45e9-9d5a-a114dd46216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:29.803962 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271d50d-da83-45e9-9d5a-a114dd46216e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.804242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271d50d-da83-45e9-9d5a-a114dd46216e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.804764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271d50d-da83-45e9-9d5a-a114dd46216e None admin] PATH_INFO: `/v3/users/7d94ce41a8294ba1a559395432ca15bc` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.822765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271d50d-da83-45e9-9d5a-a114dd46216e None admin] RBAC: Authorizing `identity:get_user(user_id=7d94ce41a8294ba1a559395432ca15bc)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:29.825611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271d50d-da83-45e9-9d5a-a114dd46216e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:29.828155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 55/114] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:29 2022] GET /identity/v3/users/7d94ce41a8294ba1a559395432ca15bc => generated 289 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:29.828746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271d50d-da83-45e9-9d5a-a114dd46216e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:29.864578 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 60/115] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:29.870783 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d170c-829d-4d1a-8b60-1de11c770a5b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.871837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d170c-829d-4d1a-8b60-1de11c770a5b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.872334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d170c-829d-4d1a-8b60-1de11c770a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.910154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9c0d170c-829d-4d1a-8b60-1de11c770a5b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:29.911741 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9c0d170c-829d-4d1a-8b60-1de11c770a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:29.935214 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:29.943974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:29.967473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271d50d-da83-45e9-9d5a-a114dd46216e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:29.986914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 61/116] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:29.988050 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d170c-829d-4d1a-8b60-1de11c770a5b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:30.011644 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e853dc-0062-4a26-ad54-39cff4a5ce3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:30.012787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e853dc-0062-4a26-ad54-39cff4a5ce3c None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:30.013240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e853dc-0062-4a26-ad54-39cff4a5ce3c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:30.013658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e853dc-0062-4a26-ad54-39cff4a5ce3c None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d/users/fd100c82cfbd4bfaaffc9eee00a66751/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:30.015941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e853dc-0062-4a26-ad54-39cff4a5ce3c None admin] RBAC: Authorizing `identity:create_grant(project_id=dc870179720c49a5916bb6299e1ba91d, user_id=fd100c82cfbd4bfaaffc9eee00a66751, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:30.017740 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e853dc-0062-4a26-ad54-39cff4a5ce3c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:30.083211 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 56/117] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:14:29 2022] PUT /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d/users/fd100c82cfbd4bfaaffc9eee00a66751/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:14:30.091794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e853dc-0062-4a26-ad54-39cff4a5ce3c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:30.107291 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d170c-829d-4d1a-8b60-1de11c770a5b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:30.151952 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8353f1-65f8-4a36-b9c2-1600a5d82bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:30.153017 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8353f1-65f8-4a36-b9c2-1600a5d82bce None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:30.153449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8353f1-65f8-4a36-b9c2-1600a5d82bce None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:30.153950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8353f1-65f8-4a36-b9c2-1600a5d82bce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:30.241595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:30.245407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8353f1-65f8-4a36-b9c2-1600a5d82bce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:30.247347 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8353f1-65f8-4a36-b9c2-1600a5d82bce None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:30.248739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e853dc-0062-4a26-ad54-39cff4a5ce3c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:30.294850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f074b91-7a47-4cc9-a2ce-f322cc5f7208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:30.295676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f074b91-7a47-4cc9-a2ce-f322cc5f7208 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:30.295958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f074b91-7a47-4cc9-a2ce-f322cc5f7208 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:30.297015 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f074b91-7a47-4cc9-a2ce-f322cc5f7208 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:30.311521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f074b91-7a47-4cc9-a2ce-f322cc5f7208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4f074b91-7a47-4cc9-a2ce-f322cc5f7208 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:30.322087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:30.323663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:30.324730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:30.324730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:30.324730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:30.324730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:30.324730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:30.324730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:30.324730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:30.324730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:30.324730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:30.324730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:30.324730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:14:30.324730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:30.324730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 57/118] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:14:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:30.325494 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91816d-d7ea-4473-9712-ba0df2cb4ac6 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:30.325598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91816d-d7ea-4473-9712-ba0df2cb4ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:30.325880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91816d-d7ea-4473-9712-ba0df2cb4ac6 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:30.327283 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 58/119] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:30.327893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91816d-d7ea-4473-9712-ba0df2cb4ac6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:30.331688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:30.393728 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 62/120] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:30.395906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8353f1-65f8-4a36-b9c2-1600a5d82bce None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:30.462305 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91816d-d7ea-4473-9712-ba0df2cb4ac6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:30.465174 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:30.503152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5f72-f741-4cf9-a639-f41c6ef7b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:30.504506 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5f72-f741-4cf9-a639-f41c6ef7b44a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:30.505004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5f72-f741-4cf9-a639-f41c6ef7b44a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:30.505474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5f72-f741-4cf9-a639-f41c6ef7b44a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:30.513942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8353f1-65f8-4a36-b9c2-1600a5d82bce None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:30.518193 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d5f72-f741-4cf9-a639-f41c6ef7b44a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-fd1d5f72-f741-4cf9-a639-f41c6ef7b44a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:30.529021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:30.529931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:30.530742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:30.530742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:30.530742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:30.530742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:30.530742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:30.530742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:30.530742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:30.530742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:30.530742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:30.530742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:30.530742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:30.530742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:30.536677 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 59/121] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:14:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:30.538458 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a8f99-84ff-40ab-8de0-3505819de5f1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:30.539040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a8f99-84ff-40ab-8de0-3505819de5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:30.539533 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a8f99-84ff-40ab-8de0-3505819de5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:30.554550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba37b31-12b3-4a14-93c4-5849008a86ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:30.558182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba37b31-12b3-4a14-93c4-5849008a86ca None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:30.558182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba37b31-12b3-4a14-93c4-5849008a86ca None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:30.558182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba37b31-12b3-4a14-93c4-5849008a86ca None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:30.558182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba37b31-12b3-4a14-93c4-5849008a86ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:30.558182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba37b31-12b3-4a14-93c4-5849008a86ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:30.559535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba37b31-12b3-4a14-93c4-5849008a86ca None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:30.561598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-751a8f99-84ff-40ab-8de0-3505819de5f1 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:30.563199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-751a8f99-84ff-40ab-8de0-3505819de5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:30.570342 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 63/122] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:30.570512 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba37b31-12b3-4a14-93c4-5849008a86ca None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:30.631148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:30.642467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 60/123] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:30.643645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a8f99-84ff-40ab-8de0-3505819de5f1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:30.679795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba37b31-12b3-4a14-93c4-5849008a86ca None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:30.706184 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:30.728852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc9ff2-2fb5-4c7e-b637-bf1eb220c25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:30.729691 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc9ff2-2fb5-4c7e-b637-bf1eb220c25c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:30.729982 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc9ff2-2fb5-4c7e-b637-bf1eb220c25c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:30.730263 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc9ff2-2fb5-4c7e-b637-bf1eb220c25c None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:30.731780 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc9ff2-2fb5-4c7e-b637-bf1eb220c25c None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:30.733452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc9ff2-2fb5-4c7e-b637-bf1eb220c25c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:30.735592 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 64/124] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:30 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:30.736406 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc9ff2-2fb5-4c7e-b637-bf1eb220c25c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:30.825905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a8f99-84ff-40ab-8de0-3505819de5f1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:30.887166 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216027a8-daa4-477a-972d-1923c331d04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:30.887867 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216027a8-daa4-477a-972d-1923c331d04c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:30.888156 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216027a8-daa4-477a-972d-1923c331d04c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:30.888489 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216027a8-daa4-477a-972d-1923c331d04c None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:30.889332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216027a8-daa4-477a-972d-1923c331d04c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:30.889872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216027a8-daa4-477a-972d-1923c331d04c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:30.892509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216027a8-daa4-477a-972d-1923c331d04c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:30.903869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 61/125] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:30.904543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216027a8-daa4-477a-972d-1923c331d04c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:30.915176 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc9ff2-2fb5-4c7e-b637-bf1eb220c25c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:30.961757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac251798-3807-41d2-a392-cfd44e3f2669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:30.963048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac251798-3807-41d2-a392-cfd44e3f2669 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:30.963588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac251798-3807-41d2-a392-cfd44e3f2669 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:30.964064 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac251798-3807-41d2-a392-cfd44e3f2669 None admin] PATH_INFO: `/v3/users/fd100c82cfbd4bfaaffc9eee00a66751` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:30.965540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac251798-3807-41d2-a392-cfd44e3f2669 None admin] RBAC: Authorizing `identity:get_user(user_id=fd100c82cfbd4bfaaffc9eee00a66751)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:30.969354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac251798-3807-41d2-a392-cfd44e3f2669 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:30.973160 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 65/126] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:30 2022] GET /identity/v3/users/fd100c82cfbd4bfaaffc9eee00a66751 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:30.974452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac251798-3807-41d2-a392-cfd44e3f2669 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:30.986242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:31.049568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:31.063312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216027a8-daa4-477a-972d-1923c331d04c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:31.107571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac251798-3807-41d2-a392-cfd44e3f2669 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:31.115474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f1dc2-efdf-49ad-927e-8033b3f2e992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:31.116335 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f1dc2-efdf-49ad-927e-8033b3f2e992 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:31.116626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f1dc2-efdf-49ad-927e-8033b3f2e992 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:31.117275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f1dc2-efdf-49ad-927e-8033b3f2e992 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:31.133382 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f1dc2-efdf-49ad-927e-8033b3f2e992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-847f1dc2-efdf-49ad-927e-8033b3f2e992 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:31.145526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:31.146444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:31.147457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:31.147457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:31.147457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:31.147457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:31.147457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:31.147457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:31.147457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:31.147457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:31.147457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:31.147457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:31.147457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:31.147457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:31.147457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 62/127] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:31.148106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f1dc2-efdf-49ad-927e-8033b3f2e992 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:31.156922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025c0dc-4030-4c06-bdc1-d226ae7db7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:31.157893 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025c0dc-4030-4c06-bdc1-d226ae7db7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:31.158362 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025c0dc-4030-4c06-bdc1-d226ae7db7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:31.159533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025c0dc-4030-4c06-bdc1-d226ae7db7d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:31.160575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025c0dc-4030-4c06-bdc1-d226ae7db7d3 None admin] RBAC: Adding query filter params (role.id=8b71d050850f4e75a4ae097553e111d0, scope.project.id=dc870179720c49a5916bb6299e1ba91d, user.id=7d94ce41a8294ba1a559395432ca15bc) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:31.161069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025c0dc-4030-4c06-bdc1-d226ae7db7d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:31.162746 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025c0dc-4030-4c06-bdc1-d226ae7db7d3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:31.170600 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 66/128] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:30 2022] GET /identity/v3/role_assignments?user.id=7d94ce41a8294ba1a559395432ca15bc&scope.project.id=dc870179720c49a5916bb6299e1ba91d&role.id=8b71d050850f4e75a4ae097553e111d0 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:31.171891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025c0dc-4030-4c06-bdc1-d226ae7db7d3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:31.303932 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f1dc2-efdf-49ad-927e-8033b3f2e992 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:31.323193 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025c0dc-4030-4c06-bdc1-d226ae7db7d3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:31.323724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:31.346544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:31.357325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7485b-977b-45ff-91b9-df93db1632c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:31.359812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7485b-977b-45ff-91b9-df93db1632c7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:31.360363 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7485b-977b-45ff-91b9-df93db1632c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:31.360925 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7485b-977b-45ff-91b9-df93db1632c7 None admin] PATH_INFO: `/v3/users/bc14ede82e87407488accc3a9acc26ad` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:31.363713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7485b-977b-45ff-91b9-df93db1632c7 None admin] RBAC: Authorizing `identity:get_user(user_id=bc14ede82e87407488accc3a9acc26ad)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:31.366595 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7485b-977b-45ff-91b9-df93db1632c7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:31.371420 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 63/129] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:31 2022] GET /identity/v3/users/bc14ede82e87407488accc3a9acc26ad => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:31.372107 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7485b-977b-45ff-91b9-df93db1632c7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:31.389122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd73f8-9623-404d-9ee1-e35e005a8858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:31.397859 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd73f8-9623-404d-9ee1-e35e005a8858 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:31.398994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd73f8-9623-404d-9ee1-e35e005a8858 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:31.399502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd73f8-9623-404d-9ee1-e35e005a8858 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:31.401742 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd73f8-9623-404d-9ee1-e35e005a8858 None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:31.403636 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd73f8-9623-404d-9ee1-e35e005a8858 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:31.412038 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 67/130] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:31 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:31.413368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd73f8-9623-404d-9ee1-e35e005a8858 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:31.515891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7485b-977b-45ff-91b9-df93db1632c7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:31.566117 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6a568-aecc-4563-8506-3e01954cf97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:31.566811 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6a568-aecc-4563-8506-3e01954cf97e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:31.567362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6a568-aecc-4563-8506-3e01954cf97e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:31.567646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6a568-aecc-4563-8506-3e01954cf97e None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:31.568416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6a568-aecc-4563-8506-3e01954cf97e None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:31.568915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6a568-aecc-4563-8506-3e01954cf97e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:31.570938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6a568-aecc-4563-8506-3e01954cf97e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:31.599575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 64/131] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:31.601799 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6a568-aecc-4563-8506-3e01954cf97e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:31.658036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd73f8-9623-404d-9ee1-e35e005a8858 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:31.706037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:31.743292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f4a8d-b690-4bba-961c-31f911bc34bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:31.744223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f4a8d-b690-4bba-961c-31f911bc34bd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:31.744506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f4a8d-b690-4bba-961c-31f911bc34bd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:31.745386 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f4a8d-b690-4bba-961c-31f911bc34bd None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:31.747293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f4a8d-b690-4bba-961c-31f911bc34bd None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:31.748784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f4a8d-b690-4bba-961c-31f911bc34bd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:31.756222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 68/132] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:31 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:31.756222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f4a8d-b690-4bba-961c-31f911bc34bd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:31.787650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6a568-aecc-4563-8506-3e01954cf97e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:31.824954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cca29-8ced-4f56-a043-e1648c906df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:31.825861 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cca29-8ced-4f56-a043-e1648c906df3 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:31.826142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cca29-8ced-4f56-a043-e1648c906df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:31.826462 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cca29-8ced-4f56-a043-e1648c906df3 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d/users/fd100c82cfbd4bfaaffc9eee00a66751/roles/d73c76bc61c44f3a94e66397b0d9c359` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:31.829226 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cca29-8ced-4f56-a043-e1648c906df3 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc870179720c49a5916bb6299e1ba91d, user_id=fd100c82cfbd4bfaaffc9eee00a66751, role_id=d73c76bc61c44f3a94e66397b0d9c359)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:31.830832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cca29-8ced-4f56-a043-e1648c906df3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:31.871106 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:31.913076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f4a8d-b690-4bba-961c-31f911bc34bd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:31.952370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bb082-8134-4319-a776-646baa951c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:31.953255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bb082-8134-4319-a776-646baa951c96 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:31.953536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bb082-8134-4319-a776-646baa951c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:31.953809 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bb082-8134-4319-a776-646baa951c96 None admin] PATH_INFO: `/v3/users/fd100c82cfbd4bfaaffc9eee00a66751` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:31.955060 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bb082-8134-4319-a776-646baa951c96 None admin] RBAC: Authorizing `identity:get_user(user_id=fd100c82cfbd4bfaaffc9eee00a66751)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:31.966705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 65/133] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:14:31 2022] PUT /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d/users/fd100c82cfbd4bfaaffc9eee00a66751/roles/d73c76bc61c44f3a94e66397b0d9c359 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:14:31.966705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cca29-8ced-4f56-a043-e1648c906df3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:31.966940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bb082-8134-4319-a776-646baa951c96 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:31.966940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 69/134] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:31 2022] GET /identity/v3/users/fd100c82cfbd4bfaaffc9eee00a66751 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:31.970913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4df4c-f683-4177-8b9c-82fd49e94187 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:31.972623 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4df4c-f683-4177-8b9c-82fd49e94187 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:31.972623 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4df4c-f683-4177-8b9c-82fd49e94187 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:31.978466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 70/135] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:31 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:31.982111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4df4c-f683-4177-8b9c-82fd49e94187 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:32.172050 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4df4c-f683-4177-8b9c-82fd49e94187 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:32.189138 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cca29-8ced-4f56-a043-e1648c906df3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:32.191704 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:32.206134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:32.219039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2c0fb-0773-4d82-8408-77975cb06498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:32.220254 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2c0fb-0773-4d82-8408-77975cb06498 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.220740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2c0fb-0773-4d82-8408-77975cb06498 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.221243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2c0fb-0773-4d82-8408-77975cb06498 None admin] PATH_INFO: `/v3/projects/9b3ebf75b6b54ef78ffdbf33519cb97c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.222694 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2c0fb-0773-4d82-8408-77975cb06498 None admin] RBAC: Authorizing `identity:get_project(project_id=9b3ebf75b6b54ef78ffdbf33519cb97c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:32.224372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2c0fb-0773-4d82-8408-77975cb06498 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:32.226335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 71/136] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:31 2022] GET /identity/v3/projects/9b3ebf75b6b54ef78ffdbf33519cb97c => generated 312 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:32.228247 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3838b-762c-4f12-b1d6-b92097c3f589 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.229931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3838b-762c-4f12-b1d6-b92097c3f589 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.229931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3838b-762c-4f12-b1d6-b92097c3f589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.231856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29df4c-56d9-46e0-8efb-6cbc0636a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:32.232884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29df4c-56d9-46e0-8efb-6cbc0636a862 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.233242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29df4c-56d9-46e0-8efb-6cbc0636a862 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.233588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29df4c-56d9-46e0-8efb-6cbc0636a862 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d/users/bc14ede82e87407488accc3a9acc26ad/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.235937 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29df4c-56d9-46e0-8efb-6cbc0636a862 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc870179720c49a5916bb6299e1ba91d, user_id=bc14ede82e87407488accc3a9acc26ad, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:32.238086 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29df4c-56d9-46e0-8efb-6cbc0636a862 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:32.252490 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3fc3838b-762c-4f12-b1d6-b92097c3f589 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:32.255845 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3fc3838b-762c-4f12-b1d6-b92097c3f589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:32.309141 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 66/137] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:14:31 2022] PUT /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d/users/bc14ede82e87407488accc3a9acc26ad/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:14:32.311362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29df4c-56d9-46e0-8efb-6cbc0636a862 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:32.386058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 72/138] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:32.443093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3838b-762c-4f12-b1d6-b92097c3f589 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:32.521188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29df4c-56d9-46e0-8efb-6cbc0636a862 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:32.571528 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72d8c7-eca8-4cad-b0ec-164cb0f69852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:32.572416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72d8c7-eca8-4cad-b0ec-164cb0f69852 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.572881 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72d8c7-eca8-4cad-b0ec-164cb0f69852 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.573384 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72d8c7-eca8-4cad-b0ec-164cb0f69852 None admin] PATH_INFO: `/v3/projects/9b3ebf75b6b54ef78ffdbf33519cb97c/users/fd100c82cfbd4bfaaffc9eee00a66751/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.577383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72d8c7-eca8-4cad-b0ec-164cb0f69852 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b3ebf75b6b54ef78ffdbf33519cb97c, user_id=fd100c82cfbd4bfaaffc9eee00a66751, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:32.578493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72d8c7-eca8-4cad-b0ec-164cb0f69852 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:32.606640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3838b-762c-4f12-b1d6-b92097c3f589 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:32.630077 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:32.645077 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899fb7b-9145-4ddf-b914-9a10298968b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:32.646128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899fb7b-9145-4ddf-b914-9a10298968b5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.646550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899fb7b-9145-4ddf-b914-9a10298968b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.646986 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899fb7b-9145-4ddf-b914-9a10298968b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.648358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899fb7b-9145-4ddf-b914-9a10298968b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:32.649981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899fb7b-9145-4ddf-b914-9a10298968b5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:32.652443 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 73/139] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:32.657497 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899fb7b-9145-4ddf-b914-9a10298968b5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:32.670118 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 67/140] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:14:32 2022] PUT /identity/v3/projects/9b3ebf75b6b54ef78ffdbf33519cb97c/users/fd100c82cfbd4bfaaffc9eee00a66751/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:14:32.794066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7911545-4d50-4d52-9b50-63622dbdc63d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.794540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7911545-4d50-4d52-9b50-63622dbdc63d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.794770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7911545-4d50-4d52-9b50-63622dbdc63d None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.796453 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 68/141] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:14:32.802164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899fb7b-9145-4ddf-b914-9a10298968b5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:32.804095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af44640-721b-4418-b063-69719e61cbae None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.804649 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af44640-721b-4418-b063-69719e61cbae None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.806118 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af44640-721b-4418-b063-69719e61cbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.859112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0af44640-721b-4418-b063-69719e61cbae None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:32.863339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0af44640-721b-4418-b063-69719e61cbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:32.888048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a7024-d2d2-451b-a4e7-2bdabadefc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:32.888743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a7024-d2d2-451b-a4e7-2bdabadefc39 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.889024 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a7024-d2d2-451b-a4e7-2bdabadefc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.889299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a7024-d2d2-451b-a4e7-2bdabadefc39 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.892187 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a7024-d2d2-451b-a4e7-2bdabadefc39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:32.897080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a7024-d2d2-451b-a4e7-2bdabadefc39 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:32.910888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:32.971851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 69/142] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:32.997054 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af44640-721b-4418-b063-69719e61cbae None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:33.059860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 74/143] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:14:32 2022] POST /identity/v3/users => generated 283 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:14:33.130659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af44640-721b-4418-b063-69719e61cbae None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:33.202654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96963daf-1564-4041-bbec-907330de94fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:33.203756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96963daf-1564-4041-bbec-907330de94fa None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:33.204225 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96963daf-1564-4041-bbec-907330de94fa None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:33.204681 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96963daf-1564-4041-bbec-907330de94fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:33.235887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96963daf-1564-4041-bbec-907330de94fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-96963daf-1564-4041-bbec-907330de94fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:33.245609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:33.246844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:33.247898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:33.247898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:33.247898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:33.247898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:33.247898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:33.247898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:33.247898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:33.247898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:33.247898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:33.247898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:33.247898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:33.247898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:33.250076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 70/144] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:33.256610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a7024-d2d2-451b-a4e7-2bdabadefc39 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:33.349603 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:33.500963 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a7024-d2d2-451b-a4e7-2bdabadefc39 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:33.581303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82465f-30a7-4e9d-8359-d5a31f78094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:33.581985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82465f-30a7-4e9d-8359-d5a31f78094c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:33.582265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82465f-30a7-4e9d-8359-d5a31f78094c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:33.586696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82465f-30a7-4e9d-8359-d5a31f78094c None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:33.586696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82465f-30a7-4e9d-8359-d5a31f78094c None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:33.586696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82465f-30a7-4e9d-8359-d5a31f78094c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:33.586696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82465f-30a7-4e9d-8359-d5a31f78094c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:33.602076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 75/145] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:33.609292 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96963daf-1564-4041-bbec-907330de94fa None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:33.659096 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:33.779673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96963daf-1564-4041-bbec-907330de94fa None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:33.828822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414a3c6-ed44-4f8d-b840-4d1754214a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:33.830142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414a3c6-ed44-4f8d-b840-4d1754214a9f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:33.830662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414a3c6-ed44-4f8d-b840-4d1754214a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:33.831160 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414a3c6-ed44-4f8d-b840-4d1754214a9f None admin] PATH_INFO: `/v3/users/fd100c82cfbd4bfaaffc9eee00a66751` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:33.832765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414a3c6-ed44-4f8d-b840-4d1754214a9f None admin] RBAC: Authorizing `identity:get_user(user_id=fd100c82cfbd4bfaaffc9eee00a66751)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:33.834457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414a3c6-ed44-4f8d-b840-4d1754214a9f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:33.836360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 71/146] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:33 2022] GET /identity/v3/users/fd100c82cfbd4bfaaffc9eee00a66751 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:33.844823 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82465f-30a7-4e9d-8359-d5a31f78094c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:33.999185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82465f-30a7-4e9d-8359-d5a31f78094c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:34.006488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:34.030647 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e88ea-f660-4e20-ae05-66d3f3197547 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:34.031054 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e88ea-f660-4e20-ae05-66d3f3197547 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:34.031408 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e88ea-f660-4e20-ae05-66d3f3197547 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:34.033193 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 72/147] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:34.039033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0039545-2a17-4b0d-b823-a8baa8cedb09 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:34.040202 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0039545-2a17-4b0d-b823-a8baa8cedb09 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:34.040431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0039545-2a17-4b0d-b823-a8baa8cedb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:34.047165 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d7745-dadb-4108-ad78-d792dd533b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:34.048041 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d7745-dadb-4108-ad78-d792dd533b26 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:34.049432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d7745-dadb-4108-ad78-d792dd533b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:34.050039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d7745-dadb-4108-ad78-d792dd533b26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:34.067650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f0039545-2a17-4b0d-b823-a8baa8cedb09 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:34.069207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f0039545-2a17-4b0d-b823-a8baa8cedb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:34.163396 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d7745-dadb-4108-ad78-d792dd533b26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:34.164907 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d7745-dadb-4108-ad78-d792dd533b26 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:34.169938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 73/148] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:34.214757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0039545-2a17-4b0d-b823-a8baa8cedb09 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:34.230915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:34.304040 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 76/149] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:34.311522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d7745-dadb-4108-ad78-d792dd533b26 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:34.332089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:34.372102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0039545-2a17-4b0d-b823-a8baa8cedb09 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:34.419360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24944dc1-2778-48f2-a8f8-99b5d739a8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:34.420208 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24944dc1-2778-48f2-a8f8-99b5d739a8dc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:34.420492 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24944dc1-2778-48f2-a8f8-99b5d739a8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:34.420767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24944dc1-2778-48f2-a8f8-99b5d739a8dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:34.442185 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24944dc1-2778-48f2-a8f8-99b5d739a8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-24944dc1-2778-48f2-a8f8-99b5d739a8dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:34.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:34.461237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:34.463431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:34.463431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:34.463431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:34.463431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:34.463431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:34.463431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:34.463431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:34.463431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:34.463431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:34.463431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:34.463431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:34.463431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:34.463431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 74/150] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:34.470706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24944dc1-2778-48f2-a8f8-99b5d739a8dc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:34.527198 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d7745-dadb-4108-ad78-d792dd533b26 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:34.580628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b65ae-55d3-4bf7-a45f-e1c734e4b6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:34.581864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b65ae-55d3-4bf7-a45f-e1c734e4b6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:34.582334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b65ae-55d3-4bf7-a45f-e1c734e4b6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:34.582843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b65ae-55d3-4bf7-a45f-e1c734e4b6b9 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:34.587574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b65ae-55d3-4bf7-a45f-e1c734e4b6b9 None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:34.590074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b65ae-55d3-4bf7-a45f-e1c734e4b6b9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:34.592125 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 77/151] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:34 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:34.599373 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b65ae-55d3-4bf7-a45f-e1c734e4b6b9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:34.644983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:34.713584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24944dc1-2778-48f2-a8f8-99b5d739a8dc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:34.723727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:34.764357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b65ae-55d3-4bf7-a45f-e1c734e4b6b9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:34.781189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae08a1e-35f1-4f54-a800-781e4b94b4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:34.782219 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae08a1e-35f1-4f54-a800-781e4b94b4cb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:34.782717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae08a1e-35f1-4f54-a800-781e4b94b4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:34.783204 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae08a1e-35f1-4f54-a800-781e4b94b4cb None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:34.784146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae08a1e-35f1-4f54-a800-781e4b94b4cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:34.784637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae08a1e-35f1-4f54-a800-781e4b94b4cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:34.786198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae08a1e-35f1-4f54-a800-781e4b94b4cb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:34.801295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 75/152] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:34.809317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae08a1e-35f1-4f54-a800-781e4b94b4cb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:34.840591 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e171ef-da62-4229-876e-14969f808bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:34.841578 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e171ef-da62-4229-876e-14969f808bfb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:34.842045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e171ef-da62-4229-876e-14969f808bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:34.842501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e171ef-da62-4229-876e-14969f808bfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:34.843662 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e171ef-da62-4229-876e-14969f808bfb None admin] RBAC: Adding query filter params (role.id=9b386d2d84ef4d3b9f9401c95f06c53b, scope.project.id=dc870179720c49a5916bb6299e1ba91d, user.id=fd100c82cfbd4bfaaffc9eee00a66751) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:34.844357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e171ef-da62-4229-876e-14969f808bfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:34.846044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e171ef-da62-4229-876e-14969f808bfb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:34.865343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 78/153] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:34 2022] GET /identity/v3/role_assignments?user.id=fd100c82cfbd4bfaaffc9eee00a66751&scope.project.id=dc870179720c49a5916bb6299e1ba91d&role.id=9b386d2d84ef4d3b9f9401c95f06c53b => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:34.980270 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae08a1e-35f1-4f54-a800-781e4b94b4cb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:35.029805 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64edd5-f8fc-4bd8-89e5-cd7c28de25ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:35.030706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64edd5-f8fc-4bd8-89e5-cd7c28de25ff None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:35.030986 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64edd5-f8fc-4bd8-89e5-cd7c28de25ff None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:35.031257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64edd5-f8fc-4bd8-89e5-cd7c28de25ff None admin] PATH_INFO: `/v3/users/7d94ce41a8294ba1a559395432ca15bc` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:35.032497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64edd5-f8fc-4bd8-89e5-cd7c28de25ff None admin] RBAC: Authorizing `identity:get_user(user_id=7d94ce41a8294ba1a559395432ca15bc)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:35.034334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64edd5-f8fc-4bd8-89e5-cd7c28de25ff None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:35.036104 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 76/154] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:34 2022] GET /identity/v3/users/7d94ce41a8294ba1a559395432ca15bc => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:35.042993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e171ef-da62-4229-876e-14969f808bfb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:35.195118 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e171ef-da62-4229-876e-14969f808bfb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:35.247844 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b0c66-774b-41e5-abdd-9f645017a0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:35.248721 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b0c66-774b-41e5-abdd-9f645017a0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:35.248994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b0c66-774b-41e5-abdd-9f645017a0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:35.249261 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b0c66-774b-41e5-abdd-9f645017a0f6 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:35.255675 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b0c66-774b-41e5-abdd-9f645017a0f6 None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:35.257193 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b0c66-774b-41e5-abdd-9f645017a0f6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:35.259365 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 79/155] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:35 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:35.265544 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64edd5-f8fc-4bd8-89e5-cd7c28de25ff None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:35.268631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:35.416295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64edd5-f8fc-4bd8-89e5-cd7c28de25ff None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:35.455285 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886bcec-2eff-4288-ad05-0f047fc6f667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:35.456164 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886bcec-2eff-4288-ad05-0f047fc6f667 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:35.456489 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886bcec-2eff-4288-ad05-0f047fc6f667 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:35.456768 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886bcec-2eff-4288-ad05-0f047fc6f667 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d/users/7d94ce41a8294ba1a559395432ca15bc/roles/8b71d050850f4e75a4ae097553e111d0` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:35.458812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886bcec-2eff-4288-ad05-0f047fc6f667 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc870179720c49a5916bb6299e1ba91d, user_id=7d94ce41a8294ba1a559395432ca15bc, role_id=8b71d050850f4e75a4ae097553e111d0)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:35.460292 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886bcec-2eff-4288-ad05-0f047fc6f667 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:35.537270 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 77/156] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:14:35 2022] PUT /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d/users/7d94ce41a8294ba1a559395432ca15bc/roles/8b71d050850f4e75a4ae097553e111d0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:14:35.788914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65274e9a-f497-4da7-9092-471ed61a1707 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:35.789412 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65274e9a-f497-4da7-9092-471ed61a1707 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:35.789412 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65274e9a-f497-4da7-9092-471ed61a1707 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:35.791060 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 80/157] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:35.796903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767881fe-60f8-4020-b376-fe8383b715f6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:35.797390 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767881fe-60f8-4020-b376-fe8383b715f6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:35.797465 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767881fe-60f8-4020-b376-fe8383b715f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:35.819897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-767881fe-60f8-4020-b376-fe8383b715f6 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:35.821200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-767881fe-60f8-4020-b376-fe8383b715f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:35.871810 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863d653-d6ba-4148-b2b4-c66a513f9bb2 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:35.872163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863d653-d6ba-4148-b2b4-c66a513f9bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:35.872361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863d653-d6ba-4148-b2b4-c66a513f9bb2 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:35.873910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 81/158] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:35.883337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3c206-d3e9-4c91-983a-529aff7266ba None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:35.883610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3c206-d3e9-4c91-983a-529aff7266ba None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:35.884039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3c206-d3e9-4c91-983a-529aff7266ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:35.903096 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:35.908786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 78/159] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:35.910523 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:35.924775 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-84e3c206-d3e9-4c91-983a-529aff7266ba None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:35.925985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-84e3c206-d3e9-4c91-983a-529aff7266ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:35.933826 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767881fe-60f8-4020-b376-fe8383b715f6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:36.047061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767881fe-60f8-4020-b376-fe8383b715f6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:36.054100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 82/160] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:36.082770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0841ea1-81aa-4e00-907f-e7e63c4d28ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:36.083588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0841ea1-81aa-4e00-907f-e7e63c4d28ee None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.083867 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0841ea1-81aa-4e00-907f-e7e63c4d28ee None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.084135 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0841ea1-81aa-4e00-907f-e7e63c4d28ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.096175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0841ea1-81aa-4e00-907f-e7e63c4d28ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:36.097274 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3c206-d3e9-4c91-983a-529aff7266ba None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e0841ea1-81aa-4e00-907f-e7e63c4d28ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:36.110728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:36.111717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:36.112491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:36.112491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:36.112491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:36.112491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:36.112491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:36.112491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:36.112491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:36.112491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:36.112491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:36.112491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:36.112491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:14:36.112491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:36.112491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 79/161] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:14:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:36.113164 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0841ea1-81aa-4e00-907f-e7e63c4d28ee None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:36.171096 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:36.223027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0841ea1-81aa-4e00-907f-e7e63c4d28ee None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:36.260695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e93d9d-ebdd-472e-a090-a9e7f2268bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:36.262513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e93d9d-ebdd-472e-a090-a9e7f2268bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.263028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e93d9d-ebdd-472e-a090-a9e7f2268bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.263439 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e93d9d-ebdd-472e-a090-a9e7f2268bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.264355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e93d9d-ebdd-472e-a090-a9e7f2268bf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:36.264789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e93d9d-ebdd-472e-a090-a9e7f2268bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:36.266353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e93d9d-ebdd-472e-a090-a9e7f2268bf6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:36.273356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3c206-d3e9-4c91-983a-529aff7266ba None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:36.277341 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 80/162] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:36.289400 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e93d9d-ebdd-472e-a090-a9e7f2268bf6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:36.339571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbab0b8-29ac-42d6-a3cb-17abf3331f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:36.340414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbab0b8-29ac-42d6-a3cb-17abf3331f97 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.340766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbab0b8-29ac-42d6-a3cb-17abf3331f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.341107 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbab0b8-29ac-42d6-a3cb-17abf3331f97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.347672 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:36.365753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbab0b8-29ac-42d6-a3cb-17abf3331f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0bbab0b8-29ac-42d6-a3cb-17abf3331f97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:36.373441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:36.374361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:36.375255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:36.375255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:36.375255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:36.375255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:36.375255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:36.375255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:36.375255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:36.375255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:36.375255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:36.375255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:36.375255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:36.375255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:36.375255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 83/163] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:14:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:36.379793 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbab0b8-29ac-42d6-a3cb-17abf3331f97 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:36.439844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e93d9d-ebdd-472e-a090-a9e7f2268bf6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:36.466176 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:36.505977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c28b1c-8bef-41d9-8f95-9fc1aa02d6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:36.506947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c28b1c-8bef-41d9-8f95-9fc1aa02d6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.507226 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c28b1c-8bef-41d9-8f95-9fc1aa02d6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.507498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c28b1c-8bef-41d9-8f95-9fc1aa02d6b8 None admin] PATH_INFO: `/v3/users/fd100c82cfbd4bfaaffc9eee00a66751` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.508835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c28b1c-8bef-41d9-8f95-9fc1aa02d6b8 None admin] RBAC: Authorizing `identity:get_user(user_id=fd100c82cfbd4bfaaffc9eee00a66751)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:36.510991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c28b1c-8bef-41d9-8f95-9fc1aa02d6b8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:36.519491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 81/164] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:36 2022] GET /identity/v3/users/fd100c82cfbd4bfaaffc9eee00a66751 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:36.520942 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0542ac1-8b2f-4f97-95ba-4ed0947e1092 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.521210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0542ac1-8b2f-4f97-95ba-4ed0947e1092 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.521483 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0542ac1-8b2f-4f97-95ba-4ed0947e1092 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.522846 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 82/165] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:36.523588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0542ac1-8b2f-4f97-95ba-4ed0947e1092 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:36.693346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbab0b8-29ac-42d6-a3cb-17abf3331f97 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:36.743441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0542ac1-8b2f-4f97-95ba-4ed0947e1092 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:36.748500 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffc3c1-dd03-4ce6-8816-d0ff5a88f752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:36.748500 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffc3c1-dd03-4ce6-8816-d0ff5a88f752 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.748500 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffc3c1-dd03-4ce6-8816-d0ff5a88f752 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.748500 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffc3c1-dd03-4ce6-8816-d0ff5a88f752 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.749220 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffc3c1-dd03-4ce6-8816-d0ff5a88f752 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:36.749524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffc3c1-dd03-4ce6-8816-d0ff5a88f752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:36.750966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffc3c1-dd03-4ce6-8816-d0ff5a88f752 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:36.785744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 84/166] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:36.787345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d0724-4c71-41fb-b671-923e68d9765b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.787632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d0724-4c71-41fb-b671-923e68d9765b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.787910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d0724-4c71-41fb-b671-923e68d9765b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.813476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5b7d0724-4c71-41fb-b671-923e68d9765b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:36.814720 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5b7d0724-4c71-41fb-b671-923e68d9765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:36.840369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9189e-5fd4-440f-b01d-f474cf789a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:36.841064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9189e-5fd4-440f-b01d-f474cf789a55 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.841307 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9189e-5fd4-440f-b01d-f474cf789a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.841581 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9189e-5fd4-440f-b01d-f474cf789a55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.919252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:36.935149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 85/167] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:36.936436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d0724-4c71-41fb-b671-923e68d9765b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:36.950124 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:36.981040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9189e-5fd4-440f-b01d-f474cf789a55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:36.982807 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9189e-5fd4-440f-b01d-f474cf789a55 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:37.127367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d0724-4c71-41fb-b671-923e68d9765b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:37.173295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e45b21-67d3-448c-b33a-42cfb89365dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:37.174689 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e45b21-67d3-448c-b33a-42cfb89365dd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:37.175074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e45b21-67d3-448c-b33a-42cfb89365dd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:37.175442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e45b21-67d3-448c-b33a-42cfb89365dd None admin] PATH_INFO: `/v3/users/bc14ede82e87407488accc3a9acc26ad` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:37.177099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e45b21-67d3-448c-b33a-42cfb89365dd None admin] RBAC: Authorizing `identity:get_user(user_id=bc14ede82e87407488accc3a9acc26ad)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:37.178974 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e45b21-67d3-448c-b33a-42cfb89365dd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:37.181397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 86/168] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:36 2022] GET /identity/v3/users/bc14ede82e87407488accc3a9acc26ad => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:37.182938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e45b21-67d3-448c-b33a-42cfb89365dd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:37.185452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 83/169] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:37.191106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9189e-5fd4-440f-b01d-f474cf789a55 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:37.253558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:37.343253 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e45b21-67d3-448c-b33a-42cfb89365dd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:37.402389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f503ecb-e282-40ec-ad97-44f9b94f8ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:37.403227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503ecb-e282-40ec-ad97-44f9b94f8ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:37.403504 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503ecb-e282-40ec-ad97-44f9b94f8ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:37.403775 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503ecb-e282-40ec-ad97-44f9b94f8ea7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:37.415941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f503ecb-e282-40ec-ad97-44f9b94f8ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:37.420220 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7f503ecb-e282-40ec-ad97-44f9b94f8ea7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:37.426267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:37.427286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:37.428452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:37.428452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:37.428452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:37.428452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:37.428452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:37.428452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:37.428452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:37.428452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:37.428452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:37.428452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:37.428452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:37.428452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:37.428452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 87/170] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:37.429132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f503ecb-e282-40ec-ad97-44f9b94f8ea7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:37.482538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9189e-5fd4-440f-b01d-f474cf789a55 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:37.567560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaa86b-9e09-4b94-8ac8-d5637af002fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:37.568357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaa86b-9e09-4b94-8ac8-d5637af002fd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:37.568633 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaa86b-9e09-4b94-8ac8-d5637af002fd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:37.568936 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaa86b-9e09-4b94-8ac8-d5637af002fd None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:37.570262 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaa86b-9e09-4b94-8ac8-d5637af002fd None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:37.571777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaa86b-9e09-4b94-8ac8-d5637af002fd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:37.574545 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 84/171] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:37 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:37.575170 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaa86b-9e09-4b94-8ac8-d5637af002fd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:37.591160 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f503ecb-e282-40ec-ad97-44f9b94f8ea7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:37.637216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:37.695758 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48ffc7-597f-4905-926c-647ff612af9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:37.696415 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48ffc7-597f-4905-926c-647ff612af9b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:37.696694 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48ffc7-597f-4905-926c-647ff612af9b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:37.696962 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48ffc7-597f-4905-926c-647ff612af9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:37.735389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaa86b-9e09-4b94-8ac8-d5637af002fd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:37.800205 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48ffc7-597f-4905-926c-647ff612af9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:37.801974 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48ffc7-597f-4905-926c-647ff612af9b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:37.843550 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f490a-c479-4869-8f75-cd78c2f51427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:37.844204 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f490a-c479-4869-8f75-cd78c2f51427 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:37.844487 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f490a-c479-4869-8f75-cd78c2f51427 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:37.844755 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f490a-c479-4869-8f75-cd78c2f51427 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:37.845513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f490a-c479-4869-8f75-cd78c2f51427 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:37.845814 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f490a-c479-4869-8f75-cd78c2f51427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:37.847230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f490a-c479-4869-8f75-cd78c2f51427 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:37.872460 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 85/172] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:37.873349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f490a-c479-4869-8f75-cd78c2f51427 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:37.892116 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:37.917574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 88/173] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:37.919637 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672c6e6-0696-418c-8046-7b518f1f94b6 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:37.920081 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672c6e6-0696-418c-8046-7b518f1f94b6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:37.920990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672c6e6-0696-418c-8046-7b518f1f94b6 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:37.922467 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 89/174] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:37.923711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672c6e6-0696-418c-8046-7b518f1f94b6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:37.955064 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:38.039185 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f490a-c479-4869-8f75-cd78c2f51427 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:38.054322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672c6e6-0696-418c-8046-7b518f1f94b6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:38.077191 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fa75e-c9d3-4b15-93cf-c70f5398f82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:38.078223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fa75e-c9d3-4b15-93cf-c70f5398f82a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.078501 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fa75e-c9d3-4b15-93cf-c70f5398f82a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.078973 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fa75e-c9d3-4b15-93cf-c70f5398f82a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.079974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fa75e-c9d3-4b15-93cf-c70f5398f82a None admin] RBAC: Adding query filter params (role.id=d73c76bc61c44f3a94e66397b0d9c359, scope.project.id=dc870179720c49a5916bb6299e1ba91d, user.id=fd100c82cfbd4bfaaffc9eee00a66751) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:38.080438 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fa75e-c9d3-4b15-93cf-c70f5398f82a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:38.082144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fa75e-c9d3-4b15-93cf-c70f5398f82a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:38.089688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 86/175] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:37 2022] GET /identity/v3/role_assignments?user.id=fd100c82cfbd4bfaaffc9eee00a66751&scope.project.id=dc870179720c49a5916bb6299e1ba91d&role.id=d73c76bc61c44f3a94e66397b0d9c359 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:38.090848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fa75e-c9d3-4b15-93cf-c70f5398f82a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:38.099143 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4eef7-f278-4b9f-8363-36ad87e435bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:38.100002 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4eef7-f278-4b9f-8363-36ad87e435bd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.100278 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4eef7-f278-4b9f-8363-36ad87e435bd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.100545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4eef7-f278-4b9f-8363-36ad87e435bd None admin] PATH_INFO: `/v3/users/fd100c82cfbd4bfaaffc9eee00a66751` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.101941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4eef7-f278-4b9f-8363-36ad87e435bd None admin] RBAC: Authorizing `identity:get_user(user_id=fd100c82cfbd4bfaaffc9eee00a66751)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:38.104481 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4eef7-f278-4b9f-8363-36ad87e435bd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:38.106659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 90/176] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:37 2022] GET /identity/v3/users/fd100c82cfbd4bfaaffc9eee00a66751 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:38.109547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd890dc-601c-4ff7-9def-110d8bb13aae None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.110095 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd890dc-601c-4ff7-9def-110d8bb13aae None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.110858 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd890dc-601c-4ff7-9def-110d8bb13aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.136183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ffd890dc-601c-4ff7-9def-110d8bb13aae None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:38.138919 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ffd890dc-601c-4ff7-9def-110d8bb13aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:38.199069 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:38.231421 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fa75e-c9d3-4b15-93cf-c70f5398f82a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:38.249808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 91/177] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:38.251625 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58a1f-b767-46e5-adac-aa2b16e705ed None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.251985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58a1f-b767-46e5-adac-aa2b16e705ed None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.252584 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58a1f-b767-46e5-adac-aa2b16e705ed None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.254661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 92/178] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:38.255459 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f58a1f-b767-46e5-adac-aa2b16e705ed None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:38.278078 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4ea5e-94b0-4cc1-94f2-fd39ec1c8bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:38.279124 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4ea5e-94b0-4cc1-94f2-fd39ec1c8bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.279448 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4ea5e-94b0-4cc1-94f2-fd39ec1c8bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.279773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4ea5e-94b0-4cc1-94f2-fd39ec1c8bc5 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.281073 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4ea5e-94b0-4cc1-94f2-fd39ec1c8bc5 None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:38.282442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:38.282732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4ea5e-94b0-4cc1-94f2-fd39ec1c8bc5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:38.290588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 87/179] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:38 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:38.292544 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8183d-e614-4876-b3f7-d2ecdf3f9798 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.296197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8183d-e614-4876-b3f7-d2ecdf3f9798 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.296197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8183d-e614-4876-b3f7-d2ecdf3f9798 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.296197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 88/180] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:38.300517 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c0d1a-8c05-4d00-9afc-9692e853d50e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.300517 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c0d1a-8c05-4d00-9afc-9692e853d50e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.300865 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c0d1a-8c05-4d00-9afc-9692e853d50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.320523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-040c0d1a-8c05-4d00-9afc-9692e853d50e None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:38.321628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-040c0d1a-8c05-4d00-9afc-9692e853d50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:38.402759 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f58a1f-b767-46e5-adac-aa2b16e705ed None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:38.417879 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 89/181] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:38.418190 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c0d1a-8c05-4d00-9afc-9692e853d50e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:38.445187 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb710f7-0d39-47d3-9eca-f37b637c7486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:38.445897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb710f7-0d39-47d3-9eca-f37b637c7486 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.446260 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb710f7-0d39-47d3-9eca-f37b637c7486 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.446446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb710f7-0d39-47d3-9eca-f37b637c7486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.514998 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:38.524135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb710f7-0d39-47d3-9eca-f37b637c7486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:38.526435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb710f7-0d39-47d3-9eca-f37b637c7486 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:38.541781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c0d1a-8c05-4d00-9afc-9692e853d50e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:38.544651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:38.661740 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3bba9-461a-4144-906f-0852a6a30a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:38.662822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3bba9-461a-4144-906f-0852a6a30a39 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.663237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3bba9-461a-4144-906f-0852a6a30a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.663646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3bba9-461a-4144-906f-0852a6a30a39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.677166 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3bba9-461a-4144-906f-0852a6a30a39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-60f3bba9-461a-4144-906f-0852a6a30a39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:38.686249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:38.687375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:38.688394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:38.688394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:38.688394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:38.688394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:38.688394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:38.688394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:38.688394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:38.688394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:38.688394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:38.688394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:38.688394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:38.688394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:38.688394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 90/182] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:14:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:38.688394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3bba9-461a-4144-906f-0852a6a30a39 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:38.694285 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 93/183] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:38.695578 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a6442-38c0-4d74-bb1d-67c393d2d35b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.695858 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a6442-38c0-4d74-bb1d-67c393d2d35b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.696125 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a6442-38c0-4d74-bb1d-67c393d2d35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.712890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0a9a6442-38c0-4d74-bb1d-67c393d2d35b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:38.714592 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0a9a6442-38c0-4d74-bb1d-67c393d2d35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:38.802695 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 94/184] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:38.802695 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a6442-38c0-4d74-bb1d-67c393d2d35b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:38.802991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3bba9-461a-4144-906f-0852a6a30a39 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:38.836372 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fc61d-16b7-4c89-b1a3-92ff95e36365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:38.837381 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fc61d-16b7-4c89-b1a3-92ff95e36365 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.837381 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fc61d-16b7-4c89-b1a3-92ff95e36365 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.837587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fc61d-16b7-4c89-b1a3-92ff95e36365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.839030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fc61d-16b7-4c89-b1a3-92ff95e36365 None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=dc870179720c49a5916bb6299e1ba91d, user.id=bc14ede82e87407488accc3a9acc26ad) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:38.839353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fc61d-16b7-4c89-b1a3-92ff95e36365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:38.840813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fc61d-16b7-4c89-b1a3-92ff95e36365 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:38.842642 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:38.845522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:38.858707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 91/185] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:38 2022] GET /identity/v3/role_assignments?user.id=bc14ede82e87407488accc3a9acc26ad&scope.project.id=dc870179720c49a5916bb6299e1ba91d&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:38.858707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82308ffe-9961-4432-aab9-fc8e8b703d31 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.858707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82308ffe-9961-4432-aab9-fc8e8b703d31 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.858707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82308ffe-9961-4432-aab9-fc8e8b703d31 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.858707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 92/186] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:38.858707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82308ffe-9961-4432-aab9-fc8e8b703d31 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:38.913745 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a6442-38c0-4d74-bb1d-67c393d2d35b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:38.957613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f0dd1-c7eb-4b23-95a1-0869d2969739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:38.958438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f0dd1-c7eb-4b23-95a1-0869d2969739 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.958737 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f0dd1-c7eb-4b23-95a1-0869d2969739 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.959013 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f0dd1-c7eb-4b23-95a1-0869d2969739 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.971275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f0dd1-c7eb-4b23-95a1-0869d2969739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:38.973687 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82308ffe-9961-4432-aab9-fc8e8b703d31 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-bc7f0dd1-c7eb-4b23-95a1-0869d2969739 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:38.979842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:38.980843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:38.981635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:38.981635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:38.981635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:38.981635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:38.981635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:38.981635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:38.981635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:38.981635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:38.981635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:38.981635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:38.981635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:14:38.981635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:38.981635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 95/187] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:14:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:38.982961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f0dd1-c7eb-4b23-95a1-0869d2969739 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:39.022470 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130bb81-7ebe-4f94-827e-360682ad7100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:39.023307 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130bb81-7ebe-4f94-827e-360682ad7100 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:39.023481 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130bb81-7ebe-4f94-827e-360682ad7100 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:39.023726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130bb81-7ebe-4f94-827e-360682ad7100 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:39.026004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130bb81-7ebe-4f94-827e-360682ad7100 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:39.026336 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130bb81-7ebe-4f94-827e-360682ad7100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:39.028213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130bb81-7ebe-4f94-827e-360682ad7100 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:39.038834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 93/188] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:39.039686 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130bb81-7ebe-4f94-827e-360682ad7100 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:39.102982 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f0dd1-c7eb-4b23-95a1-0869d2969739 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:39.106169 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:39.110088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:39.137036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f55809-233b-48c8-a488-b5761124fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:39.137906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f55809-233b-48c8-a488-b5761124fe7c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:39.138195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f55809-233b-48c8-a488-b5761124fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:39.138470 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f55809-233b-48c8-a488-b5761124fe7c None admin] PATH_INFO: `/v3/projects/9b3ebf75b6b54ef78ffdbf33519cb97c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:39.139756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f55809-233b-48c8-a488-b5761124fe7c None admin] RBAC: Authorizing `identity:get_project(project_id=9b3ebf75b6b54ef78ffdbf33519cb97c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:39.141224 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f55809-233b-48c8-a488-b5761124fe7c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:39.142973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 96/189] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:38 2022] GET /identity/v3/projects/9b3ebf75b6b54ef78ffdbf33519cb97c => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:39.144191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110525c-aec7-4e06-bb6d-174dd0f0495b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:39.144483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110525c-aec7-4e06-bb6d-174dd0f0495b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:39.144845 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110525c-aec7-4e06-bb6d-174dd0f0495b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:39.150807 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130bb81-7ebe-4f94-827e-360682ad7100 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:39.162409 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8110525c-aec7-4e06-bb6d-174dd0f0495b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:39.163623 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8110525c-aec7-4e06-bb6d-174dd0f0495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:39.186126 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe0eaa-7fd8-477f-88de-ec708f57f6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:39.186878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe0eaa-7fd8-477f-88de-ec708f57f6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:39.187158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe0eaa-7fd8-477f-88de-ec708f57f6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:39.187429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe0eaa-7fd8-477f-88de-ec708f57f6b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:39.189201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe0eaa-7fd8-477f-88de-ec708f57f6b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:39.190657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe0eaa-7fd8-477f-88de-ec708f57f6b8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:39.192572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 94/190] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:39.193338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe0eaa-7fd8-477f-88de-ec708f57f6b8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:39.236656 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 97/191] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:39.237397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110525c-aec7-4e06-bb6d-174dd0f0495b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:39.296887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe0eaa-7fd8-477f-88de-ec708f57f6b8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:39.326802 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:39.334389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893590fd-d336-41d0-9168-527701b6e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:39.335110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893590fd-d336-41d0-9168-527701b6e346 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:39.335393 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893590fd-d336-41d0-9168-527701b6e346 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:39.335667 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893590fd-d336-41d0-9168-527701b6e346 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:39.336433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893590fd-d336-41d0-9168-527701b6e346 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:39.336735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893590fd-d336-41d0-9168-527701b6e346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:39.352321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893590fd-d336-41d0-9168-527701b6e346 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:39.352321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 95/192] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:39.352321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893590fd-d336-41d0-9168-527701b6e346 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:39.352550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110525c-aec7-4e06-bb6d-174dd0f0495b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:39.352550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:39.386035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c3997-4a46-4a28-936e-12383079afa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:39.386943 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c3997-4a46-4a28-936e-12383079afa8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:39.387223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c3997-4a46-4a28-936e-12383079afa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:39.387493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c3997-4a46-4a28-936e-12383079afa8 None admin] PATH_INFO: `/v3/users/c45b1a841f754ea1b42ee6ae96db12c7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:39.402144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c3997-4a46-4a28-936e-12383079afa8 None admin] RBAC: Authorizing `identity:get_user(user_id=c45b1a841f754ea1b42ee6ae96db12c7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:39.403764 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c3997-4a46-4a28-936e-12383079afa8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:39.405576 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 98/193] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:39 2022] GET /identity/v3/users/c45b1a841f754ea1b42ee6ae96db12c7 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:39.406317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c3997-4a46-4a28-936e-12383079afa8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:39.455151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893590fd-d336-41d0-9168-527701b6e346 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:39.488713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c597e-78f9-48f2-9fd5-943c22ead2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:39.489370 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c597e-78f9-48f2-9fd5-943c22ead2eb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:39.489647 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c597e-78f9-48f2-9fd5-943c22ead2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:39.489915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c597e-78f9-48f2-9fd5-943c22ead2eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:39.490778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c597e-78f9-48f2-9fd5-943c22ead2eb None admin] RBAC: Adding query filter params (role.id=9b386d2d84ef4d3b9f9401c95f06c53b, scope.project.id=9b3ebf75b6b54ef78ffdbf33519cb97c, user.id=fd100c82cfbd4bfaaffc9eee00a66751) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:39.491083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c597e-78f9-48f2-9fd5-943c22ead2eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:39.492526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c597e-78f9-48f2-9fd5-943c22ead2eb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:39.498839 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 96/194] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:39 2022] GET /identity/v3/role_assignments?user.id=fd100c82cfbd4bfaaffc9eee00a66751&scope.project.id=9b3ebf75b6b54ef78ffdbf33519cb97c&role.id=9b386d2d84ef4d3b9f9401c95f06c53b => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:39.499618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c597e-78f9-48f2-9fd5-943c22ead2eb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:39.508084 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c3997-4a46-4a28-936e-12383079afa8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:39.551262 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd039f8-f4d4-4ebd-9d9c-c8499815cc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:39.551962 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd039f8-f4d4-4ebd-9d9c-c8499815cc1a None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:39.552249 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd039f8-f4d4-4ebd-9d9c-c8499815cc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:39.552527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd039f8-f4d4-4ebd-9d9c-c8499815cc1a None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:39.553268 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd039f8-f4d4-4ebd-9d9c-c8499815cc1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:39.554822 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd039f8-f4d4-4ebd-9d9c-c8499815cc1a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:39.578632 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:39.625466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c597e-78f9-48f2-9fd5-943c22ead2eb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:39.664678 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec1664-534b-4751-820e-f669527ab060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:39.665001 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec1664-534b-4751-820e-f669527ab060 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:39.665581 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec1664-534b-4751-820e-f669527ab060 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:39.665967 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec1664-534b-4751-820e-f669527ab060 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:39.677814 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec1664-534b-4751-820e-f669527ab060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-51ec1664-534b-4751-820e-f669527ab060 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:39.686312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:39.687530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:39.688348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:39.688348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:39.688348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:39.688348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:39.688348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:39.688348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:39.688348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:39.688348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:39.688348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:39.688348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:39.688348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:39.688348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:39.688348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 97/195] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:39.688348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec1664-534b-4751-820e-f669527ab060 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:39.697819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 99/196] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:14:39 2022] POST /identity/v3/users => generated 297 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:14:39.699884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd039f8-f4d4-4ebd-9d9c-c8499815cc1a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:39.727393 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:39.824603 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec1664-534b-4751-820e-f669527ab060 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:39.838407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd039f8-f4d4-4ebd-9d9c-c8499815cc1a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:39.842211 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:39.866842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347c63b-3c35-4140-84ea-49e9b7bf09a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:39.867719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347c63b-3c35-4140-84ea-49e9b7bf09a7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:39.868004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347c63b-3c35-4140-84ea-49e9b7bf09a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:39.868286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347c63b-3c35-4140-84ea-49e9b7bf09a7 None admin] PATH_INFO: `/v3/users/c45b1a841f754ea1b42ee6ae96db12c7` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:39.870453 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347c63b-3c35-4140-84ea-49e9b7bf09a7 None admin] RBAC: Authorizing `identity:get_user(user_id=c45b1a841f754ea1b42ee6ae96db12c7)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:39.871319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347c63b-3c35-4140-84ea-49e9b7bf09a7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:39.873351 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 98/197] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:39 2022] GET /identity/v3/users/c45b1a841f754ea1b42ee6ae96db12c7 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:39.874181 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347c63b-3c35-4140-84ea-49e9b7bf09a7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:39.881349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7be2a-2290-4d4e-b830-ba4667a3e1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:39.882336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7be2a-2290-4d4e-b830-ba4667a3e1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:39.882336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7be2a-2290-4d4e-b830-ba4667a3e1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:39.882336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7be2a-2290-4d4e-b830-ba4667a3e1f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:39.971310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7be2a-2290-4d4e-b830-ba4667a3e1f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:39.972806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7be2a-2290-4d4e-b830-ba4667a3e1f5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:39.995061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347c63b-3c35-4140-84ea-49e9b7bf09a7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:39.995883 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:40.048584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203668a-0a2a-4d50-a557-896ef8f58ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:40.049277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203668a-0a2a-4d50-a557-896ef8f58ece None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:40.049588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203668a-0a2a-4d50-a557-896ef8f58ece None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:40.049836 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203668a-0a2a-4d50-a557-896ef8f58ece None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:40.050600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203668a-0a2a-4d50-a557-896ef8f58ece None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:40.050939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203668a-0a2a-4d50-a557-896ef8f58ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:40.052830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203668a-0a2a-4d50-a557-896ef8f58ece None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:40.062911 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 99/198] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:40.063532 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203668a-0a2a-4d50-a557-896ef8f58ece None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:40.113778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:40.118539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 100/199] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:40.120744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7be2a-2290-4d4e-b830-ba4667a3e1f5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:40.184361 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203668a-0a2a-4d50-a557-896ef8f58ece None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:40.231627 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e92cb-25c1-4ec1-879d-bd5a816a8a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:40.232812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e92cb-25c1-4ec1-879d-bd5a816a8a2c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:40.233238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e92cb-25c1-4ec1-879d-bd5a816a8a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:40.233877 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e92cb-25c1-4ec1-879d-bd5a816a8a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:40.243988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7be2a-2290-4d4e-b830-ba4667a3e1f5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:40.266504 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:40.290257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb072d-a25c-42fe-8f80-8dd89e9e54e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:40.292617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb072d-a25c-42fe-8f80-8dd89e9e54e8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:40.293042 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb072d-a25c-42fe-8f80-8dd89e9e54e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:40.293620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb072d-a25c-42fe-8f80-8dd89e9e54e8 None admin] PATH_INFO: `/v3/users/7d94ce41a8294ba1a559395432ca15bc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:40.295662 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb072d-a25c-42fe-8f80-8dd89e9e54e8 None admin] RBAC: Authorizing `identity:get_user(user_id=7d94ce41a8294ba1a559395432ca15bc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:40.297561 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb072d-a25c-42fe-8f80-8dd89e9e54e8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:40.299722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 101/200] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:40 2022] GET /identity/v3/users/7d94ce41a8294ba1a559395432ca15bc => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:40.300682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb072d-a25c-42fe-8f80-8dd89e9e54e8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:40.329745 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e92cb-25c1-4ec1-879d-bd5a816a8a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:40.331943 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e92cb-25c1-4ec1-879d-bd5a816a8a2c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:40.394155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:40.432802 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb072d-a25c-42fe-8f80-8dd89e9e54e8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:40.471888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 100/201] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:40.472794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaedd27-d049-48b6-90fa-4fb687a74263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:40.473366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e92cb-25c1-4ec1-879d-bd5a816a8a2c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:40.473882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaedd27-d049-48b6-90fa-4fb687a74263 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:40.474233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaedd27-d049-48b6-90fa-4fb687a74263 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:40.474623 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaedd27-d049-48b6-90fa-4fb687a74263 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:40.476031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaedd27-d049-48b6-90fa-4fb687a74263 None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:40.478217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaedd27-d049-48b6-90fa-4fb687a74263 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:40.479898 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 102/202] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:40 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:40.486005 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaedd27-d049-48b6-90fa-4fb687a74263 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:40.554153 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:40.593720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e92cb-25c1-4ec1-879d-bd5a816a8a2c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:40.617624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaedd27-d049-48b6-90fa-4fb687a74263 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:40.632999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f0c2d-7161-41ed-afae-83c7fc56ca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:40.633698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f0c2d-7161-41ed-afae-83c7fc56ca86 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:40.634128 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f0c2d-7161-41ed-afae-83c7fc56ca86 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:40.634548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f0c2d-7161-41ed-afae-83c7fc56ca86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:40.650946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:40.663790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75a6a3-b780-4cde-b4af-74e70586c185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:40.664810 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a6a3-b780-4cde-b4af-74e70586c185 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:40.665100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a6a3-b780-4cde-b4af-74e70586c185 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:40.665375 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a6a3-b780-4cde-b4af-74e70586c185 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:40.667452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75a6a3-b780-4cde-b4af-74e70586c185 None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:40.669353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75a6a3-b780-4cde-b4af-74e70586c185 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:40.671916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 103/203] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:40 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:40.672740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75a6a3-b780-4cde-b4af-74e70586c185 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:40.717437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f0c2d-7161-41ed-afae-83c7fc56ca86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:40.719176 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f0c2d-7161-41ed-afae-83c7fc56ca86 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:40.785466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75a6a3-b780-4cde-b4af-74e70586c185 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:40.806539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:40.821590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd916e1e-30f4-4796-9c54-07ba841ea5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:40.822818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd916e1e-30f4-4796-9c54-07ba841ea5ba None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:40.823097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd916e1e-30f4-4796-9c54-07ba841ea5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:40.823549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd916e1e-30f4-4796-9c54-07ba841ea5ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:40.824487 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd916e1e-30f4-4796-9c54-07ba841ea5ba None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=3b6f3b860bdb40de962e435fd234c802, user.id=c45b1a841f754ea1b42ee6ae96db12c7) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:40.824791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd916e1e-30f4-4796-9c54-07ba841ea5ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:40.826236 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd916e1e-30f4-4796-9c54-07ba841ea5ba None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:40.831473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 101/204] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:40.832271 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 104/205] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:40 2022] GET /identity/v3/role_assignments?user.id=c45b1a841f754ea1b42ee6ae96db12c7&scope.project.id=3b6f3b860bdb40de962e435fd234c802&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:40.836951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f0c2d-7161-41ed-afae-83c7fc56ca86 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:40.839145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd916e1e-30f4-4796-9c54-07ba841ea5ba None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:40.894092 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:40.961369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f0c2d-7161-41ed-afae-83c7fc56ca86 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:41.005829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4323ce0-028c-41a2-bd52-73206fd340b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:41.006851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323ce0-028c-41a2-bd52-73206fd340b6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:41.007363 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323ce0-028c-41a2-bd52-73206fd340b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:41.008228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323ce0-028c-41a2-bd52-73206fd340b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:41.009242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4323ce0-028c-41a2-bd52-73206fd340b6 None admin] RBAC: Adding query filter params (role.id=d73c76bc61c44f3a94e66397b0d9c359, scope.project.id=3b6f3b860bdb40de962e435fd234c802, user.id=c45b1a841f754ea1b42ee6ae96db12c7) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:41.010303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4323ce0-028c-41a2-bd52-73206fd340b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:41.012442 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4323ce0-028c-41a2-bd52-73206fd340b6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:41.019141 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 102/206] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:40 2022] GET /identity/v3/role_assignments?user.id=c45b1a841f754ea1b42ee6ae96db12c7&scope.project.id=3b6f3b860bdb40de962e435fd234c802&role.id=d73c76bc61c44f3a94e66397b0d9c359 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:41.074897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd916e1e-30f4-4796-9c54-07ba841ea5ba None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:41.114708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a22de7-bad1-41a5-9d62-f130432cbf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:41.115848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a22de7-bad1-41a5-9d62-f130432cbf7b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:41.116270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a22de7-bad1-41a5-9d62-f130432cbf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:41.116683 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a22de7-bad1-41a5-9d62-f130432cbf7b None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:41.118054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a22de7-bad1-41a5-9d62-f130432cbf7b None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:41.120290 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a22de7-bad1-41a5-9d62-f130432cbf7b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:41.122244 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 105/207] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:40 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:41.128602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4323ce0-028c-41a2-bd52-73206fd340b6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:41.248824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4323ce0-028c-41a2-bd52-73206fd340b6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:41.261068 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:41.298416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db84d9-d778-499b-a6c7-6c7a2872b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:41.299204 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db84d9-d778-499b-a6c7-6c7a2872b075 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:41.299485 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db84d9-d778-499b-a6c7-6c7a2872b075 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:41.299757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db84d9-d778-499b-a6c7-6c7a2872b075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:41.300611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db84d9-d778-499b-a6c7-6c7a2872b075 None admin] RBAC: Adding query filter params (role.id=8b71d050850f4e75a4ae097553e111d0, scope.project.id=dc870179720c49a5916bb6299e1ba91d, user.id=7d94ce41a8294ba1a559395432ca15bc) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:41.300917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db84d9-d778-499b-a6c7-6c7a2872b075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:41.302372 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db84d9-d778-499b-a6c7-6c7a2872b075 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:41.309776 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 103/208] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:41 2022] GET /identity/v3/role_assignments?user.id=7d94ce41a8294ba1a559395432ca15bc&scope.project.id=dc870179720c49a5916bb6299e1ba91d&role.id=8b71d050850f4e75a4ae097553e111d0 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:42.002091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e180bef-a972-49c3-a8c4-b0c35e2231ff None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:42.002615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e180bef-a972-49c3-a8c4-b0c35e2231ff None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:42.003061 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e180bef-a972-49c3-a8c4-b0c35e2231ff None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:42.004622 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 106/209] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:42.012170 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d2fbc-1e62-4e0c-9e44-a93b0f008eb8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:42.013078 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d2fbc-1e62-4e0c-9e44-a93b0f008eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:42.013551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d2fbc-1e62-4e0c-9e44-a93b0f008eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:42.031382 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3b6d2fbc-1e62-4e0c-9e44-a93b0f008eb8 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:42.033084 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3b6d2fbc-1e62-4e0c-9e44-a93b0f008eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:42.108383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 104/210] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:42.133552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e180bef-a972-49c3-a8c4-b0c35e2231ff None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:42.151652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aded7-c89e-418e-a618-7e82b96701bf None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:42.151967 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aded7-c89e-418e-a618-7e82b96701bf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:42.152208 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aded7-c89e-418e-a618-7e82b96701bf None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:42.153845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 105/211] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:14:42.159981 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5b70a-978d-4d27-9ff5-c0e8f5eb4787 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:42.160330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5b70a-978d-4d27-9ff5-c0e8f5eb4787 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:42.160539 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5b70a-978d-4d27-9ff5-c0e8f5eb4787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:42.183366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a2d5b70a-978d-4d27-9ff5-c0e8f5eb4787 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:42.184590 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a2d5b70a-978d-4d27-9ff5-c0e8f5eb4787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:42.205709 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:42.270398 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 106/212] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:42.276672 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e180bef-a972-49c3-a8c4-b0c35e2231ff None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:42.299313 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5b70a-978d-4d27-9ff5-c0e8f5eb4787 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:42.333166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d032aae-b443-48a7-93b1-685c5191e892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:42.334804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d032aae-b443-48a7-93b1-685c5191e892 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:42.335295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d032aae-b443-48a7-93b1-685c5191e892 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:42.335915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d032aae-b443-48a7-93b1-685c5191e892 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:42.340049 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:42.351871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d032aae-b443-48a7-93b1-685c5191e892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-9d032aae-b443-48a7-93b1-685c5191e892 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:42.362983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:42.363946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:42.364738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:42.364738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:42.364738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:42.364738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:42.364738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:42.364738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:42.364738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:42.364738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:42.364738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:42.364738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:42.364738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:42.364738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:42.368020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 107/213] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:42.377735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d032aae-b443-48a7-93b1-685c5191e892 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:42.434614 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5b70a-978d-4d27-9ff5-c0e8f5eb4787 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:42.479659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c230-ff9d-4723-8cbb-00561339c3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:42.480473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c230-ff9d-4723-8cbb-00561339c3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:42.480899 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c230-ff9d-4723-8cbb-00561339c3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:42.481174 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c230-ff9d-4723-8cbb-00561339c3c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:42.482775 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6c230-ff9d-4723-8cbb-00561339c3c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:42.484521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6c230-ff9d-4723-8cbb-00561339c3c4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:42.486732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 107/214] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:42.492172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c230-ff9d-4723-8cbb-00561339c3c4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:42.506917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d032aae-b443-48a7-93b1-685c5191e892 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:42.527585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:42.556512 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fae10-b45b-4ec0-b67f-d738caebaf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:42.558178 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fae10-b45b-4ec0-b67f-d738caebaf67 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:42.558614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fae10-b45b-4ec0-b67f-d738caebaf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:42.559330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fae10-b45b-4ec0-b67f-d738caebaf67 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:42.560496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fae10-b45b-4ec0-b67f-d738caebaf67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:42.561087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fae10-b45b-4ec0-b67f-d738caebaf67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:42.563364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fae10-b45b-4ec0-b67f-d738caebaf67 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:42.576397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 108/215] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:42.582034 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fae10-b45b-4ec0-b67f-d738caebaf67 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:42.605905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:42.609967 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c230-ff9d-4723-8cbb-00561339c3c4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:42.648223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b5d0a-23eb-4fbc-9d5b-b14df8e4ff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:42.649354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b5d0a-23eb-4fbc-9d5b-b14df8e4ff6c None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:42.649930 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b5d0a-23eb-4fbc-9d5b-b14df8e4ff6c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:42.651095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b5d0a-23eb-4fbc-9d5b-b14df8e4ff6c None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:42.652114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b5d0a-23eb-4fbc-9d5b-b14df8e4ff6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:42.653881 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b5d0a-23eb-4fbc-9d5b-b14df8e4ff6c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:42.709415 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fae10-b45b-4ec0-b67f-d738caebaf67 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:42.745691 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b5c29-f4b8-4c2c-ad75-ebcf202f55c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:42.746731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b5c29-f4b8-4c2c-ad75-ebcf202f55c2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:42.747108 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b5c29-f4b8-4c2c-ad75-ebcf202f55c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:42.747477 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b5c29-f4b8-4c2c-ad75-ebcf202f55c2 None admin] PATH_INFO: `/v3/users/f7b51dc574ac403bb592fb969ee29225` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:42.765007 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b5c29-f4b8-4c2c-ad75-ebcf202f55c2 None admin] RBAC: Authorizing `identity:get_user(user_id=f7b51dc574ac403bb592fb969ee29225)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:42.765700 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 108/216] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:14:42 2022] POST /identity/v3/users => generated 297 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:14:42.767275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b5c29-f4b8-4c2c-ad75-ebcf202f55c2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:42.773953 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 109/217] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:42 2022] GET /identity/v3/users/f7b51dc574ac403bb592fb969ee29225 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:42.776078 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b5d0a-23eb-4fbc-9d5b-b14df8e4ff6c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:42.908731 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b5d0a-23eb-4fbc-9d5b-b14df8e4ff6c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:42.946741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100e63d-634a-46e4-a575-f94538ae12a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:42.948551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100e63d-634a-46e4-a575-f94538ae12a3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:42.948980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100e63d-634a-46e4-a575-f94538ae12a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:42.949398 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100e63d-634a-46e4-a575-f94538ae12a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:42.979777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:43.027201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100e63d-634a-46e4-a575-f94538ae12a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:43.028683 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100e63d-634a-46e4-a575-f94538ae12a3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:43.138809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 109/218] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:43.144157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b5c29-f4b8-4c2c-ad75-ebcf202f55c2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:43.150994 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e5c84-5668-4393-8602-1e5b78c89cf9 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:43.151592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e5c84-5668-4393-8602-1e5b78c89cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:43.152168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e5c84-5668-4393-8602-1e5b78c89cf9 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:43.153772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 110/219] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:14:43.159572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2081e-6905-4078-9df2-f10ff69dadbb None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:43.160127 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2081e-6905-4078-9df2-f10ff69dadbb None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:43.160598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2081e-6905-4078-9df2-f10ff69dadbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:43.178828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-dcb2081e-6905-4078-9df2-f10ff69dadbb None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:43.180487 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dcb2081e-6905-4078-9df2-f10ff69dadbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:43.185562 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:43.241098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:43.261831 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 111/220] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:43.282471 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b5c29-f4b8-4c2c-ad75-ebcf202f55c2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:43.296120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2081e-6905-4078-9df2-f10ff69dadbb None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:43.320191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f8db4-bc15-46dd-b240-29da1851c47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:43.321499 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f8db4-bc15-46dd-b240-29da1851c47f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:43.322471 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f8db4-bc15-46dd-b240-29da1851c47f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:43.322854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f8db4-bc15-46dd-b240-29da1851c47f None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:43.324449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f8db4-bc15-46dd-b240-29da1851c47f None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:43.326111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f8db4-bc15-46dd-b240-29da1851c47f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:43.328371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 110/221] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:43 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:43.335465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f8db4-bc15-46dd-b240-29da1851c47f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:43.497385 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2081e-6905-4078-9df2-f10ff69dadbb None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:43.515118 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:43.519165 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f8db4-bc15-46dd-b240-29da1851c47f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:43.538404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e43d69-e3ab-4305-94a5-efbffae7da54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:43.539481 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e43d69-e3ab-4305-94a5-efbffae7da54 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:43.540321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e43d69-e3ab-4305-94a5-efbffae7da54 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:43.541410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e43d69-e3ab-4305-94a5-efbffae7da54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:43.553579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e43d69-e3ab-4305-94a5-efbffae7da54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:43.562542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204891d-1847-45d1-8a4a-7640c2573762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-68e43d69-e3ab-4305-94a5-efbffae7da54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:43.563203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:43.572500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:43.573329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:43.573329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:43.573329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:43.573329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:43.573329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:43.573329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:43.573329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:43.573329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:43.573329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:43.573329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:43.573329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:43.573329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:43.573937 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204891d-1847-45d1-8a4a-7640c2573762 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:43.573937 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204891d-1847-45d1-8a4a-7640c2573762 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:43.573937 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204891d-1847-45d1-8a4a-7640c2573762 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:43.573937 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204891d-1847-45d1-8a4a-7640c2573762 None admin] RBAC: Adding query filter params (role.id=9b386d2d84ef4d3b9f9401c95f06c53b, scope.project.id=3b6f3b860bdb40de962e435fd234c802, user.id=f7b51dc574ac403bb592fb969ee29225) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:43.574749 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 112/222] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:14:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:43.574891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204891d-1847-45d1-8a4a-7640c2573762 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:43.574891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204891d-1847-45d1-8a4a-7640c2573762 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:43.575033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810d2e1-d451-4d20-b360-ceb28cdb8041 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:43.575033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810d2e1-d451-4d20-b360-ceb28cdb8041 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:43.575033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810d2e1-d451-4d20-b360-ceb28cdb8041 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:43.575033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 113/223] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:43.575033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810d2e1-d451-4d20-b360-ceb28cdb8041 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:43.575403 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 111/224] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:43 2022] GET /identity/v3/role_assignments?user.id=f7b51dc574ac403bb592fb969ee29225&scope.project.id=3b6f3b860bdb40de962e435fd234c802&role.id=9b386d2d84ef4d3b9f9401c95f06c53b => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:43.584291 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a8d79-fa9c-48b6-946f-b0b21b13f6b8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:43.584594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a8d79-fa9c-48b6-946f-b0b21b13f6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:43.584847 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a8d79-fa9c-48b6-946f-b0b21b13f6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:43.630260 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ec6a8d79-fa9c-48b6-946f-b0b21b13f6b8 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:43.630776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ec6a8d79-fa9c-48b6-946f-b0b21b13f6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:43.703641 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:43.718705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 112/225] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:43.752172 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a8d79-fa9c-48b6-946f-b0b21b13f6b8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:43.836345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810d2e1-d451-4d20-b360-ceb28cdb8041 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:43.879941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd62292-a7fd-4880-83d7-d9da78c2ec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:43.880987 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62292-a7fd-4880-83d7-d9da78c2ec60 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:43.881756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62292-a7fd-4880-83d7-d9da78c2ec60 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:43.882042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62292-a7fd-4880-83d7-d9da78c2ec60 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:43.882841 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd62292-a7fd-4880-83d7-d9da78c2ec60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:43.883152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd62292-a7fd-4880-83d7-d9da78c2ec60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:43.884911 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a8d79-fa9c-48b6-946f-b0b21b13f6b8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:43.885273 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd62292-a7fd-4880-83d7-d9da78c2ec60 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:43.898726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 114/226] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:43.898931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:43.903689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd62292-a7fd-4880-83d7-d9da78c2ec60 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:43.955714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f980297-5e8c-466c-9c9b-2684d6752605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:43.956582 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f980297-5e8c-466c-9c9b-2684d6752605 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:43.956861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f980297-5e8c-466c-9c9b-2684d6752605 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:43.957129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f980297-5e8c-466c-9c9b-2684d6752605 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:43.979211 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f980297-5e8c-466c-9c9b-2684d6752605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3f980297-5e8c-466c-9c9b-2684d6752605 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:43.996093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:43.997028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:43.997820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:43.997820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:43.997820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:43.997820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:43.997820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:43.997820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:43.997820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:43.997820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:43.997820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:43.997820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:43.997820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:14:43.997820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:43.998416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 113/227] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:14:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:44.011725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f980297-5e8c-466c-9c9b-2684d6752605 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:44.099238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd62292-a7fd-4880-83d7-d9da78c2ec60 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:44.118295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:44.174263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e6e72-8241-4653-8d92-c60caa8fea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:44.176066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6e72-8241-4653-8d92-c60caa8fea26 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:44.176341 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6e72-8241-4653-8d92-c60caa8fea26 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:44.176610 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6e72-8241-4653-8d92-c60caa8fea26 None admin] PATH_INFO: `/v3/users/c45b1a841f754ea1b42ee6ae96db12c7` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:44.178639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e6e72-8241-4653-8d92-c60caa8fea26 None admin] RBAC: Authorizing `identity:get_user(user_id=c45b1a841f754ea1b42ee6ae96db12c7)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:44.180117 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e6e72-8241-4653-8d92-c60caa8fea26 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:44.183303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 115/228] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:43 2022] GET /identity/v3/users/c45b1a841f754ea1b42ee6ae96db12c7 => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:44.189670 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e6e72-8241-4653-8d92-c60caa8fea26 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:44.220900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f980297-5e8c-466c-9c9b-2684d6752605 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:44.294704 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa00160-a33a-4d0f-bb9c-6cd4a3cc42bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:44.294704 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa00160-a33a-4d0f-bb9c-6cd4a3cc42bc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:44.294704 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa00160-a33a-4d0f-bb9c-6cd4a3cc42bc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:44.294704 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa00160-a33a-4d0f-bb9c-6cd4a3cc42bc None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:44.295075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa00160-a33a-4d0f-bb9c-6cd4a3cc42bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:44.295075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa00160-a33a-4d0f-bb9c-6cd4a3cc42bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:44.295075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa00160-a33a-4d0f-bb9c-6cd4a3cc42bc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:44.308864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 114/229] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:44.311795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa00160-a33a-4d0f-bb9c-6cd4a3cc42bc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:44.344076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:44.369277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e6e72-8241-4653-8d92-c60caa8fea26 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:44.439366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc93a90-4ef6-4e2d-aea3-2dcba2fb0500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:44.440239 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc93a90-4ef6-4e2d-aea3-2dcba2fb0500 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:44.440517 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc93a90-4ef6-4e2d-aea3-2dcba2fb0500 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:44.440785 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc93a90-4ef6-4e2d-aea3-2dcba2fb0500 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:44.442525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc93a90-4ef6-4e2d-aea3-2dcba2fb0500 None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:44.444003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc93a90-4ef6-4e2d-aea3-2dcba2fb0500 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:44.446031 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 116/230] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:44 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:44.455615 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc93a90-4ef6-4e2d-aea3-2dcba2fb0500 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:44.500525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa00160-a33a-4d0f-bb9c-6cd4a3cc42bc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:44.559154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:44.575613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7919b-985b-4a89-b00e-816146671684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:44.576484 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7919b-985b-4a89-b00e-816146671684 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:44.576765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7919b-985b-4a89-b00e-816146671684 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:44.577040 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7919b-985b-4a89-b00e-816146671684 None admin] PATH_INFO: `/v3/users/c45b1a841f754ea1b42ee6ae96db12c7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:44.580731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7919b-985b-4a89-b00e-816146671684 None admin] RBAC: Authorizing `identity:get_user(user_id=c45b1a841f754ea1b42ee6ae96db12c7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:44.582255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7919b-985b-4a89-b00e-816146671684 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:44.583941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 115/231] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:44 2022] GET /identity/v3/users/c45b1a841f754ea1b42ee6ae96db12c7 => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:44.590960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7919b-985b-4a89-b00e-816146671684 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:44.601233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc93a90-4ef6-4e2d-aea3-2dcba2fb0500 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:44.647374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d4030-d3b8-442c-8b82-a48812f3d581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:44.648566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d4030-d3b8-442c-8b82-a48812f3d581 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:44.649017 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d4030-d3b8-442c-8b82-a48812f3d581 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:44.649482 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d4030-d3b8-442c-8b82-a48812f3d581 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802/users/c45b1a841f754ea1b42ee6ae96db12c7/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:44.655984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d4030-d3b8-442c-8b82-a48812f3d581 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b6f3b860bdb40de962e435fd234c802, user_id=c45b1a841f754ea1b42ee6ae96db12c7, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:44.658653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d4030-d3b8-442c-8b82-a48812f3d581 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:44.703476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:44.721073 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7919b-985b-4a89-b00e-816146671684 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:44.757697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 117/232] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:14:44 2022] PUT /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802/users/c45b1a841f754ea1b42ee6ae96db12c7/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:14:44.760307 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5c3ca-5f10-46ef-9012-15d736d0e516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:44.761202 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5c3ca-5f10-46ef-9012-15d736d0e516 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:44.761485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5c3ca-5f10-46ef-9012-15d736d0e516 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:44.761762 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5c3ca-5f10-46ef-9012-15d736d0e516 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:44.763172 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5c3ca-5f10-46ef-9012-15d736d0e516 None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:44.764698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5c3ca-5f10-46ef-9012-15d736d0e516 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:44.766549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 116/233] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:44 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:44.772644 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d4030-d3b8-442c-8b82-a48812f3d581 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:44.928658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d4030-d3b8-442c-8b82-a48812f3d581 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:44.934969 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:44.975652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fea85f-e7e0-4254-9c56-ee8cce517da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:44.976735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fea85f-e7e0-4254-9c56-ee8cce517da1 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:44.977413 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fea85f-e7e0-4254-9c56-ee8cce517da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:44.977779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fea85f-e7e0-4254-9c56-ee8cce517da1 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802/users/c45b1a841f754ea1b42ee6ae96db12c7/roles/d73c76bc61c44f3a94e66397b0d9c359` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:44.980534 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fea85f-e7e0-4254-9c56-ee8cce517da1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b6f3b860bdb40de962e435fd234c802, user_id=c45b1a841f754ea1b42ee6ae96db12c7, role_id=d73c76bc61c44f3a94e66397b0d9c359)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:44.982096 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fea85f-e7e0-4254-9c56-ee8cce517da1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:45.130597 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 118/234] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:14:44 2022] PUT /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802/users/c45b1a841f754ea1b42ee6ae96db12c7/roles/d73c76bc61c44f3a94e66397b0d9c359 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:14:45.391965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92109fb-e931-4d3c-b198-351b97440051 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:45.392515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92109fb-e931-4d3c-b198-351b97440051 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:45.392515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92109fb-e931-4d3c-b198-351b97440051 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:45.394335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 117/235] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:45.399856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d100f3-5144-455f-99af-a86db08b64c6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:45.400143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d100f3-5144-455f-99af-a86db08b64c6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:45.400425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d100f3-5144-455f-99af-a86db08b64c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:45.423785 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-25d100f3-5144-455f-99af-a86db08b64c6 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:45.425030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-25d100f3-5144-455f-99af-a86db08b64c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:45.430899 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30df5b0-395c-4230-be57-a71016713ace None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:45.431691 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30df5b0-395c-4230-be57-a71016713ace None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:45.431977 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30df5b0-395c-4230-be57-a71016713ace None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:45.433735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 118/236] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:45.438820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4ca8f-67ac-499f-87d5-6ffb58ad9e02 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:45.439107 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4ca8f-67ac-499f-87d5-6ffb58ad9e02 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:45.439385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4ca8f-67ac-499f-87d5-6ffb58ad9e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:45.463727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7ed4ca8f-67ac-499f-87d5-6ffb58ad9e02 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:45.464927 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7ed4ca8f-67ac-499f-87d5-6ffb58ad9e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:45.552984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 119/237] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:45.574991 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 119/238] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:45.584947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d100f3-5144-455f-99af-a86db08b64c6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:45.603128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4ca8f-67ac-499f-87d5-6ffb58ad9e02 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:45.702413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:45.723282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4ca8f-67ac-499f-87d5-6ffb58ad9e02 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:45.764641 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29336464-a55c-424e-8ba6-86c26852f61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:45.765953 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29336464-a55c-424e-8ba6-86c26852f61e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:45.766435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29336464-a55c-424e-8ba6-86c26852f61e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:45.766986 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29336464-a55c-424e-8ba6-86c26852f61e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:45.768427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29336464-a55c-424e-8ba6-86c26852f61e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:45.770103 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29336464-a55c-424e-8ba6-86c26852f61e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:45.773261 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 120/239] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:45.780373 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29336464-a55c-424e-8ba6-86c26852f61e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:45.800317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d100f3-5144-455f-99af-a86db08b64c6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:45.811098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:45.840023 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56f2ca-7e1d-452c-86f9-8c86c1d290b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:45.841033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56f2ca-7e1d-452c-86f9-8c86c1d290b3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:45.841780 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56f2ca-7e1d-452c-86f9-8c86c1d290b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:45.841780 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56f2ca-7e1d-452c-86f9-8c86c1d290b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:45.854549 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56f2ca-7e1d-452c-86f9-8c86c1d290b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-ab56f2ca-7e1d-452c-86f9-8c86c1d290b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:45.863524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:45.864457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:45.865230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:45.865230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:45.865230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:45.865230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:45.865230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:45.865230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:45.865230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:45.865230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:45.865230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:45.865230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:45.865230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:45.865230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:45.865230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 120/240] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:45.871398 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56f2ca-7e1d-452c-86f9-8c86c1d290b3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:45.988269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56f2ca-7e1d-452c-86f9-8c86c1d290b3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:46.029231 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c5326-0e3d-4e34-b27d-3968b58bd396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:46.029921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c5326-0e3d-4e34-b27d-3968b58bd396 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:46.030207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c5326-0e3d-4e34-b27d-3968b58bd396 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:46.030488 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c5326-0e3d-4e34-b27d-3968b58bd396 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:46.031360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c5326-0e3d-4e34-b27d-3968b58bd396 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:46.031676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c5326-0e3d-4e34-b27d-3968b58bd396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:46.033368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c5326-0e3d-4e34-b27d-3968b58bd396 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:46.045064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 121/241] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:46.050560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c5326-0e3d-4e34-b27d-3968b58bd396 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:46.071223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:46.081944 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29336464-a55c-424e-8ba6-86c26852f61e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:46.164173 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4340e-55b1-41e8-8ac8-e2f40e24dc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:46.164854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4340e-55b1-41e8-8ac8-e2f40e24dc45 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:46.165682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4340e-55b1-41e8-8ac8-e2f40e24dc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:46.165958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4340e-55b1-41e8-8ac8-e2f40e24dc45 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:46.166696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4340e-55b1-41e8-8ac8-e2f40e24dc45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:46.168176 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4340e-55b1-41e8-8ac8-e2f40e24dc45 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:46.208303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c5326-0e3d-4e34-b27d-3968b58bd396 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:46.243807 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f7651-97c0-42f7-8781-9a55397556f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:46.244752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7651-97c0-42f7-8781-9a55397556f7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:46.245035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7651-97c0-42f7-8781-9a55397556f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:46.245309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7651-97c0-42f7-8781-9a55397556f7 None admin] PATH_INFO: `/v3/users/677f763bb25a4388aaf6efcc7e7a6be2` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:46.260013 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f7651-97c0-42f7-8781-9a55397556f7 None admin] RBAC: Authorizing `identity:get_user(user_id=677f763bb25a4388aaf6efcc7e7a6be2)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:46.261506 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f7651-97c0-42f7-8781-9a55397556f7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:46.263257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 122/242] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:46 2022] GET /identity/v3/users/677f763bb25a4388aaf6efcc7e7a6be2 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:46.264493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca6edd-6dc2-4681-b229-e81cc41861fe None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:46.264776 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca6edd-6dc2-4681-b229-e81cc41861fe None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:46.265047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca6edd-6dc2-4681-b229-e81cc41861fe None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:46.266304 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 123/243] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:46.270043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca6edd-6dc2-4681-b229-e81cc41861fe None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:46.278715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 121/244] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:14:45 2022] POST /identity/v3/users => generated 293 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:14:46.285254 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9459c-c4b1-444e-ad60-adba9bf1cf70 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:46.285564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9459c-c4b1-444e-ad60-adba9bf1cf70 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:46.285806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9459c-c4b1-444e-ad60-adba9bf1cf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:46.315185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:46.329478 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-acd9459c-c4b1-444e-ad60-adba9bf1cf70 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:46.330635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-acd9459c-c4b1-444e-ad60-adba9bf1cf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:46.448497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:46.482808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 122/245] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:46.499955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca6edd-6dc2-4681-b229-e81cc41861fe None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:46.520107 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9459c-c4b1-444e-ad60-adba9bf1cf70 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:46.548785 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb27807-89f5-4642-9320-71d6f8f30df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:46.549854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb27807-89f5-4642-9320-71d6f8f30df4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:46.550305 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb27807-89f5-4642-9320-71d6f8f30df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:46.550752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb27807-89f5-4642-9320-71d6f8f30df4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:46.634243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9459c-c4b1-444e-ad60-adba9bf1cf70 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:46.639436 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb27807-89f5-4642-9320-71d6f8f30df4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:46.641136 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb27807-89f5-4642-9320-71d6f8f30df4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:46.673288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67c9ca-ae2d-470e-be5c-23ad5d83347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:46.674054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67c9ca-ae2d-470e-be5c-23ad5d83347b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:46.674337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67c9ca-ae2d-470e-be5c-23ad5d83347b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:46.674608 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67c9ca-ae2d-470e-be5c-23ad5d83347b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:46.677555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:46.686030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67c9ca-ae2d-470e-be5c-23ad5d83347b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7c67c9ca-ae2d-470e-be5c-23ad5d83347b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:46.694227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:46.695320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:46.696516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:46.696516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:46.696516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:46.696516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:46.696516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:46.696516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:46.696516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:46.696516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:46.696516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:46.696516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:46.696516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:46.696516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:46.696516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 123/246] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:46.704150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67c9ca-ae2d-470e-be5c-23ad5d83347b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:46.744483 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:46.775399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 124/247] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:46.781589 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb27807-89f5-4642-9320-71d6f8f30df4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:46.841193 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67c9ca-ae2d-470e-be5c-23ad5d83347b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:46.892177 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6701d4f-42aa-4bb3-baed-b5931155cd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:46.893152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6701d4f-42aa-4bb3-baed-b5931155cd7c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:46.893630 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6701d4f-42aa-4bb3-baed-b5931155cd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:46.894077 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6701d4f-42aa-4bb3-baed-b5931155cd7c None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:46.895223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6701d4f-42aa-4bb3-baed-b5931155cd7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:46.895742 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6701d4f-42aa-4bb3-baed-b5931155cd7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:46.897472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6701d4f-42aa-4bb3-baed-b5931155cd7c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:46.909438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 124/248] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:46.913817 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb27807-89f5-4642-9320-71d6f8f30df4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:46.916500 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6701d4f-42aa-4bb3-baed-b5931155cd7c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:46.968818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09b75d-1a6f-40bd-a1d5-73dbd88ca67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:46.969697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09b75d-1a6f-40bd-a1d5-73dbd88ca67f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:46.969973 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09b75d-1a6f-40bd-a1d5-73dbd88ca67f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:46.970241 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09b75d-1a6f-40bd-a1d5-73dbd88ca67f None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:46.975543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09b75d-1a6f-40bd-a1d5-73dbd88ca67f None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:46.977036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09b75d-1a6f-40bd-a1d5-73dbd88ca67f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:46.979324 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 125/249] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:46 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:46.985112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09b75d-1a6f-40bd-a1d5-73dbd88ca67f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:46.992016 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:47.038198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:47.042477 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6701d4f-42aa-4bb3-baed-b5931155cd7c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:47.091095 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed7068-9625-4a95-b2c0-7a818ebb3194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:47.092666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed7068-9625-4a95-b2c0-7a818ebb3194 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:47.093641 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed7068-9625-4a95-b2c0-7a818ebb3194 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:47.094373 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed7068-9625-4a95-b2c0-7a818ebb3194 None admin] PATH_INFO: `/v3/users/f7b51dc574ac403bb592fb969ee29225` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:47.096497 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed7068-9625-4a95-b2c0-7a818ebb3194 None admin] RBAC: Authorizing `identity:get_user(user_id=f7b51dc574ac403bb592fb969ee29225)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:47.098442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed7068-9625-4a95-b2c0-7a818ebb3194 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:47.101636 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 125/250] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:46 2022] GET /identity/v3/users/f7b51dc574ac403bb592fb969ee29225 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:47.105486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09b75d-1a6f-40bd-a1d5-73dbd88ca67f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:47.108405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed7068-9625-4a95-b2c0-7a818ebb3194 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:47.146388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae210abe-1e07-423b-85a3-25295bd90166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:47.147190 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae210abe-1e07-423b-85a3-25295bd90166 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:47.147527 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae210abe-1e07-423b-85a3-25295bd90166 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:47.147871 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae210abe-1e07-423b-85a3-25295bd90166 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:47.148791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae210abe-1e07-423b-85a3-25295bd90166 None admin] RBAC: Adding query filter params (role.id=8b71d050850f4e75a4ae097553e111d0, scope.project.id=3b6f3b860bdb40de962e435fd234c802, user.id=677f763bb25a4388aaf6efcc7e7a6be2) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:47.149183 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae210abe-1e07-423b-85a3-25295bd90166 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:47.151376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae210abe-1e07-423b-85a3-25295bd90166 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:47.159227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 126/251] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:46 2022] GET /identity/v3/role_assignments?user.id=677f763bb25a4388aaf6efcc7e7a6be2&scope.project.id=3b6f3b860bdb40de962e435fd234c802&role.id=8b71d050850f4e75a4ae097553e111d0 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:47.251029 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed7068-9625-4a95-b2c0-7a818ebb3194 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:47.283666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:47.293667 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3f7b4-b90c-414d-9afc-cc454e50f62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:47.294546 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3f7b4-b90c-414d-9afc-cc454e50f62e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:47.300594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3f7b4-b90c-414d-9afc-cc454e50f62e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:47.300594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3f7b4-b90c-414d-9afc-cc454e50f62e None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:47.300594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3f7b4-b90c-414d-9afc-cc454e50f62e None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:47.300594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3f7b4-b90c-414d-9afc-cc454e50f62e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:47.300594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 126/252] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:47 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:47.306855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae210abe-1e07-423b-85a3-25295bd90166 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:47.453524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae210abe-1e07-423b-85a3-25295bd90166 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:47.462097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:47.474361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c35b-3f48-451b-9ceb-c6eaa136deea None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:47.475003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c35b-3f48-451b-9ceb-c6eaa136deea None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:47.475763 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c35b-3f48-451b-9ceb-c6eaa136deea None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:47.478138 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 127/253] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:47.484786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb2f55-c349-47dd-b8b3-e38e72025705 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:47.485970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb2f55-c349-47dd-b8b3-e38e72025705 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:47.486822 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb2f55-c349-47dd-b8b3-e38e72025705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:47.505990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df5842-a348-4310-8ea2-f5c5d63e778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:47.506917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df5842-a348-4310-8ea2-f5c5d63e778d None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:47.507197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df5842-a348-4310-8ea2-f5c5d63e778d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:47.507466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df5842-a348-4310-8ea2-f5c5d63e778d None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802/users/f7b51dc574ac403bb592fb969ee29225/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:47.509982 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-caeb2f55-c349-47dd-b8b3-e38e72025705 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:47.511457 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-caeb2f55-c349-47dd-b8b3-e38e72025705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:47.512014 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df5842-a348-4310-8ea2-f5c5d63e778d None admin] RBAC: Authorizing `identity:create_grant(project_id=3b6f3b860bdb40de962e435fd234c802, user_id=f7b51dc574ac403bb592fb969ee29225, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:47.513489 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df5842-a348-4310-8ea2-f5c5d63e778d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:47.636207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 127/254] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:14:47 2022] PUT /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802/users/f7b51dc574ac403bb592fb969ee29225/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:14:47.638697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadf851-d1b2-4c5e-adf7-f8ebde3c6f88 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:47.640115 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadf851-d1b2-4c5e-adf7-f8ebde3c6f88 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:47.641511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadf851-d1b2-4c5e-adf7-f8ebde3c6f88 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:47.645372 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 128/255] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:47.651920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635ab96-fedd-4c19-8530-229015336e68 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:47.652201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635ab96-fedd-4c19-8530-229015336e68 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:47.652474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635ab96-fedd-4c19-8530-229015336e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:47.687355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d635ab96-fedd-4c19-8530-229015336e68 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:47.688561 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d635ab96-fedd-4c19-8530-229015336e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:47.692372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 128/256] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:47.724124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb2f55-c349-47dd-b8b3-e38e72025705 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:47.825881 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 129/257] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:47.861890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635ab96-fedd-4c19-8530-229015336e68 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:47.906512 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb2f55-c349-47dd-b8b3-e38e72025705 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:47.944057 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:47.968443 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b0d12-1ba8-45ab-aa3f-74f9d0d6a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:47.970578 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b0d12-1ba8-45ab-aa3f-74f9d0d6a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:47.970578 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b0d12-1ba8-45ab-aa3f-74f9d0d6a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:47.970578 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b0d12-1ba8-45ab-aa3f-74f9d0d6a6d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:47.996514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b0d12-1ba8-45ab-aa3f-74f9d0d6a6d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:48.000147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-277b0d12-1ba8-45ab-aa3f-74f9d0d6a6d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:48.004257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:48.006199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:48.007237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:48.007237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:48.007237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:48.007237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:48.007237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:48.007237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:48.007237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:48.007237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:48.007237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:48.007237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:48.007237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:48.007237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:48.007237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 129/258] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:14:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:48.013182 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635ab96-fedd-4c19-8530-229015336e68 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:48.015746 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b0d12-1ba8-45ab-aa3f-74f9d0d6a6d3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:48.060479 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40244805-ffe9-4f63-b185-fd86916dc68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:48.061590 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40244805-ffe9-4f63-b185-fd86916dc68c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:48.062098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40244805-ffe9-4f63-b185-fd86916dc68c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:48.062617 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40244805-ffe9-4f63-b185-fd86916dc68c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:48.077742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40244805-ffe9-4f63-b185-fd86916dc68c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-40244805-ffe9-4f63-b185-fd86916dc68c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:48.086459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:48.088213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:48.089240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:48.089240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:48.089240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:48.089240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:48.089240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:48.089240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:48.089240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:48.089240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:48.089240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:48.089240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:48.089240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:14:48.089240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:48.091557 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 130/259] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:14:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:48.097600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40244805-ffe9-4f63-b185-fd86916dc68c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:48.216454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b0d12-1ba8-45ab-aa3f-74f9d0d6a6d3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:48.221498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40244805-ffe9-4f63-b185-fd86916dc68c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:48.262906 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80b57e-7818-459a-91c5-c5a9fd80de43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:48.263950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80b57e-7818-459a-91c5-c5a9fd80de43 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:48.264376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80b57e-7818-459a-91c5-c5a9fd80de43 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:48.265040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80b57e-7818-459a-91c5-c5a9fd80de43 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:48.266414 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80b57e-7818-459a-91c5-c5a9fd80de43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:48.266918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80b57e-7818-459a-91c5-c5a9fd80de43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:48.268626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80b57e-7818-459a-91c5-c5a9fd80de43 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:48.281371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 131/260] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:48.295391 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80b57e-7818-459a-91c5-c5a9fd80de43 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:48.310022 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619a6aa-6e2d-4d10-b44a-8392b851d024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:48.310834 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619a6aa-6e2d-4d10-b44a-8392b851d024 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:48.311213 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619a6aa-6e2d-4d10-b44a-8392b851d024 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:48.311625 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619a6aa-6e2d-4d10-b44a-8392b851d024 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:48.312465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619a6aa-6e2d-4d10-b44a-8392b851d024 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:48.313773 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619a6aa-6e2d-4d10-b44a-8392b851d024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:48.318920 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619a6aa-6e2d-4d10-b44a-8392b851d024 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:48.343538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:48.348749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 130/261] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:48.363784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619a6aa-6e2d-4d10-b44a-8392b851d024 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:48.461035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80b57e-7818-459a-91c5-c5a9fd80de43 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:48.480087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:48.504579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdba52-3b06-4cd0-949d-7b2b6773e009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:48.506072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdba52-3b06-4cd0-949d-7b2b6773e009 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:48.506502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdba52-3b06-4cd0-949d-7b2b6773e009 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:48.507101 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdba52-3b06-4cd0-949d-7b2b6773e009 None admin] PATH_INFO: `/v3/users/c45b1a841f754ea1b42ee6ae96db12c7` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:48.508848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdba52-3b06-4cd0-949d-7b2b6773e009 None admin] RBAC: Authorizing `identity:get_user(user_id=c45b1a841f754ea1b42ee6ae96db12c7)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:48.511197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdba52-3b06-4cd0-949d-7b2b6773e009 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:48.513901 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 132/262] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:48 2022] GET /identity/v3/users/c45b1a841f754ea1b42ee6ae96db12c7 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:48.524504 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdba52-3b06-4cd0-949d-7b2b6773e009 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:48.602965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619a6aa-6e2d-4d10-b44a-8392b851d024 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:48.710837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f0373-0279-493a-a6c3-c2c47a352266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:48.710837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f0373-0279-493a-a6c3-c2c47a352266 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:48.710837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f0373-0279-493a-a6c3-c2c47a352266 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:48.710837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f0373-0279-493a-a6c3-c2c47a352266 None admin] PATH_INFO: `/v3/users/c45b1a841f754ea1b42ee6ae96db12c7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:48.711286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:48.711384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f0373-0279-493a-a6c3-c2c47a352266 None admin] RBAC: Authorizing `identity:get_user(user_id=c45b1a841f754ea1b42ee6ae96db12c7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:48.711384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f0373-0279-493a-a6c3-c2c47a352266 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:48.711384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 131/263] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:48 2022] GET /identity/v3/users/c45b1a841f754ea1b42ee6ae96db12c7 => generated 283 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:48.716942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f0373-0279-493a-a6c3-c2c47a352266 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:48.724873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdba52-3b06-4cd0-949d-7b2b6773e009 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:48.783660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31df4fa-f332-4921-8238-ebe60ecf65cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:48.784567 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31df4fa-f332-4921-8238-ebe60ecf65cc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:48.785100 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31df4fa-f332-4921-8238-ebe60ecf65cc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:48.785519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31df4fa-f332-4921-8238-ebe60ecf65cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:48.911525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f0373-0279-493a-a6c3-c2c47a352266 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:48.942337 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31df4fa-f332-4921-8238-ebe60ecf65cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:48.943867 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31df4fa-f332-4921-8238-ebe60ecf65cc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:48.948988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:48.971359 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6623a90-ed2f-4714-8daa-08450ed20065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:48.972181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6623a90-ed2f-4714-8daa-08450ed20065 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:48.972472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6623a90-ed2f-4714-8daa-08450ed20065 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:48.972752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6623a90-ed2f-4714-8daa-08450ed20065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:49.093590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6623a90-ed2f-4714-8daa-08450ed20065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:49.099052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6623a90-ed2f-4714-8daa-08450ed20065 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:49.099438 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:49.110776 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 133/264] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:14:49.117914 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31df4fa-f332-4921-8238-ebe60ecf65cc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:49.286389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31df4fa-f332-4921-8238-ebe60ecf65cc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:49.287595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 132/265] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:49.294100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6623a90-ed2f-4714-8daa-08450ed20065 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:49.331056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:49.364762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f8093-9275-4a97-a3e4-061d302a3296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:49.365562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f8093-9275-4a97-a3e4-061d302a3296 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:49.365820 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f8093-9275-4a97-a3e4-061d302a3296 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:49.366083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f8093-9275-4a97-a3e4-061d302a3296 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:49.375603 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f8093-9275-4a97-a3e4-061d302a3296 None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:49.377136 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f8093-9275-4a97-a3e4-061d302a3296 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:49.379190 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 134/266] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:49 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:49.385367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f8093-9275-4a97-a3e4-061d302a3296 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:49.528316 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:49.536765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6623a90-ed2f-4714-8daa-08450ed20065 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:49.639449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08cd7f-ebf4-4f8e-88d5-a43480d58ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:49.640230 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08cd7f-ebf4-4f8e-88d5-a43480d58ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:49.640505 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08cd7f-ebf4-4f8e-88d5-a43480d58ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:49.640770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08cd7f-ebf4-4f8e-88d5-a43480d58ec1 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:49.642579 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08cd7f-ebf4-4f8e-88d5-a43480d58ec1 None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:49.644084 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08cd7f-ebf4-4f8e-88d5-a43480d58ec1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:49.645978 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 133/267] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:49 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:49.648057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f8093-9275-4a97-a3e4-061d302a3296 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:49.656074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08cd7f-ebf4-4f8e-88d5-a43480d58ec1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:49.751445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2c338-a60e-4b72-8dbd-49a2ffa27786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:49.752137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2c338-a60e-4b72-8dbd-49a2ffa27786 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:49.752397 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2c338-a60e-4b72-8dbd-49a2ffa27786 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:49.752669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2c338-a60e-4b72-8dbd-49a2ffa27786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:49.753524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2c338-a60e-4b72-8dbd-49a2ffa27786 None admin] RBAC: Adding query filter params (role.id=d73c76bc61c44f3a94e66397b0d9c359, scope.project.id=3b6f3b860bdb40de962e435fd234c802, user.id=c45b1a841f754ea1b42ee6ae96db12c7) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:49.753832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2c338-a60e-4b72-8dbd-49a2ffa27786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:49.755309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2c338-a60e-4b72-8dbd-49a2ffa27786 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:49.765353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 135/268] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:49 2022] GET /identity/v3/role_assignments?user.id=c45b1a841f754ea1b42ee6ae96db12c7&scope.project.id=3b6f3b860bdb40de962e435fd234c802&role.id=d73c76bc61c44f3a94e66397b0d9c359 => generated 608 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:49.798653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a51677-948c-40c7-90e6-a40e0f157f2b None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:49.798995 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a51677-948c-40c7-90e6-a40e0f157f2b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:49.799244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a51677-948c-40c7-90e6-a40e0f157f2b None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:49.801014 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 136/269] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:14:49.808286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb8fce-f5bd-44d2-8f2d-ff7cf606edf5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:49.808604 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb8fce-f5bd-44d2-8f2d-ff7cf606edf5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:49.808874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb8fce-f5bd-44d2-8f2d-ff7cf606edf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:49.811646 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:49.830096 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08cd7f-ebf4-4f8e-88d5-a43480d58ec1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:49.855850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4ceb8fce-f5bd-44d2-8f2d-ff7cf606edf5 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:49.857073 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4ceb8fce-f5bd-44d2-8f2d-ff7cf606edf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:49.890113 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700e1fd-1519-48dc-bfde-52f5c5229cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:49.890719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700e1fd-1519-48dc-bfde-52f5c5229cef None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:49.891002 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700e1fd-1519-48dc-bfde-52f5c5229cef None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:49.891275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700e1fd-1519-48dc-bfde-52f5c5229cef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:49.892118 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700e1fd-1519-48dc-bfde-52f5c5229cef None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=3b6f3b860bdb40de962e435fd234c802, user.id=c45b1a841f754ea1b42ee6ae96db12c7) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:49.892426 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700e1fd-1519-48dc-bfde-52f5c5229cef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:49.893886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700e1fd-1519-48dc-bfde-52f5c5229cef None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:49.910153 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 134/270] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:49 2022] GET /identity/v3/role_assignments?user.id=c45b1a841f754ea1b42ee6ae96db12c7&scope.project.id=3b6f3b860bdb40de962e435fd234c802&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:49.989005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 137/271] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:50.032371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700e1fd-1519-48dc-bfde-52f5c5229cef None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:50.196952 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02704bac-d4fa-42dc-8b7f-45f1bb788b22 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:50.197304 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02704bac-d4fa-42dc-8b7f-45f1bb788b22 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:50.197498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02704bac-d4fa-42dc-8b7f-45f1bb788b22 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:50.197717 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700e1fd-1519-48dc-bfde-52f5c5229cef None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:50.199054 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 138/272] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:50.216210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3b4fd-d981-405c-8557-2c05870d2aba None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:50.216549 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3b4fd-d981-405c-8557-2c05870d2aba None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:50.216759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3b4fd-d981-405c-8557-2c05870d2aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:50.245271 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fcdb2-1383-4ed0-b412-d64481e27f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:50.246083 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fcdb2-1383-4ed0-b412-d64481e27f01 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:50.246364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fcdb2-1383-4ed0-b412-d64481e27f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:50.246787 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fcdb2-1383-4ed0-b412-d64481e27f01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:50.258467 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fcdb2-1383-4ed0-b412-d64481e27f01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:50.262510 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-96d3b4fd-d981-405c-8557-2c05870d2aba None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:50.263766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-96d3b4fd-d981-405c-8557-2c05870d2aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4c0fcdb2-1383-4ed0-b412-d64481e27f01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:50.267009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:50.267925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:50.268757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:50.268757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:50.268757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:50.268757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:50.268757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:50.268757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:50.268757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:50.268757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:50.268757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:50.268757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:50.268757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:50.268757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:50.268757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 135/273] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:50.275029 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fcdb2-1383-4ed0-b412-d64481e27f01 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:50.303082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:50.348964 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:50.381962 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 139/274] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:50.389503 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fcdb2-1383-4ed0-b412-d64481e27f01 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:50.412708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3b4fd-d981-405c-8557-2c05870d2aba None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:50.433091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e949251-2f13-424f-b1d8-9e7b5fb94a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:50.433787 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e949251-2f13-424f-b1d8-9e7b5fb94a43 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:50.434063 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e949251-2f13-424f-b1d8-9e7b5fb94a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:50.434334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e949251-2f13-424f-b1d8-9e7b5fb94a43 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:50.435277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e949251-2f13-424f-b1d8-9e7b5fb94a43 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:50.435588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e949251-2f13-424f-b1d8-9e7b5fb94a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:50.437207 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e949251-2f13-424f-b1d8-9e7b5fb94a43 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:50.452596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 136/275] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:50.454285 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c752794-df67-4ddf-98b1-d125b32017bb None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:50.454572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c752794-df67-4ddf-98b1-d125b32017bb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:50.454885 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c752794-df67-4ddf-98b1-d125b32017bb None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:50.458087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 137/276] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:50.459436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c752794-df67-4ddf-98b1-d125b32017bb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:50.541765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:50.550129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3b4fd-d981-405c-8557-2c05870d2aba None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:50.579100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c752794-df67-4ddf-98b1-d125b32017bb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:50.589441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b3f53-f389-4769-b02a-5e4d850dd935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:50.590298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b3f53-f389-4769-b02a-5e4d850dd935 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:50.590580 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b3f53-f389-4769-b02a-5e4d850dd935 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:50.590940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b3f53-f389-4769-b02a-5e4d850dd935 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:50.592367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b3f53-f389-4769-b02a-5e4d850dd935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:50.594378 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b3f53-f389-4769-b02a-5e4d850dd935 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:50.600753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 140/277] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:50.600753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dfe46-4110-4386-bb57-fc654b35cfcb None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:50.600753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dfe46-4110-4386-bb57-fc654b35cfcb None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:50.600753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dfe46-4110-4386-bb57-fc654b35cfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:50.614629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188cb69-e891-49c8-bc5d-5b7b3c06e1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:50.615534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188cb69-e891-49c8-bc5d-5b7b3c06e1ba None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:50.615811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188cb69-e891-49c8-bc5d-5b7b3c06e1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:50.616081 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188cb69-e891-49c8-bc5d-5b7b3c06e1ba None admin] PATH_INFO: `/v3/users/8aeecf7bdc8f4e0c88e73c469d203e5c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:50.619692 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-380dfe46-4110-4386-bb57-fc654b35cfcb None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:50.620895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-380dfe46-4110-4386-bb57-fc654b35cfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:50.630917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188cb69-e891-49c8-bc5d-5b7b3c06e1ba None admin] RBAC: Authorizing `identity:get_user(user_id=8aeecf7bdc8f4e0c88e73c469d203e5c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:50.632918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188cb69-e891-49c8-bc5d-5b7b3c06e1ba None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:50.639897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 138/278] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:50 2022] GET /identity/v3/users/8aeecf7bdc8f4e0c88e73c469d203e5c => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:50.639897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188cb69-e891-49c8-bc5d-5b7b3c06e1ba None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:50.673064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:50.698771 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 141/279] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:50.704048 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dfe46-4110-4386-bb57-fc654b35cfcb None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:50.745448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188cb69-e891-49c8-bc5d-5b7b3c06e1ba None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:50.772718 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:50.782500 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd5bdb-c55b-4601-811f-f04ee3e7c278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:50.783192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd5bdb-c55b-4601-811f-f04ee3e7c278 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:50.783470 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd5bdb-c55b-4601-811f-f04ee3e7c278 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:50.783739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd5bdb-c55b-4601-811f-f04ee3e7c278 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:50.791012 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd5bdb-c55b-4601-811f-f04ee3e7c278 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:50.791012 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd5bdb-c55b-4601-811f-f04ee3e7c278 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:50.811736 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dfe46-4110-4386-bb57-fc654b35cfcb None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:50.845657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67564c4-e071-4dcb-8a1b-a159e5cab3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:50.846312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67564c4-e071-4dcb-8a1b-a159e5cab3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:50.846593 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67564c4-e071-4dcb-8a1b-a159e5cab3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:50.846896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67564c4-e071-4dcb-8a1b-a159e5cab3b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:50.847733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67564c4-e071-4dcb-8a1b-a159e5cab3b7 None admin] RBAC: Adding query filter params (role.id=9b386d2d84ef4d3b9f9401c95f06c53b, user.id=8aeecf7bdc8f4e0c88e73c469d203e5c, scope.system=all) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:50.848043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67564c4-e071-4dcb-8a1b-a159e5cab3b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:50.849512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67564c4-e071-4dcb-8a1b-a159e5cab3b7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:50.854582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 142/280] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jul 20 19:14:50 2022] GET /identity/v3/role_assignments?user.id=8aeecf7bdc8f4e0c88e73c469d203e5c&scope.system=all&role.id=9b386d2d84ef4d3b9f9401c95f06c53b => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:50.855383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67564c4-e071-4dcb-8a1b-a159e5cab3b7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:50.901856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:50.919857 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 139/281] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:14:50 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:14:50.920073 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af1ff6-9efe-437d-a5df-3eb5f004bb34 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:50.920400 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af1ff6-9efe-437d-a5df-3eb5f004bb34 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:50.921693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af1ff6-9efe-437d-a5df-3eb5f004bb34 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:50.922293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 140/282] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:50.928629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6c119-bec4-4e95-8e57-66764d284f14 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:50.928915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6c119-bec4-4e95-8e57-66764d284f14 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:50.929195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6c119-bec4-4e95-8e57-66764d284f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:50.953834 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c3e6c119-bec4-4e95-8e57-66764d284f14 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:50.958231 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c3e6c119-bec4-4e95-8e57-66764d284f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:50.996805 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67564c4-e071-4dcb-8a1b-a159e5cab3b7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:51.053516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 141/283] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:51.058762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fea45c-ea8e-445d-913c-1e0ceba54c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:51.059582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fea45c-ea8e-445d-913c-1e0ceba54c01 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:51.059856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fea45c-ea8e-445d-913c-1e0ceba54c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:51.060119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fea45c-ea8e-445d-913c-1e0ceba54c01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:51.072365 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fea45c-ea8e-445d-913c-1e0ceba54c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-12fea45c-ea8e-445d-913c-1e0ceba54c01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:51.087007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:51.088409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:51.089399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:51.089399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:51.089399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:51.089399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:51.089399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:51.089399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:51.089399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:51.089399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:51.089399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:51.089399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:51.089399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:51.089399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:51.089399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 143/284] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:51.091369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fea45c-ea8e-445d-913c-1e0ceba54c01 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:51.091493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6c119-bec4-4e95-8e57-66764d284f14 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:51.227895 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6c119-bec4-4e95-8e57-66764d284f14 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:51.232547 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:51.235822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fea45c-ea8e-445d-913c-1e0ceba54c01 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:51.242747 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:51.275101 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12991a50-674b-4a90-b907-f8a5a5b384a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:51.275884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12991a50-674b-4a90-b907-f8a5a5b384a2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:51.276164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12991a50-674b-4a90-b907-f8a5a5b384a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:51.276439 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12991a50-674b-4a90-b907-f8a5a5b384a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:51.277204 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12991a50-674b-4a90-b907-f8a5a5b384a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:51.277509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12991a50-674b-4a90-b907-f8a5a5b384a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:51.279431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12991a50-674b-4a90-b907-f8a5a5b384a2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:51.291026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 142/285] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:51.294199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2baa499-d4e1-431e-802e-0f1239846bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:51.295168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2baa499-d4e1-431e-802e-0f1239846bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:51.295656 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2baa499-d4e1-431e-802e-0f1239846bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:51.295957 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2baa499-d4e1-431e-802e-0f1239846bb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:51.297014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12991a50-674b-4a90-b907-f8a5a5b384a2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:51.310634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2baa499-d4e1-431e-802e-0f1239846bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c2baa499-d4e1-431e-802e-0f1239846bb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:51.321576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:51.322576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:51.323406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:51.323406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:51.323406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:51.323406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:51.323406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:51.323406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:51.323406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:51.323406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:51.323406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:51.323406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:51.323406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:51.323406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:51.323406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 144/286] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:51.328970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2baa499-d4e1-431e-802e-0f1239846bb4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:51.421637 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12991a50-674b-4a90-b907-f8a5a5b384a2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:51.459402 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2baa499-d4e1-431e-802e-0f1239846bb4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:51.463264 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb028d3-093b-43bf-9838-89aa4ac1c6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:51.464371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb028d3-093b-43bf-9838-89aa4ac1c6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:51.464867 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb028d3-093b-43bf-9838-89aa4ac1c6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:51.465317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb028d3-093b-43bf-9838-89aa4ac1c6a7 None admin] PATH_INFO: `/v3/users/677f763bb25a4388aaf6efcc7e7a6be2` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:51.466828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb028d3-093b-43bf-9838-89aa4ac1c6a7 None admin] RBAC: Authorizing `identity:get_user(user_id=677f763bb25a4388aaf6efcc7e7a6be2)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:51.468610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb028d3-093b-43bf-9838-89aa4ac1c6a7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:51.471072 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 143/287] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:51 2022] GET /identity/v3/users/677f763bb25a4388aaf6efcc7e7a6be2 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:51.478782 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb028d3-093b-43bf-9838-89aa4ac1c6a7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:51.521653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85284a81-3f62-435d-bbda-496f45fe2576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:51.522336 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284a81-3f62-435d-bbda-496f45fe2576 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:51.522615 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284a81-3f62-435d-bbda-496f45fe2576 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:51.522947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284a81-3f62-435d-bbda-496f45fe2576 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:51.523708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85284a81-3f62-435d-bbda-496f45fe2576 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:51.524139 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85284a81-3f62-435d-bbda-496f45fe2576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:51.525603 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85284a81-3f62-435d-bbda-496f45fe2576 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:51.545021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 145/288] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:51.553059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85284a81-3f62-435d-bbda-496f45fe2576 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:51.575040 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:51.601235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:51.672725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb028d3-093b-43bf-9838-89aa4ac1c6a7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:51.732341 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407d8e7-acfa-422b-869b-9c26c40f4596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:51.733241 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407d8e7-acfa-422b-869b-9c26c40f4596 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:51.733521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407d8e7-acfa-422b-869b-9c26c40f4596 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:51.733641 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85284a81-3f62-435d-bbda-496f45fe2576 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:51.733868 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407d8e7-acfa-422b-869b-9c26c40f4596 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:51.735099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407d8e7-acfa-422b-869b-9c26c40f4596 None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:51.736566 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407d8e7-acfa-422b-869b-9c26c40f4596 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:51.738642 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 144/289] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:51 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:51.745775 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407d8e7-acfa-422b-869b-9c26c40f4596 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:51.803394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf331e-9706-42a0-a2d9-a707e4629260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:51.804329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf331e-9706-42a0-a2d9-a707e4629260 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:51.804609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf331e-9706-42a0-a2d9-a707e4629260 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:51.804880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf331e-9706-42a0-a2d9-a707e4629260 None admin] PATH_INFO: `/v3/users/f7b51dc574ac403bb592fb969ee29225` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:51.808409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf331e-9706-42a0-a2d9-a707e4629260 None admin] RBAC: Authorizing `identity:get_user(user_id=f7b51dc574ac403bb592fb969ee29225)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:51.809927 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf331e-9706-42a0-a2d9-a707e4629260 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:51.814545 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 146/290] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:51 2022] GET /identity/v3/users/f7b51dc574ac403bb592fb969ee29225 => generated 297 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:51.817918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf331e-9706-42a0-a2d9-a707e4629260 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:51.921720 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407d8e7-acfa-422b-869b-9c26c40f4596 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:51.939046 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:51.981217 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:51.986879 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ae25f-62ce-492b-ac81-bc8adbbb8716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:51.987719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ae25f-62ce-492b-ac81-bc8adbbb8716 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:51.987997 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ae25f-62ce-492b-ac81-bc8adbbb8716 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:51.988269 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ae25f-62ce-492b-ac81-bc8adbbb8716 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802/users/677f763bb25a4388aaf6efcc7e7a6be2/roles/8b71d050850f4e75a4ae097553e111d0` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:51.990344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ae25f-62ce-492b-ac81-bc8adbbb8716 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b6f3b860bdb40de962e435fd234c802, user_id=677f763bb25a4388aaf6efcc7e7a6be2, role_id=8b71d050850f4e75a4ae097553e111d0)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:51.991870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ae25f-62ce-492b-ac81-bc8adbbb8716 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:52.000937 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf331e-9706-42a0-a2d9-a707e4629260 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:52.036279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181201c-02f4-4770-b6c0-f31887ef6ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:52.036944 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181201c-02f4-4770-b6c0-f31887ef6ddf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:52.037233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181201c-02f4-4770-b6c0-f31887ef6ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:52.037509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181201c-02f4-4770-b6c0-f31887ef6ddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:52.100720 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 145/291] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:14:51 2022] PUT /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802/users/677f763bb25a4388aaf6efcc7e7a6be2/roles/8b71d050850f4e75a4ae097553e111d0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:14:52.120825 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181201c-02f4-4770-b6c0-f31887ef6ddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:52.122427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181201c-02f4-4770-b6c0-f31887ef6ddf None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:52.246190 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:52.256862 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 147/292] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:14:52.264052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ae25f-62ce-492b-ac81-bc8adbbb8716 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:52.435560 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ae25f-62ce-492b-ac81-bc8adbbb8716 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:52.489277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6afc93-88a6-412f-86c8-47a8f5d55424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:52.490147 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6afc93-88a6-412f-86c8-47a8f5d55424 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:52.490431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6afc93-88a6-412f-86c8-47a8f5d55424 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:52.490755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6afc93-88a6-412f-86c8-47a8f5d55424 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:52.491931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6afc93-88a6-412f-86c8-47a8f5d55424 None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:52.493926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6afc93-88a6-412f-86c8-47a8f5d55424 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:52.496061 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 146/293] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:52 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:52.501896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181201c-02f4-4770-b6c0-f31887ef6ddf None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:52.652553 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181201c-02f4-4770-b6c0-f31887ef6ddf None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:52.688096 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8759431-0af2-45df-b0f8-06d324c67937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:52.688754 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8759431-0af2-45df-b0f8-06d324c67937 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:52.689034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8759431-0af2-45df-b0f8-06d324c67937 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:52.689306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8759431-0af2-45df-b0f8-06d324c67937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:52.690409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8759431-0af2-45df-b0f8-06d324c67937 None admin] RBAC: Adding query filter params (role.id=9b386d2d84ef4d3b9f9401c95f06c53b, scope.project.id=3b6f3b860bdb40de962e435fd234c802, user.id=f7b51dc574ac403bb592fb969ee29225) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:52.690753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8759431-0af2-45df-b0f8-06d324c67937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:52.692268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8759431-0af2-45df-b0f8-06d324c67937 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:52.699378 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 148/294] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:52 2022] GET /identity/v3/role_assignments?user.id=f7b51dc574ac403bb592fb969ee29225&scope.project.id=3b6f3b860bdb40de962e435fd234c802&role.id=9b386d2d84ef4d3b9f9401c95f06c53b => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:53.282337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8436b4-d38a-4a6c-ba97-41771cab9718 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:53.282871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8436b4-d38a-4a6c-ba97-41771cab9718 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:53.282978 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8436b4-d38a-4a6c-ba97-41771cab9718 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:53.284588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 147/295] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:53.291432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952db13-b7c2-4555-a62b-8c5ca9c1eaa1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:53.291719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952db13-b7c2-4555-a62b-8c5ca9c1eaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:53.291990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952db13-b7c2-4555-a62b-8c5ca9c1eaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:53.313596 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f952db13-b7c2-4555-a62b-8c5ca9c1eaa1 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:53.314791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f952db13-b7c2-4555-a62b-8c5ca9c1eaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:53.366895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:53.386190 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 149/296] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:53.411669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8436b4-d38a-4a6c-ba97-41771cab9718 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:53.457332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:53.519478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361336b2-ebfc-4117-a9e6-ef78db346fab None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:53.519974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361336b2-ebfc-4117-a9e6-ef78db346fab None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:53.520047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361336b2-ebfc-4117-a9e6-ef78db346fab None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:53.522714 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 150/297] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:14:53.526739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8436b4-d38a-4a6c-ba97-41771cab9718 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:53.527506 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61951830-55b7-4fb2-b7de-547999decc49 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:53.527854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61951830-55b7-4fb2-b7de-547999decc49 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:53.528280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61951830-55b7-4fb2-b7de-547999decc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:53.545858 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-61951830-55b7-4fb2-b7de-547999decc49 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:53.547015 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-61951830-55b7-4fb2-b7de-547999decc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:53.581358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8faa7a-b410-4ca1-a069-e6cb6ca58e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:53.582168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8faa7a-b410-4ca1-a069-e6cb6ca58e90 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:53.582443 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8faa7a-b410-4ca1-a069-e6cb6ca58e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:53.582975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8faa7a-b410-4ca1-a069-e6cb6ca58e90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:53.598918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8faa7a-b410-4ca1-a069-e6cb6ca58e90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-cf8faa7a-b410-4ca1-a069-e6cb6ca58e90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:53.609973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:53.610913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:53.611729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:53.611729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:53.611729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:53.611729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:53.611729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:53.611729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:53.611729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:53.611729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:53.611729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:53.611729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:53.611729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:53.611729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:53.615233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 148/298] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:53.621060 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8faa7a-b410-4ca1-a069-e6cb6ca58e90 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:53.634114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 151/299] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:53.635935 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875b4fd-28f5-427e-a133-0f237beebb04 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:53.636220 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875b4fd-28f5-427e-a133-0f237beebb04 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:53.636491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875b4fd-28f5-427e-a133-0f237beebb04 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:53.637899 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 152/300] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:53.643016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a9a92-d811-4e24-b4a9-10053ec5e400 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:53.643294 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a9a92-d811-4e24-b4a9-10053ec5e400 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:53.643562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a9a92-d811-4e24-b4a9-10053ec5e400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:53.660856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-945a9a92-d811-4e24-b4a9-10053ec5e400 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:53.662025 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-945a9a92-d811-4e24-b4a9-10053ec5e400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:53.733322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:53.737493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8faa7a-b410-4ca1-a069-e6cb6ca58e90 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:53.737813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 153/301] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:53.743752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a9a92-d811-4e24-b4a9-10053ec5e400 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:53.783305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922706a8-78d4-4276-94f5-713c6e5f7985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:53.784283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922706a8-78d4-4276-94f5-713c6e5f7985 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:53.784554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922706a8-78d4-4276-94f5-713c6e5f7985 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:53.784842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922706a8-78d4-4276-94f5-713c6e5f7985 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:53.785686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922706a8-78d4-4276-94f5-713c6e5f7985 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:53.785894 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922706a8-78d4-4276-94f5-713c6e5f7985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:53.787324 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922706a8-78d4-4276-94f5-713c6e5f7985 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:53.796867 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:53.798755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 149/302] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:53.799492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922706a8-78d4-4276-94f5-713c6e5f7985 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:53.863399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a9a92-d811-4e24-b4a9-10053ec5e400 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:53.901306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c423c7-9274-4c07-9033-3d91444063f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:53.902264 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c423c7-9274-4c07-9033-3d91444063f8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:53.902540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c423c7-9274-4c07-9033-3d91444063f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:53.902974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c423c7-9274-4c07-9033-3d91444063f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:53.908560 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922706a8-78d4-4276-94f5-713c6e5f7985 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:53.913516 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c423c7-9274-4c07-9033-3d91444063f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-32c423c7-9274-4c07-9033-3d91444063f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:53.922718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:53.923620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:53.924415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:53.924415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:53.924415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:53.924415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:53.924415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:53.924415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:53.924415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:53.924415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:53.924415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:53.924415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:53.924415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:53.924415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:53.924415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 154/303] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:53.925551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c423c7-9274-4c07-9033-3d91444063f8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:53.951596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5f400-1036-46b4-9a57-792d67993d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:53.952493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5f400-1036-46b4-9a57-792d67993d04 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:53.952781 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5f400-1036-46b4-9a57-792d67993d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:53.953020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5f400-1036-46b4-9a57-792d67993d04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:53.954183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5f400-1036-46b4-9a57-792d67993d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:53.955877 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5f400-1036-46b4-9a57-792d67993d04 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:53.962111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 150/304] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:53.962111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5f400-1036-46b4-9a57-792d67993d04 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:53.993169 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:54.037957 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c423c7-9274-4c07-9033-3d91444063f8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:54.041387 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:54.068041 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5f400-1036-46b4-9a57-792d67993d04 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:54.075295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c1e0e-09b7-47de-84b9-5e6f56960f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:54.076574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c1e0e-09b7-47de-84b9-5e6f56960f4d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:54.077344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c1e0e-09b7-47de-84b9-5e6f56960f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:54.077620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c1e0e-09b7-47de-84b9-5e6f56960f4d None admin] PATH_INFO: `/v3/users/8aeecf7bdc8f4e0c88e73c469d203e5c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:54.078877 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c1e0e-09b7-47de-84b9-5e6f56960f4d None admin] RBAC: Authorizing `identity:get_user(user_id=8aeecf7bdc8f4e0c88e73c469d203e5c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:54.080346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c1e0e-09b7-47de-84b9-5e6f56960f4d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:54.082005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 155/305] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:53 2022] GET /identity/v3/users/8aeecf7bdc8f4e0c88e73c469d203e5c => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:54.082005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c1e0e-09b7-47de-84b9-5e6f56960f4d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:54.109128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83481147-f0e6-4fa1-a1a9-21c2ffe468d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:54.109791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83481147-f0e6-4fa1-a1a9-21c2ffe468d0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:54.110075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83481147-f0e6-4fa1-a1a9-21c2ffe468d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:54.110341 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83481147-f0e6-4fa1-a1a9-21c2ffe468d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:54.111111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83481147-f0e6-4fa1-a1a9-21c2ffe468d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:54.111410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83481147-f0e6-4fa1-a1a9-21c2ffe468d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:54.112786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83481147-f0e6-4fa1-a1a9-21c2ffe468d0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:54.126459 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 151/306] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:54.126459 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83481147-f0e6-4fa1-a1a9-21c2ffe468d0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:54.210352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c1e0e-09b7-47de-84b9-5e6f56960f4d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:54.223533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:54.234193 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83481147-f0e6-4fa1-a1a9-21c2ffe468d0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:54.246175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dff1a-7509-4aa8-8445-870a1c74bff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:54.246877 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dff1a-7509-4aa8-8445-870a1c74bff3 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:54.247158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dff1a-7509-4aa8-8445-870a1c74bff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:54.247497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dff1a-7509-4aa8-8445-870a1c74bff3 None admin] PATH_INFO: `/v3/groups` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:54.248203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133dff1a-7509-4aa8-8445-870a1c74bff3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:54.249690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133dff1a-7509-4aa8-8445-870a1c74bff3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:54.270504 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ab64a-bc1a-4226-963c-96ff2e755d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:54.271511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ab64a-bc1a-4226-963c-96ff2e755d80 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:54.271993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ab64a-bc1a-4226-963c-96ff2e755d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:54.272438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ab64a-bc1a-4226-963c-96ff2e755d80 None admin] PATH_INFO: `/v3/system/users/8aeecf7bdc8f4e0c88e73c469d203e5c/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:54.275722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ab64a-bc1a-4226-963c-96ff2e755d80 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8aeecf7bdc8f4e0c88e73c469d203e5c, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:54.277122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ab64a-bc1a-4226-963c-96ff2e755d80 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:54.344189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 156/307] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Jul 20 19:14:54 2022] POST /identity/v3/groups => generated 229 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:14:54.344929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dff1a-7509-4aa8-8445-870a1c74bff3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:54.373455 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 152/308] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Jul 20 19:14:54 2022] PUT /identity/v3/system/users/8aeecf7bdc8f4e0c88e73c469d203e5c/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:14:54.404803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:54.492980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dff1a-7509-4aa8-8445-870a1c74bff3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:54.533326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe2f42-3ccd-40bf-b89b-7c644d63b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:54.534214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe2f42-3ccd-40bf-b89b-7c644d63b7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:54.534498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe2f42-3ccd-40bf-b89b-7c644d63b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:54.534801 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe2f42-3ccd-40bf-b89b-7c644d63b7b5 None admin] PATH_INFO: `/v3/users/382d067341384a71880e81f0e93e2a1e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:54.546201 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10aa9-1e9d-4ae1-8d8b-f42a75e43c64 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:54.546549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10aa9-1e9d-4ae1-8d8b-f42a75e43c64 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:54.546861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10aa9-1e9d-4ae1-8d8b-f42a75e43c64 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:54.548285 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 153/309] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:54.552831 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe2f42-3ccd-40bf-b89b-7c644d63b7b5 None admin] RBAC: Authorizing `identity:get_user(user_id=382d067341384a71880e81f0e93e2a1e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:54.554437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe2f42-3ccd-40bf-b89b-7c644d63b7b5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:54.558715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 157/310] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:54 2022] GET /identity/v3/users/382d067341384a71880e81f0e93e2a1e => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:54.561333 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f003fba-e6e0-464e-a80d-166c7582bd64 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:54.561697 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f003fba-e6e0-464e-a80d-166c7582bd64 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:54.562049 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f003fba-e6e0-464e-a80d-166c7582bd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:54.564108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe2f42-3ccd-40bf-b89b-7c644d63b7b5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:54.584753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5f003fba-e6e0-464e-a80d-166c7582bd64 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:54.586124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5f003fba-e6e0-464e-a80d-166c7582bd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:54.674643 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:54.689320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 154/311] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:54.689526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe2f42-3ccd-40bf-b89b-7c644d63b7b5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:54.706990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f003fba-e6e0-464e-a80d-166c7582bd64 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:54.726808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b14a9-cdff-46c3-bb77-819d26cf94ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:54.727854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b14a9-cdff-46c3-bb77-819d26cf94ff None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:54.728373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b14a9-cdff-46c3-bb77-819d26cf94ff None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:54.728852 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b14a9-cdff-46c3-bb77-819d26cf94ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:54.729889 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b14a9-cdff-46c3-bb77-819d26cf94ff None admin] RBAC: Adding query filter params (role.id=8b71d050850f4e75a4ae097553e111d0, user.id=382d067341384a71880e81f0e93e2a1e, scope.system=all) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:54.730397 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b14a9-cdff-46c3-bb77-819d26cf94ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:54.732155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b14a9-cdff-46c3-bb77-819d26cf94ff None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:54.738493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 158/312] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jul 20 19:14:54 2022] GET /identity/v3/role_assignments?user.id=382d067341384a71880e81f0e93e2a1e&scope.system=all&role.id=8b71d050850f4e75a4ae097553e111d0 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:54.818165 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:54.837741 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f003fba-e6e0-464e-a80d-166c7582bd64 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:54.878297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002da5ac-e3bf-4301-981a-9107dab4ef57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:54.879474 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002da5ac-e3bf-4301-981a-9107dab4ef57 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:54.879908 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002da5ac-e3bf-4301-981a-9107dab4ef57 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:54.880361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002da5ac-e3bf-4301-981a-9107dab4ef57 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:54.893756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002da5ac-e3bf-4301-981a-9107dab4ef57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-002da5ac-e3bf-4301-981a-9107dab4ef57 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:54.902627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:54.903599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:54.904421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:54.904421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:54.904421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:54.904421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:54.904421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:54.904421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:54.904421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:54.904421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:54.904421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:54.904421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:54.904421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:54.904421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:54.910706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 155/313] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:54.913621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b14a9-cdff-46c3-bb77-819d26cf94ff None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:55.022349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b14a9-cdff-46c3-bb77-819d26cf94ff None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:55.058650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d1858-1d58-4e21-92b8-e6521925cfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:55.059354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d1858-1d58-4e21-92b8-e6521925cfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:55.059635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d1858-1d58-4e21-92b8-e6521925cfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:55.059910 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d1858-1d58-4e21-92b8-e6521925cfd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:55.060669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d1858-1d58-4e21-92b8-e6521925cfd1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:55.060975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d1858-1d58-4e21-92b8-e6521925cfd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:55.062362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d1858-1d58-4e21-92b8-e6521925cfd1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:55.072473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 159/314] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:55.077605 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002da5ac-e3bf-4301-981a-9107dab4ef57 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:55.193189 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002da5ac-e3bf-4301-981a-9107dab4ef57 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:55.238627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df1b30-667f-4a6b-b55d-7ce4ee7ae59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:55.239529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df1b30-667f-4a6b-b55d-7ce4ee7ae59e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:55.239807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df1b30-667f-4a6b-b55d-7ce4ee7ae59e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:55.240077 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df1b30-667f-4a6b-b55d-7ce4ee7ae59e None admin] PATH_INFO: `/v3/users/677f763bb25a4388aaf6efcc7e7a6be2` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:55.241301 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df1b30-667f-4a6b-b55d-7ce4ee7ae59e None admin] RBAC: Authorizing `identity:get_user(user_id=677f763bb25a4388aaf6efcc7e7a6be2)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:55.242845 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df1b30-667f-4a6b-b55d-7ce4ee7ae59e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:55.244814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 156/315] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:55 2022] GET /identity/v3/users/677f763bb25a4388aaf6efcc7e7a6be2 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:55.249978 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d1858-1d58-4e21-92b8-e6521925cfd1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:55.269231 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:55.361604 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d1858-1d58-4e21-92b8-e6521925cfd1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:55.396540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bedf9a-d4fe-4ef3-89de-40ce68a01ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:55.397195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bedf9a-d4fe-4ef3-89de-40ce68a01ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:55.397480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bedf9a-d4fe-4ef3-89de-40ce68a01ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:55.397757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bedf9a-d4fe-4ef3-89de-40ce68a01ec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:55.468522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bedf9a-d4fe-4ef3-89de-40ce68a01ec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:55.470006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bedf9a-d4fe-4ef3-89de-40ce68a01ec3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:55.499462 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:55.585762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 160/316] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:14:55.592569 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df1b30-667f-4a6b-b55d-7ce4ee7ae59e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:55.611900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:55.703184 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df1b30-667f-4a6b-b55d-7ce4ee7ae59e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:55.738877 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bdf25-4c8b-4ed6-bf25-63d594aa0ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:55.740066 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bdf25-4c8b-4ed6-bf25-63d594aa0ebb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:55.740593 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bdf25-4c8b-4ed6-bf25-63d594aa0ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:55.741065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bdf25-4c8b-4ed6-bf25-63d594aa0ebb None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:55.743054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bdf25-4c8b-4ed6-bf25-63d594aa0ebb None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:55.744720 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bdf25-4c8b-4ed6-bf25-63d594aa0ebb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:55.746963 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 157/317] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:14:55 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:55.753049 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bedf9a-d4fe-4ef3-89de-40ce68a01ec3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:55.853705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bedf9a-d4fe-4ef3-89de-40ce68a01ec3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:55.871958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:55.895179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fbc72-8719-4c84-bfed-13e7e377ee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:55.895844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fbc72-8719-4c84-bfed-13e7e377ee68 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:55.896123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fbc72-8719-4c84-bfed-13e7e377ee68 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:55.896398 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fbc72-8719-4c84-bfed-13e7e377ee68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:55.897240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fbc72-8719-4c84-bfed-13e7e377ee68 None admin] RBAC: Adding query filter params (role.id=8b71d050850f4e75a4ae097553e111d0, scope.project.id=3b6f3b860bdb40de962e435fd234c802, user.id=677f763bb25a4388aaf6efcc7e7a6be2) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:55.897551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fbc72-8719-4c84-bfed-13e7e377ee68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:55.899610 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fbc72-8719-4c84-bfed-13e7e377ee68 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:55.906337 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 161/318] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:55 2022] GET /identity/v3/role_assignments?user.id=677f763bb25a4388aaf6efcc7e7a6be2&scope.project.id=3b6f3b860bdb40de962e435fd234c802&role.id=8b71d050850f4e75a4ae097553e111d0 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:56.548453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b4a59-58c0-469c-8c31-2426545d8fc6 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:56.548709 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b4a59-58c0-469c-8c31-2426545d8fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:56.548892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b4a59-58c0-469c-8c31-2426545d8fc6 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:56.550443 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 158/319] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:14:56.556040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fc78a-5ff9-4d64-895d-0cb692e9858c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:56.556328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fc78a-5ff9-4d64-895d-0cb692e9858c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:56.556600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fc78a-5ff9-4d64-895d-0cb692e9858c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:56.574223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-835fc78a-5ff9-4d64-895d-0cb692e9858c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:56.575445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-835fc78a-5ff9-4d64-895d-0cb692e9858c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:56.602328 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb1c44-dd02-4308-93e3-b5615cfd4b4c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:56.602900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb1c44-dd02-4308-93e3-b5615cfd4b4c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:56.602900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb1c44-dd02-4308-93e3-b5615cfd4b4c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:56.604229 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 159/320] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:14:56.609246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c3fb3-b7ef-4f51-bd0f-f38d7057d803 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:56.609441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c3fb3-b7ef-4f51-bd0f-f38d7057d803 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:56.609889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c3fb3-b7ef-4f51-bd0f-f38d7057d803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:56.628704 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-827c3fb3-b7ef-4f51-bd0f-f38d7057d803 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:56.629912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-827c3fb3-b7ef-4f51-bd0f-f38d7057d803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:56.647103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 162/321] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:56.670284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fc78a-5ff9-4d64-895d-0cb692e9858c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:56.705475 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 160/322] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:14:56.728463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c3fb3-b7ef-4f51-bd0f-f38d7057d803 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:56.740464 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:56.776923 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fc78a-5ff9-4d64-895d-0cb692e9858c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:56.789559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:56.813875 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8d93b-d4de-4aa1-b7ee-ca1bbd8a10f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:56.814595 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8d93b-d4de-4aa1-b7ee-ca1bbd8a10f2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:56.815221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8d93b-d4de-4aa1-b7ee-ca1bbd8a10f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:56.815495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8d93b-d4de-4aa1-b7ee-ca1bbd8a10f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:56.816669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8d93b-d4de-4aa1-b7ee-ca1bbd8a10f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:56.818110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8d93b-d4de-4aa1-b7ee-ca1bbd8a10f2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:56.819834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 163/323] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:56.825370 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8d93b-d4de-4aa1-b7ee-ca1bbd8a10f2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:56.900872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c3fb3-b7ef-4f51-bd0f-f38d7057d803 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:56.935620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf3737-dbb8-403f-b35a-61d25fdd47b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:56.936418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf3737-dbb8-403f-b35a-61d25fdd47b2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:56.936687 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf3737-dbb8-403f-b35a-61d25fdd47b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:56.936951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf3737-dbb8-403f-b35a-61d25fdd47b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:56.947477 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf3737-dbb8-403f-b35a-61d25fdd47b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-cedf3737-dbb8-403f-b35a-61d25fdd47b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:56.955257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:56.956372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:56.957216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:56.957216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:56.957216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:56.957216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:56.957216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:56.957216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:56.957216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:56.957216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:56.957216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:56.957216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:56.957216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:56.957216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:56.957216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 161/324] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:56.959685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59019de-ec51-4642-8140-2206fa150905 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:56.959971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59019de-ec51-4642-8140-2206fa150905 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:56.960250 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59019de-ec51-4642-8140-2206fa150905 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:56.962121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 162/325] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:56.962852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59019de-ec51-4642-8140-2206fa150905 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:56.971428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8d93b-d4de-4aa1-b7ee-ca1bbd8a10f2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:57.006286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4e1f3-2b80-496a-9e22-fe5c1c189b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:57.006979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4e1f3-2b80-496a-9e22-fe5c1c189b0a None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:57.007254 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4e1f3-2b80-496a-9e22-fe5c1c189b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:57.007519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4e1f3-2b80-496a-9e22-fe5c1c189b0a None admin] PATH_INFO: `/v3/groups` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:57.008244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4e1f3-2b80-496a-9e22-fe5c1c189b0a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:57.009678 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4e1f3-2b80-496a-9e22-fe5c1c189b0a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:57.035533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:57.067671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59019de-ec51-4642-8140-2206fa150905 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:57.101374 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d2e1b-299c-48ad-a644-b2e8e97d6305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:57.102687 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d2e1b-299c-48ad-a644-b2e8e97d6305 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:57.102991 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d2e1b-299c-48ad-a644-b2e8e97d6305 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:57.103267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d2e1b-299c-48ad-a644-b2e8e97d6305 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:57.104014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d2e1b-299c-48ad-a644-b2e8e97d6305 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:57.104320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d2e1b-299c-48ad-a644-b2e8e97d6305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:57.105729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d2e1b-299c-48ad-a644-b2e8e97d6305 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:57.114311 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 163/326] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:57.119420 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e00c69-5127-41a3-820d-e491a8f49c92 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:57.119420 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e00c69-5127-41a3-820d-e491a8f49c92 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:57.119420 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e00c69-5127-41a3-820d-e491a8f49c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:57.119721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 164/327] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Jul 20 19:14:56 2022] POST /identity/v3/groups => generated 226 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:14:57.132126 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4e1f3-2b80-496a-9e22-fe5c1c189b0a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:57.134029 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-74e00c69-5127-41a3-820d-e491a8f49c92 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:57.135295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-74e00c69-5127-41a3-820d-e491a8f49c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:57.179157 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:57.218538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 164/328] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:57.243772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e00c69-5127-41a3-820d-e491a8f49c92 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:57.253748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4e1f3-2b80-496a-9e22-fe5c1c189b0a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:57.300202 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acfdf1-fb61-4675-a472-d9b0c7d50154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:57.301631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acfdf1-fb61-4675-a472-d9b0c7d50154 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:57.301631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acfdf1-fb61-4675-a472-d9b0c7d50154 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:57.301812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acfdf1-fb61-4675-a472-d9b0c7d50154 None admin] PATH_INFO: `/v3/users/8aeecf7bdc8f4e0c88e73c469d203e5c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:57.303004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acfdf1-fb61-4675-a472-d9b0c7d50154 None admin] RBAC: Authorizing `identity:get_user(user_id=8aeecf7bdc8f4e0c88e73c469d203e5c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:57.304533 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acfdf1-fb61-4675-a472-d9b0c7d50154 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:57.306719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 165/329] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:57 2022] GET /identity/v3/users/8aeecf7bdc8f4e0c88e73c469d203e5c => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:57.312488 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acfdf1-fb61-4675-a472-d9b0c7d50154 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:57.328744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:57.379569 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e00c69-5127-41a3-820d-e491a8f49c92 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:57.421556 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e891361-ef47-4f5b-9768-ca6061695c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:57.422358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e891361-ef47-4f5b-9768-ca6061695c45 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:57.422632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e891361-ef47-4f5b-9768-ca6061695c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:57.422930 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e891361-ef47-4f5b-9768-ca6061695c45 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:57.438842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e891361-ef47-4f5b-9768-ca6061695c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1e891361-ef47-4f5b-9768-ca6061695c45 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:57.447129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:57.448045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:57.449037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:57.449037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:57.449037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:57.449037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:57.449037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:57.449037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:57.449037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:57.449037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:57.449037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:57.449037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:57.449037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:14:57.449037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:14:57.449037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 165/330] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:57.454645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acfdf1-fb61-4675-a472-d9b0c7d50154 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:57.455257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e891361-ef47-4f5b-9768-ca6061695c45 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:57.463156 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:57.495271 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4607c-5537-412e-a426-e6c04ee4608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:57.495939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4607c-5537-412e-a426-e6c04ee4608a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:57.496214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4607c-5537-412e-a426-e6c04ee4608a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:57.496483 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4607c-5537-412e-a426-e6c04ee4608a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:57.497321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4607c-5537-412e-a426-e6c04ee4608a None admin] RBAC: Adding query filter params (role.id=9b386d2d84ef4d3b9f9401c95f06c53b, user.id=8aeecf7bdc8f4e0c88e73c469d203e5c, scope.system=all) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:57.497628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4607c-5537-412e-a426-e6c04ee4608a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:57.499439 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4607c-5537-412e-a426-e6c04ee4608a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:57.516772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 166/331] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jul 20 19:14:57 2022] GET /identity/v3/role_assignments?user.id=8aeecf7bdc8f4e0c88e73c469d203e5c&scope.system=all&role.id=9b386d2d84ef4d3b9f9401c95f06c53b => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:57.594968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e891361-ef47-4f5b-9768-ca6061695c45 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:57.616556 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:57.629580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fb489-22bb-45f4-a8c4-3bb0c7df431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:57.630273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fb489-22bb-45f4-a8c4-3bb0c7df431b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:57.630602 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fb489-22bb-45f4-a8c4-3bb0c7df431b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:57.630927 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fb489-22bb-45f4-a8c4-3bb0c7df431b None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:57.631685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fb489-22bb-45f4-a8c4-3bb0c7df431b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:57.631997 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fb489-22bb-45f4-a8c4-3bb0c7df431b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:57.633888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fb489-22bb-45f4-a8c4-3bb0c7df431b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:57.645260 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 166/332] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:57.651292 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4607c-5537-412e-a426-e6c04ee4608a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:57.762124 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4607c-5537-412e-a426-e6c04ee4608a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:57.798939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccff89-b45f-4fd5-8b2a-3436ce01a20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:57.799811 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccff89-b45f-4fd5-8b2a-3436ce01a20c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:57.800085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccff89-b45f-4fd5-8b2a-3436ce01a20c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:57.800351 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccff89-b45f-4fd5-8b2a-3436ce01a20c None admin] PATH_INFO: `/v3/users/382d067341384a71880e81f0e93e2a1e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:57.801566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccff89-b45f-4fd5-8b2a-3436ce01a20c None admin] RBAC: Authorizing `identity:get_user(user_id=382d067341384a71880e81f0e93e2a1e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:57.803095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccff89-b45f-4fd5-8b2a-3436ce01a20c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:57.805792 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 167/333] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:14:57 2022] GET /identity/v3/users/382d067341384a71880e81f0e93e2a1e => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:57.811511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fb489-22bb-45f4-a8c4-3bb0c7df431b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:57.947163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fb489-22bb-45f4-a8c4-3bb0c7df431b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:57.989652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c602e1d-c985-4dea-8b00-9e0dbdcabe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:57.990519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c602e1d-c985-4dea-8b00-9e0dbdcabe8d None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:57.990867 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c602e1d-c985-4dea-8b00-9e0dbdcabe8d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:57.991140 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c602e1d-c985-4dea-8b00-9e0dbdcabe8d None admin] PATH_INFO: `/v3/system/users/382d067341384a71880e81f0e93e2a1e/roles/8b71d050850f4e75a4ae097553e111d0` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:57.993362 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c602e1d-c985-4dea-8b00-9e0dbdcabe8d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=382d067341384a71880e81f0e93e2a1e, role_id=8b71d050850f4e75a4ae097553e111d0)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:57.994899 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c602e1d-c985-4dea-8b00-9e0dbdcabe8d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:58.064458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 167/334] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Jul 20 19:14:57 2022] PUT /identity/v3/system/users/382d067341384a71880e81f0e93e2a1e/roles/8b71d050850f4e75a4ae097553e111d0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:14:59.461502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f0cd2-5f87-4f21-8518-aa58ec9cfcfa None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:59.462035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f0cd2-5f87-4f21-8518-aa58ec9cfcfa None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:59.462305 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f0cd2-5f87-4f21-8518-aa58ec9cfcfa None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:59.463796 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 168/335] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:59.472577 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a70fa5-eee0-44a2-9b12-47276e112b26 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:59.473085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a70fa5-eee0-44a2-9b12-47276e112b26 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:59.473169 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a70fa5-eee0-44a2-9b12-47276e112b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:59.493943 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-69a70fa5-eee0-44a2-9b12-47276e112b26 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:59.495171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-69a70fa5-eee0-44a2-9b12-47276e112b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:59.555126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:59.584488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 168/336] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:14:59.628201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f0cd2-5f87-4f21-8518-aa58ec9cfcfa None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:59.668893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:59.750009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f0cd2-5f87-4f21-8518-aa58ec9cfcfa None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:59.800740 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36a97e-6558-4e9e-ad90-1e6b86f60ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:59.801539 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a97e-6558-4e9e-ad90-1e6b86f60ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:59.801821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a97e-6558-4e9e-ad90-1e6b86f60ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:59.802088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a97e-6558-4e9e-ad90-1e6b86f60ee4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:59.817767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36a97e-6558-4e9e-ad90-1e6b86f60ee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-0b36a97e-6558-4e9e-ad90-1e6b86f60ee4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:59.826559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:59.827524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:59.828321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:59.828321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:59.828321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:59.828321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:59.828321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:59.828321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:59.828321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:59.828321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:59.828321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:59.828321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:59.828321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:14:59.828321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:14:59.830773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 169/337] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:59.834138 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a70fa5-eee0-44a2-9b12-47276e112b26 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:59.967807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a70fa5-eee0-44a2-9b12-47276e112b26 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:00.016803 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1cae7-e863-40e7-ab3f-41f203ccc2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:00.017488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1cae7-e863-40e7-ab3f-41f203ccc2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:00.017770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1cae7-e863-40e7-ab3f-41f203ccc2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:00.018041 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1cae7-e863-40e7-ab3f-41f203ccc2f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:00.018831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1cae7-e863-40e7-ab3f-41f203ccc2f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:00.019135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1cae7-e863-40e7-ab3f-41f203ccc2f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:00.020554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1cae7-e863-40e7-ab3f-41f203ccc2f4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:00.034964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 169/338] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:14:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:00.040874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36a97e-6558-4e9e-ad90-1e6b86f60ee4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:00.158266 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:00.169000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36a97e-6558-4e9e-ad90-1e6b86f60ee4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:00.214850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e73a6-7152-4692-a4d4-e02bf0c56f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:00.215780 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e73a6-7152-4692-a4d4-e02bf0c56f5c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:00.216208 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e73a6-7152-4692-a4d4-e02bf0c56f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:00.216621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e73a6-7152-4692-a4d4-e02bf0c56f5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:00.241588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362b513-d7f2-44e4-a0fe-6a1b9ca1a955 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:00.244799 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362b513-d7f2-44e4-a0fe-6a1b9ca1a955 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:00.245329 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362b513-d7f2-44e4-a0fe-6a1b9ca1a955 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:00.254699 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 170/339] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:15:00.259858 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4c286-547b-4c6e-9e46-a5b47dc3e12c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:00.260460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4c286-547b-4c6e-9e46-a5b47dc3e12c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:00.260936 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4c286-547b-4c6e-9e46-a5b47dc3e12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:00.294659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e0e4c286-547b-4c6e-9e46-a5b47dc3e12c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:00.296198 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e0e4c286-547b-4c6e-9e46-a5b47dc3e12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:00.303507 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e73a6-7152-4692-a4d4-e02bf0c56f5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:00.305026 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e73a6-7152-4692-a4d4-e02bf0c56f5c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:00.401135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:00.420229 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 170/340] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:00.421893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40203a-f1ba-4b56-9d0c-d52a6fb3dbea None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:00.422317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40203a-f1ba-4b56-9d0c-d52a6fb3dbea None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:00.422775 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40203a-f1ba-4b56-9d0c-d52a6fb3dbea None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:00.424192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 171/341] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:00.425707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:00.432025 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918b466-9439-46f7-8645-602f12aa2345 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:00.432298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918b466-9439-46f7-8645-602f12aa2345 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:00.432748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918b466-9439-46f7-8645-602f12aa2345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:00.463609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c918b466-9439-46f7-8645-602f12aa2345 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:00.465548 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 171/342] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:00.466586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4c286-547b-4c6e-9e46-a5b47dc3e12c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:00.471072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c918b466-9439-46f7-8645-602f12aa2345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:00.641713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4c286-547b-4c6e-9e46-a5b47dc3e12c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:00.643746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 172/343] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:00.644773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918b466-9439-46f7-8645-602f12aa2345 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:00.684506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c503dbf-2e7e-46c4-9ded-a80dd4721cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:00.685745 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c503dbf-2e7e-46c4-9ded-a80dd4721cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:00.686229 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c503dbf-2e7e-46c4-9ded-a80dd4721cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:00.686743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c503dbf-2e7e-46c4-9ded-a80dd4721cd1 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:00.688173 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c503dbf-2e7e-46c4-9ded-a80dd4721cd1 None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:00.690278 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c503dbf-2e7e-46c4-9ded-a80dd4721cd1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:00.692557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 172/344] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:15:00 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:00.699746 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c503dbf-2e7e-46c4-9ded-a80dd4721cd1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:00.761453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:00.819169 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c503dbf-2e7e-46c4-9ded-a80dd4721cd1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:00.863156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bef822-0e71-4099-98d2-8f3dc55f7e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:00.864233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bef822-0e71-4099-98d2-8f3dc55f7e61 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:00.865727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bef822-0e71-4099-98d2-8f3dc55f7e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:00.866245 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bef822-0e71-4099-98d2-8f3dc55f7e61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:00.891984 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bef822-0e71-4099-98d2-8f3dc55f7e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:00.901780 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918b466-9439-46f7-8645-602f12aa2345 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-79bef822-0e71-4099-98d2-8f3dc55f7e61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:00.913557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:00.915239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:00.916027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:00.916027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:00.916027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:00.916027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:00.916027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:00.916027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:00.916027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:00.916027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:00.916027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:00.916027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:00.916027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:15:00.916027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:00.918000 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 173/345] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:15:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:00.926023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bef822-0e71-4099-98d2-8f3dc55f7e61 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:00.958937 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:00.983422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc30c8-530a-4be7-97de-58727b92a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:00.984509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc30c8-530a-4be7-97de-58727b92a684 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:00.984949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc30c8-530a-4be7-97de-58727b92a684 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:00.985368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc30c8-530a-4be7-97de-58727b92a684 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:00.998886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc30c8-530a-4be7-97de-58727b92a684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-aacc30c8-530a-4be7-97de-58727b92a684 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:01.010707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:01.011870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:01.013003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:01.013003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:01.013003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:01.013003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:01.013003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:01.013003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:01.013003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:01.013003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:01.013003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:01.013003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:01.013003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:15:01.013003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:01.017987 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 173/346] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:01.019671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc30c8-530a-4be7-97de-58727b92a684 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:01.147073 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:01.150587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc30c8-530a-4be7-97de-58727b92a684 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:01.154599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bef822-0e71-4099-98d2-8f3dc55f7e61 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:01.189615 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853b5bb-fd25-4c9f-a3a9-72b36ad2231b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:01.190638 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853b5bb-fd25-4c9f-a3a9-72b36ad2231b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:01.191355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853b5bb-fd25-4c9f-a3a9-72b36ad2231b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:01.191785 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853b5bb-fd25-4c9f-a3a9-72b36ad2231b None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:01.192761 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853b5bb-fd25-4c9f-a3a9-72b36ad2231b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:01.193319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853b5bb-fd25-4c9f-a3a9-72b36ad2231b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:01.195714 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853b5bb-fd25-4c9f-a3a9-72b36ad2231b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:01.205299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7199a-14ea-4666-a41e-e53322486676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:01.206065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 174/347] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:01.206183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7199a-14ea-4666-a41e-e53322486676 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:01.206431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7199a-14ea-4666-a41e-e53322486676 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:01.206723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7199a-14ea-4666-a41e-e53322486676 None admin] PATH_INFO: `/v3/groups/374da9c91ed74150aa588ae8f9850085` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:01.207575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853b5bb-fd25-4c9f-a3a9-72b36ad2231b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:01.227545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7199a-14ea-4666-a41e-e53322486676 None admin] RBAC: Authorizing `identity:get_group(group_id=374da9c91ed74150aa588ae8f9850085)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:01.229761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7199a-14ea-4666-a41e-e53322486676 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:01.230723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 174/348] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 20 19:15:00 2022] GET /identity/v3/groups/374da9c91ed74150aa588ae8f9850085 => generated 226 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:01.231501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7199a-14ea-4666-a41e-e53322486676 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:01.284256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:01.354244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853b5bb-fd25-4c9f-a3a9-72b36ad2231b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:01.385828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7199a-14ea-4666-a41e-e53322486676 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:01.397765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a70bda-167b-4904-a1d3-3fe09af3705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:01.399961 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a70bda-167b-4904-a1d3-3fe09af3705c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:01.400608 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a70bda-167b-4904-a1d3-3fe09af3705c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:01.401160 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a70bda-167b-4904-a1d3-3fe09af3705c None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:01.402091 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a70bda-167b-4904-a1d3-3fe09af3705c None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:01.402844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a70bda-167b-4904-a1d3-3fe09af3705c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:01.404913 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a70bda-167b-4904-a1d3-3fe09af3705c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:01.418768 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 175/349] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:15:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:01.420613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a70bda-167b-4904-a1d3-3fe09af3705c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:01.432649 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab0e11-3c02-4116-a8de-2245be83d909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:01.433656 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab0e11-3c02-4116-a8de-2245be83d909 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:01.434182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab0e11-3c02-4116-a8de-2245be83d909 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:01.434698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab0e11-3c02-4116-a8de-2245be83d909 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:01.469844 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:01.516135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab0e11-3c02-4116-a8de-2245be83d909 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:01.519419 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab0e11-3c02-4116-a8de-2245be83d909 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:01.555990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a70bda-167b-4904-a1d3-3fe09af3705c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:01.567129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:01.603991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd01f1c-387d-425c-8d40-cf3fcbbe102f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:01.604711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd01f1c-387d-425c-8d40-cf3fcbbe102f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:01.604994 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd01f1c-387d-425c-8d40-cf3fcbbe102f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:01.605271 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd01f1c-387d-425c-8d40-cf3fcbbe102f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:01.606752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd01f1c-387d-425c-8d40-cf3fcbbe102f None admin] RBAC: Adding query filter params (group.id=374da9c91ed74150aa588ae8f9850085, role.id=9b386d2d84ef4d3b9f9401c95f06c53b, scope.project.id=dc870179720c49a5916bb6299e1ba91d) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:01.606752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd01f1c-387d-425c-8d40-cf3fcbbe102f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:01.607965 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd01f1c-387d-425c-8d40-cf3fcbbe102f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:01.614741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 176/350] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 20 19:15:01 2022] GET /identity/v3/role_assignments?group.id=374da9c91ed74150aa588ae8f9850085&scope.project.id=dc870179720c49a5916bb6299e1ba91d&role.id=9b386d2d84ef4d3b9f9401c95f06c53b => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:01.616189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcf0cd-0b37-4799-b66a-40a3ca13b375 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:01.616477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcf0cd-0b37-4799-b66a-40a3ca13b375 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:01.616812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcf0cd-0b37-4799-b66a-40a3ca13b375 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:01.618230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 177/351] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:01.619186 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcf0cd-0b37-4799-b66a-40a3ca13b375 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:01.652004 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 175/352] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:01.654905 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5518b0-6dc3-4ff6-aa0f-6a254bef8318 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:01.655469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5518b0-6dc3-4ff6-aa0f-6a254bef8318 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:01.655918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5518b0-6dc3-4ff6-aa0f-6a254bef8318 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:01.658201 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 176/353] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:01.659776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac99cfa-668e-48c2-8c95-f5797d3787d5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:01.660217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac99cfa-668e-48c2-8c95-f5797d3787d5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:01.660632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac99cfa-668e-48c2-8c95-f5797d3787d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:01.686846 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bac99cfa-668e-48c2-8c95-f5797d3787d5 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:01.688424 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bac99cfa-668e-48c2-8c95-f5797d3787d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:01.778731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:01.784635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcf0cd-0b37-4799-b66a-40a3ca13b375 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:01.802665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 177/354] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:01.803403 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac99cfa-668e-48c2-8c95-f5797d3787d5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:01.850079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534f61e-3bda-4f63-9f3a-58a127ae743a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:01.851487 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534f61e-3bda-4f63-9f3a-58a127ae743a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:01.851763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534f61e-3bda-4f63-9f3a-58a127ae743a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:01.852037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534f61e-3bda-4f63-9f3a-58a127ae743a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:01.897511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:01.930058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534f61e-3bda-4f63-9f3a-58a127ae743a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:01.931569 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534f61e-3bda-4f63-9f3a-58a127ae743a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:01.932653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac99cfa-668e-48c2-8c95-f5797d3787d5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:01.970419 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de94946-8efd-4b0e-97d5-f3f769baa2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:01.971654 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de94946-8efd-4b0e-97d5-f3f769baa2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:01.972266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de94946-8efd-4b0e-97d5-f3f769baa2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:01.972732 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de94946-8efd-4b0e-97d5-f3f769baa2c3 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:01.974421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de94946-8efd-4b0e-97d5-f3f769baa2c3 None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:01.976612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de94946-8efd-4b0e-97d5-f3f769baa2c3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:01.978373 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 178/355] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:15:01 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:01.979591 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8c4c7-6af8-4bb0-b848-0380ad6d30bd None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:01.979871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8c4c7-6af8-4bb0-b848-0380ad6d30bd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:01.980140 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8c4c7-6af8-4bb0-b848-0380ad6d30bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:02.003649 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cda8c4c7-6af8-4bb0-b848-0380ad6d30bd None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:02.004844 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cda8c4c7-6af8-4bb0-b848-0380ad6d30bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:02.044027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 178/356] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:02.044828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534f61e-3bda-4f63-9f3a-58a127ae743a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:02.075355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:02.089037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 179/357] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:02.092544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695f6ec-a427-45b4-8ee5-8a46ec4a631a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:02.092544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695f6ec-a427-45b4-8ee5-8a46ec4a631a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:02.092544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695f6ec-a427-45b4-8ee5-8a46ec4a631a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:02.092544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 180/358] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:02.093087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695f6ec-a427-45b4-8ee5-8a46ec4a631a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:02.158957 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:02.200748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534f61e-3bda-4f63-9f3a-58a127ae743a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:02.237110 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695f6ec-a427-45b4-8ee5-8a46ec4a631a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:02.245405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5344f33-1bcc-47c5-8f5c-466604bff577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:02.246223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5344f33-1bcc-47c5-8f5c-466604bff577 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:02.246500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5344f33-1bcc-47c5-8f5c-466604bff577 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:02.247171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5344f33-1bcc-47c5-8f5c-466604bff577 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:02.258685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5344f33-1bcc-47c5-8f5c-466604bff577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a5344f33-1bcc-47c5-8f5c-466604bff577 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:02.268613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:02.269711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:02.270523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:02.270523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:02.270523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:02.270523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:02.270523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:02.270523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:02.270523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:02.270523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:02.270523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:02.270523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:02.270523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:15:02.270523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:02.270523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 179/359] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:15:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:02.271267 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5344f33-1bcc-47c5-8f5c-466604bff577 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:02.290005 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f832c-a1f3-4042-ba60-d713f85f7639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:02.291299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f832c-a1f3-4042-ba60-d713f85f7639 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:02.291782 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f832c-a1f3-4042-ba60-d713f85f7639 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:02.292287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f832c-a1f3-4042-ba60-d713f85f7639 None admin] PATH_INFO: `/v3/groups/374da9c91ed74150aa588ae8f9850085` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:02.296243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f832c-a1f3-4042-ba60-d713f85f7639 None admin] RBAC: Authorizing `identity:get_group(group_id=374da9c91ed74150aa588ae8f9850085)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:02.297663 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f832c-a1f3-4042-ba60-d713f85f7639 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:02.300753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 181/360] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 20 19:15:02 2022] GET /identity/v3/groups/374da9c91ed74150aa588ae8f9850085 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:02.300753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809ff3d-24a9-4a84-83b9-9b1787a6a32d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:02.300934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809ff3d-24a9-4a84-83b9-9b1787a6a32d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:02.301171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809ff3d-24a9-4a84-83b9-9b1787a6a32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:02.324479 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c809ff3d-24a9-4a84-83b9-9b1787a6a32d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:02.325671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c809ff3d-24a9-4a84-83b9-9b1787a6a32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:02.395802 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:02.407055 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5344f33-1bcc-47c5-8f5c-466604bff577 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:02.415393 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 182/361] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:02.416641 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809ff3d-24a9-4a84-83b9-9b1787a6a32d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:02.445604 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:02.454089 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889d207-5203-417b-8fb1-856de15aafb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:02.457720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889d207-5203-417b-8fb1-856de15aafb4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:02.457720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889d207-5203-417b-8fb1-856de15aafb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:02.457720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889d207-5203-417b-8fb1-856de15aafb4 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:02.458218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889d207-5203-417b-8fb1-856de15aafb4 None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:02.459729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889d207-5203-417b-8fb1-856de15aafb4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:02.462263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 180/362] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:15:02 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:02.463559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889d207-5203-417b-8fb1-856de15aafb4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:02.556765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809ff3d-24a9-4a84-83b9-9b1787a6a32d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:02.599191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa2b4a-f19c-4136-9449-04d2dc3a2356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:02.599997 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa2b4a-f19c-4136-9449-04d2dc3a2356 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:02.600275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa2b4a-f19c-4136-9449-04d2dc3a2356 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:02.600553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa2b4a-f19c-4136-9449-04d2dc3a2356 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:02.602354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889d207-5203-417b-8fb1-856de15aafb4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:02.618183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa2b4a-f19c-4136-9449-04d2dc3a2356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e6aa2b4a-f19c-4136-9449-04d2dc3a2356 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:02.626134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:02.627076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:02.627864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:02.627864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:02.627864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:02.627864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:02.627864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:02.627864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:02.627864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:02.627864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:02.627864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:02.627864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:02.627864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:15:02.627864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:02.628955 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 183/363] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:02.628955 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa2b4a-f19c-4136-9449-04d2dc3a2356 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:02.653687 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d2c77-ef21-4bc0-a641-b61bc141fac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:02.654883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d2c77-ef21-4bc0-a641-b61bc141fac4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:02.655308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d2c77-ef21-4bc0-a641-b61bc141fac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:02.655894 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d2c77-ef21-4bc0-a641-b61bc141fac4 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:02.657106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d2c77-ef21-4bc0-a641-b61bc141fac4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:02.657412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d2c77-ef21-4bc0-a641-b61bc141fac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:02.658834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d2c77-ef21-4bc0-a641-b61bc141fac4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:02.672649 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 181/364] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:02.674114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d2c77-ef21-4bc0-a641-b61bc141fac4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:02.697811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:02.771940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa2b4a-f19c-4136-9449-04d2dc3a2356 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:02.780225 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:02.821021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfc8bf-f3bd-408c-b68c-bc670113a3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:02.822213 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfc8bf-f3bd-408c-b68c-bc670113a3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:02.822513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfc8bf-f3bd-408c-b68c-bc670113a3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:02.823118 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfc8bf-f3bd-408c-b68c-bc670113a3f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:02.824016 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfc8bf-f3bd-408c-b68c-bc670113a3f8 None admin] RBAC: Adding query filter params (group.id=374da9c91ed74150aa588ae8f9850085, role.id=d73c76bc61c44f3a94e66397b0d9c359, scope.project.id=dc870179720c49a5916bb6299e1ba91d) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:02.824519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfc8bf-f3bd-408c-b68c-bc670113a3f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:02.826750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfc8bf-f3bd-408c-b68c-bc670113a3f8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:02.832915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d2c77-ef21-4bc0-a641-b61bc141fac4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:02.833995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 184/365] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 20 19:15:02 2022] GET /identity/v3/role_assignments?group.id=374da9c91ed74150aa588ae8f9850085&scope.project.id=dc870179720c49a5916bb6299e1ba91d&role.id=d73c76bc61c44f3a94e66397b0d9c359 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:02.835098 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfc8bf-f3bd-408c-b68c-bc670113a3f8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:02.878583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67def14-7556-41cf-882c-723e839f41e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:02.879432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67def14-7556-41cf-882c-723e839f41e9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:02.879715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67def14-7556-41cf-882c-723e839f41e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:02.879997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67def14-7556-41cf-882c-723e839f41e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:02.893406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67def14-7556-41cf-882c-723e839f41e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b67def14-7556-41cf-882c-723e839f41e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:02.902855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:02.903830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:02.904622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:02.904622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:02.904622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:02.904622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:02.904622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:02.904622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:02.904622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:02.904622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:02.904622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:02.904622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:02.904622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:02.904622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:02.904622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 182/366] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:15:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:02.905284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67def14-7556-41cf-882c-723e839f41e9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:02.958258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfc8bf-f3bd-408c-b68c-bc670113a3f8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:02.975123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:03.000568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041641ef-e19a-4433-85ed-cf9c9fa805e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:03.001441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041641ef-e19a-4433-85ed-cf9c9fa805e7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:03.001727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041641ef-e19a-4433-85ed-cf9c9fa805e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:03.002000 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041641ef-e19a-4433-85ed-cf9c9fa805e7 None admin] PATH_INFO: `/v3/groups/374da9c91ed74150aa588ae8f9850085` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:03.004130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041641ef-e19a-4433-85ed-cf9c9fa805e7 None admin] RBAC: Authorizing `identity:get_group(group_id=374da9c91ed74150aa588ae8f9850085)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:03.005744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041641ef-e19a-4433-85ed-cf9c9fa805e7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:03.007767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 185/367] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 20 19:15:02 2022] GET /identity/v3/groups/374da9c91ed74150aa588ae8f9850085 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:03.008348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041641ef-e19a-4433-85ed-cf9c9fa805e7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:03.022009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67def14-7556-41cf-882c-723e839f41e9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:03.045595 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:03.068627 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180a0ee-50b9-4220-ab5b-623aa1c3728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:03.070372 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180a0ee-50b9-4220-ab5b-623aa1c3728c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:03.070372 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180a0ee-50b9-4220-ab5b-623aa1c3728c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:03.071203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180a0ee-50b9-4220-ab5b-623aa1c3728c None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:03.071936 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180a0ee-50b9-4220-ab5b-623aa1c3728c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:03.072245 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180a0ee-50b9-4220-ab5b-623aa1c3728c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:03.073637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180a0ee-50b9-4220-ab5b-623aa1c3728c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:03.086605 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 183/368] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:15:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:03.087979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180a0ee-50b9-4220-ab5b-623aa1c3728c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:03.145670 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041641ef-e19a-4433-85ed-cf9c9fa805e7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:03.193395 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dc3cb-182b-48ad-a9c8-0a573bbb60b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:03.194427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dc3cb-182b-48ad-a9c8-0a573bbb60b0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:03.195042 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dc3cb-182b-48ad-a9c8-0a573bbb60b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:03.195568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dc3cb-182b-48ad-a9c8-0a573bbb60b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:03.209574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180a0ee-50b9-4220-ab5b-623aa1c3728c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:03.255230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa616-6cf7-4d54-a8ab-5c0659f29f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:03.255913 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa616-6cf7-4d54-a8ab-5c0659f29f8a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:03.256208 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa616-6cf7-4d54-a8ab-5c0659f29f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:03.256468 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa616-6cf7-4d54-a8ab-5c0659f29f8a None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:03.257577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fa616-6cf7-4d54-a8ab-5c0659f29f8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:03.257891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fa616-6cf7-4d54-a8ab-5c0659f29f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:03.259571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:03.260485 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fa616-6cf7-4d54-a8ab-5c0659f29f8a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:03.271444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 184/369] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:03.272207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa616-6cf7-4d54-a8ab-5c0659f29f8a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:03.287873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dc3cb-182b-48ad-a9c8-0a573bbb60b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:03.290380 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dc3cb-182b-48ad-a9c8-0a573bbb60b0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:03.339134 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:03.405822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa616-6cf7-4d54-a8ab-5c0659f29f8a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:03.434360 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 186/370] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:03.434360 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dc3cb-182b-48ad-a9c8-0a573bbb60b0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:03.459210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91314582-8002-4bf6-a9b1-8f69a099db09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:03.460297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91314582-8002-4bf6-a9b1-8f69a099db09 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:03.460799 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91314582-8002-4bf6-a9b1-8f69a099db09 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:03.461265 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91314582-8002-4bf6-a9b1-8f69a099db09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:03.462301 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91314582-8002-4bf6-a9b1-8f69a099db09 None admin] RBAC: Adding query filter params (group.id=374da9c91ed74150aa588ae8f9850085, role.id=9b386d2d84ef4d3b9f9401c95f06c53b, scope.project.id=3b6f3b860bdb40de962e435fd234c802) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:03.462839 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91314582-8002-4bf6-a9b1-8f69a099db09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:03.464505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91314582-8002-4bf6-a9b1-8f69a099db09 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:03.476342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 185/371] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 20 19:15:03 2022] GET /identity/v3/role_assignments?group.id=374da9c91ed74150aa588ae8f9850085&scope.project.id=3b6f3b860bdb40de962e435fd234c802&role.id=9b386d2d84ef4d3b9f9401c95f06c53b => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:03.477653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91314582-8002-4bf6-a9b1-8f69a099db09 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:03.542710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:03.569896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dc3cb-182b-48ad-a9c8-0a573bbb60b0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:03.621149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea88b3-4644-49fc-b525-676ff7841429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:03.621898 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea88b3-4644-49fc-b525-676ff7841429 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:03.622182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea88b3-4644-49fc-b525-676ff7841429 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:03.622464 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea88b3-4644-49fc-b525-676ff7841429 None admin] PATH_INFO: `/v3/users/382d067341384a71880e81f0e93e2a1e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:03.625097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea88b3-4644-49fc-b525-676ff7841429 None admin] RBAC: Authorizing `identity:get_user(user_id=382d067341384a71880e81f0e93e2a1e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:03.625766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea88b3-4644-49fc-b525-676ff7841429 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:03.630422 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 187/372] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:15:03 2022] GET /identity/v3/users/382d067341384a71880e81f0e93e2a1e => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:03.630422 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea88b3-4644-49fc-b525-676ff7841429 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:03.667650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91314582-8002-4bf6-a9b1-8f69a099db09 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:03.683309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:03.719032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e3f4b-7f68-472f-811f-9929ec023661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:03.719958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e3f4b-7f68-472f-811f-9929ec023661 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:03.720244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e3f4b-7f68-472f-811f-9929ec023661 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:03.720522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e3f4b-7f68-472f-811f-9929ec023661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:03.769143 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea88b3-4644-49fc-b525-676ff7841429 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:03.809115 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e3f4b-7f68-472f-811f-9929ec023661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:03.810966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e3f4b-7f68-472f-811f-9929ec023661 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:03.813646 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dc3e7-238f-44e1-9950-1a53f50aa211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:03.815646 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc3e7-238f-44e1-9950-1a53f50aa211 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:03.815931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc3e7-238f-44e1-9950-1a53f50aa211 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:03.816207 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc3e7-238f-44e1-9950-1a53f50aa211 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:03.817476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dc3e7-238f-44e1-9950-1a53f50aa211 None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:03.819361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dc3e7-238f-44e1-9950-1a53f50aa211 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:03.825615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 188/373] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:15:03 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:03.825615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dc3e7-238f-44e1-9950-1a53f50aa211 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:03.847411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:03.941754 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 186/374] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:03.943122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e3f4b-7f68-472f-811f-9929ec023661 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:03.965191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dc3e7-238f-44e1-9950-1a53f50aa211 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:03.968312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:04.013544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566f30e-ee44-4fc2-9af4-18560faa889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:04.014216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566f30e-ee44-4fc2-9af4-18560faa889d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:04.014494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566f30e-ee44-4fc2-9af4-18560faa889d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:04.014798 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566f30e-ee44-4fc2-9af4-18560faa889d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:04.015693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566f30e-ee44-4fc2-9af4-18560faa889d None admin] RBAC: Adding query filter params (role.id=8b71d050850f4e75a4ae097553e111d0, user.id=382d067341384a71880e81f0e93e2a1e, scope.system=all) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:04.016007 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566f30e-ee44-4fc2-9af4-18560faa889d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:04.017985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566f30e-ee44-4fc2-9af4-18560faa889d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:04.034424 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 189/375] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jul 20 19:15:03 2022] GET /identity/v3/role_assignments?user.id=382d067341384a71880e81f0e93e2a1e&scope.system=all&role.id=8b71d050850f4e75a4ae097553e111d0 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:04.035353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566f30e-ee44-4fc2-9af4-18560faa889d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:04.077775 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e3f4b-7f68-472f-811f-9929ec023661 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:04.118775 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0a079-0812-41fd-ac9b-7316493580fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:04.119661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0a079-0812-41fd-ac9b-7316493580fd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:04.119937 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0a079-0812-41fd-ac9b-7316493580fd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:04.120205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0a079-0812-41fd-ac9b-7316493580fd None admin] PATH_INFO: `/v3/groups/374da9c91ed74150aa588ae8f9850085` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:04.121501 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0a079-0812-41fd-ac9b-7316493580fd None admin] RBAC: Authorizing `identity:get_group(group_id=374da9c91ed74150aa588ae8f9850085)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:04.123025 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0a079-0812-41fd-ac9b-7316493580fd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:04.130416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:04.130599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 187/376] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 20 19:15:03 2022] GET /identity/v3/groups/374da9c91ed74150aa588ae8f9850085 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:04.132616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daea3b-f69b-4cbc-9bd7-94c70922b3ed None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:04.132897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daea3b-f69b-4cbc-9bd7-94c70922b3ed None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:04.133167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daea3b-f69b-4cbc-9bd7-94c70922b3ed None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:04.135037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 188/377] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:04.136336 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daea3b-f69b-4cbc-9bd7-94c70922b3ed None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:04.161613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566f30e-ee44-4fc2-9af4-18560faa889d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:04.242146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13e87f-562e-468c-8d7d-c54639db2097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:04.243379 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13e87f-562e-468c-8d7d-c54639db2097 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:04.244140 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13e87f-562e-468c-8d7d-c54639db2097 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:04.244417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13e87f-562e-468c-8d7d-c54639db2097 None admin] PATH_INFO: `/v3/projects/19ff1600e760429b9e38b7ac11d31b62` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:04.245969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13e87f-562e-468c-8d7d-c54639db2097 None admin] RBAC: Authorizing `identity:get_project(project_id=19ff1600e760429b9e38b7ac11d31b62)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:04.247623 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13e87f-562e-468c-8d7d-c54639db2097 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:04.250045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 190/378] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:15:04 2022] GET /identity/v3/projects/19ff1600e760429b9e38b7ac11d31b62 => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:04.252124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41349571-a213-4c59-a936-5a80193c0b31 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:04.252407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41349571-a213-4c59-a936-5a80193c0b31 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:04.252678 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41349571-a213-4c59-a936-5a80193c0b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:04.273881 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:04.282039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-41349571-a213-4c59-a936-5a80193c0b31 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:04.289906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-41349571-a213-4c59-a936-5a80193c0b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:04.319218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daea3b-f69b-4cbc-9bd7-94c70922b3ed None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:04.372229 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a3220-9382-4732-a5f1-ae4438cbdec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:04.373271 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a3220-9382-4732-a5f1-ae4438cbdec8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:04.373769 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a3220-9382-4732-a5f1-ae4438cbdec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:04.374259 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a3220-9382-4732-a5f1-ae4438cbdec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:04.375386 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a3220-9382-4732-a5f1-ae4438cbdec8 None admin] RBAC: Adding query filter params (group.id=374da9c91ed74150aa588ae8f9850085, role.id=d73c76bc61c44f3a94e66397b0d9c359, scope.project.id=3b6f3b860bdb40de962e435fd234c802) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:04.375903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a3220-9382-4732-a5f1-ae4438cbdec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:04.377606 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a3220-9382-4732-a5f1-ae4438cbdec8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:04.386276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 189/379] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 20 19:15:04 2022] GET /identity/v3/role_assignments?group.id=374da9c91ed74150aa588ae8f9850085&scope.project.id=3b6f3b860bdb40de962e435fd234c802&role.id=d73c76bc61c44f3a94e66397b0d9c359 => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:04.387487 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a3220-9382-4732-a5f1-ae4438cbdec8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:04.414708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 191/380] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:04.459016 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41349571-a213-4c59-a936-5a80193c0b31 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:04.594062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:04.606450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a3220-9382-4732-a5f1-ae4438cbdec8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:04.651133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41349571-a213-4c59-a936-5a80193c0b31 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:04.669185 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d9185-8b25-47f5-baa2-c1440521b5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:04.670065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d9185-8b25-47f5-baa2-c1440521b5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:04.670343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d9185-8b25-47f5-baa2-c1440521b5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:04.670612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d9185-8b25-47f5-baa2-c1440521b5c3 None admin] PATH_INFO: `/v3/groups/0c22f66178db4f2692eed5d05b82156e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:04.678786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d9185-8b25-47f5-baa2-c1440521b5c3 None admin] RBAC: Authorizing `identity:get_group(group_id=0c22f66178db4f2692eed5d05b82156e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:04.680743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d9185-8b25-47f5-baa2-c1440521b5c3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:04.683576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 190/381] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 20 19:15:04 2022] GET /identity/v3/groups/0c22f66178db4f2692eed5d05b82156e => generated 229 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:04.690779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d9185-8b25-47f5-baa2-c1440521b5c3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:04.695662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:04.717713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e846b6-f8fd-4b0b-8982-07c09a872808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:04.718533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e846b6-f8fd-4b0b-8982-07c09a872808 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:04.718866 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e846b6-f8fd-4b0b-8982-07c09a872808 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:04.719138 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e846b6-f8fd-4b0b-8982-07c09a872808 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:04.747650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e846b6-f8fd-4b0b-8982-07c09a872808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-35e846b6-f8fd-4b0b-8982-07c09a872808 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:04.755595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:04.756515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:04.757381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:04.757381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:04.757381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:04.757381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:04.757381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:04.757381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:04.757381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:04.757381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:04.757381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:04.757381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:04.757381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:15:04.757381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:04.762873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 192/382] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:04.782463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e846b6-f8fd-4b0b-8982-07c09a872808 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:04.897590 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d9185-8b25-47f5-baa2-c1440521b5c3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:04.964847 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e846b6-f8fd-4b0b-8982-07c09a872808 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:04.999552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:05.009813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98f295-eb94-472d-b40c-93d213cdfbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:05.010593 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98f295-eb94-472d-b40c-93d213cdfbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:05.010902 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98f295-eb94-472d-b40c-93d213cdfbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:05.019666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98f295-eb94-472d-b40c-93d213cdfbd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:05.019666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98f295-eb94-472d-b40c-93d213cdfbd2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:05.019666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98f295-eb94-472d-b40c-93d213cdfbd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:05.019666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98f295-eb94-472d-b40c-93d213cdfbd2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:05.020010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba62d6-bc90-4e28-8f51-dfc6228201e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:05.020010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba62d6-bc90-4e28-8f51-dfc6228201e9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:05.020010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba62d6-bc90-4e28-8f51-dfc6228201e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:05.020010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba62d6-bc90-4e28-8f51-dfc6228201e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:05.020578 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba62d6-bc90-4e28-8f51-dfc6228201e9 None admin] RBAC: Adding query filter params (group.id=0c22f66178db4f2692eed5d05b82156e, role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=19ff1600e760429b9e38b7ac11d31b62) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:05.020888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba62d6-bc90-4e28-8f51-dfc6228201e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:05.022317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba62d6-bc90-4e28-8f51-dfc6228201e9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:05.042990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 191/384] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 20 19:15:04 2022] GET /identity/v3/role_assignments?group.id=0c22f66178db4f2692eed5d05b82156e&scope.project.id=19ff1600e760429b9e38b7ac11d31b62&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 260 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:05.043337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 193/384] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:15:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:05.044364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba62d6-bc90-4e28-8f51-dfc6228201e9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:05.143080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:05.189864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba62d6-bc90-4e28-8f51-dfc6228201e9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:05.239800 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd6ea1-3dea-47bb-8ad6-bb4f8cd0d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:05.240678 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd6ea1-3dea-47bb-8ad6-bb4f8cd0d555 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:05.240958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd6ea1-3dea-47bb-8ad6-bb4f8cd0d555 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:05.241844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd6ea1-3dea-47bb-8ad6-bb4f8cd0d555 None admin] PATH_INFO: `/v3/groups/374da9c91ed74150aa588ae8f9850085` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:05.247542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd6ea1-3dea-47bb-8ad6-bb4f8cd0d555 None admin] RBAC: Authorizing `identity:get_group(group_id=374da9c91ed74150aa588ae8f9850085)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:05.249036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd6ea1-3dea-47bb-8ad6-bb4f8cd0d555 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:05.251280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 192/385] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 20 19:15:05 2022] GET /identity/v3/groups/374da9c91ed74150aa588ae8f9850085 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:05.259827 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98f295-eb94-472d-b40c-93d213cdfbd2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:05.420133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98f295-eb94-472d-b40c-93d213cdfbd2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:05.467794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a6d93-a515-4f10-8fcd-1137e9c2e5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:05.469020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a6d93-a515-4f10-8fcd-1137e9c2e5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:05.469522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a6d93-a515-4f10-8fcd-1137e9c2e5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:05.469998 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a6d93-a515-4f10-8fcd-1137e9c2e5c3 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:05.475417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a6d93-a515-4f10-8fcd-1137e9c2e5c3 None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:05.477374 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a6d93-a515-4f10-8fcd-1137e9c2e5c3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:05.479381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 194/386] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:15:05 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:05.485548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd6ea1-3dea-47bb-8ad6-bb4f8cd0d555 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:05.636371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd6ea1-3dea-47bb-8ad6-bb4f8cd0d555 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:05.685583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70481f8-2076-47b4-8ccb-16d82b73e527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:05.687303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70481f8-2076-47b4-8ccb-16d82b73e527 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:05.687808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70481f8-2076-47b4-8ccb-16d82b73e527 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:05.688285 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70481f8-2076-47b4-8ccb-16d82b73e527 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d/groups/374da9c91ed74150aa588ae8f9850085/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:05.696202 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70481f8-2076-47b4-8ccb-16d82b73e527 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc870179720c49a5916bb6299e1ba91d, group_id=374da9c91ed74150aa588ae8f9850085, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:05.697966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70481f8-2076-47b4-8ccb-16d82b73e527 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:05.711106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:05.737588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4998db-ce75-4e4f-829d-9d10c4623163 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:05.738195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4998db-ce75-4e4f-829d-9d10c4623163 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:05.738709 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4998db-ce75-4e4f-829d-9d10c4623163 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:05.740743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 195/387] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:05.746565 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055f098-322b-4c67-8c14-ff373e308e90 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:05.746950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055f098-322b-4c67-8c14-ff373e308e90 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:05.747171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055f098-322b-4c67-8c14-ff373e308e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:05.767714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d055f098-322b-4c67-8c14-ff373e308e90 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:05.768932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d055f098-322b-4c67-8c14-ff373e308e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:05.791604 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 193/388] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jul 20 19:15:05 2022] PUT /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d/groups/374da9c91ed74150aa588ae8f9850085/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:15:05.851321 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:05.866086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 196/389] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:15:05.890813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70481f8-2076-47b4-8ccb-16d82b73e527 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:06.024013 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70481f8-2076-47b4-8ccb-16d82b73e527 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:06.062946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969628a7-45fe-4e5e-a374-5fb3f91fc3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:06.064093 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969628a7-45fe-4e5e-a374-5fb3f91fc3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:06.064377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969628a7-45fe-4e5e-a374-5fb3f91fc3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:06.064709 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969628a7-45fe-4e5e-a374-5fb3f91fc3d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:06.077543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969628a7-45fe-4e5e-a374-5fb3f91fc3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-969628a7-45fe-4e5e-a374-5fb3f91fc3d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:06.086695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:06.087618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:06.088452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:06.088452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:06.088452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:06.088452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:06.088452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:06.088452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:06.088452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:06.088452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:06.088452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:06.088452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:06.088452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:15:06.088452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:06.088452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 194/390] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:15:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:06.093756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055f098-322b-4c67-8c14-ff373e308e90 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:06.202412 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055f098-322b-4c67-8c14-ff373e308e90 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:06.239915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1cce8-449a-41ed-80a0-1837326baf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:06.240596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1cce8-449a-41ed-80a0-1837326baf04 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:06.240876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1cce8-449a-41ed-80a0-1837326baf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:06.241220 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1cce8-449a-41ed-80a0-1837326baf04 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:06.241983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1cce8-449a-41ed-80a0-1837326baf04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:06.242292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1cce8-449a-41ed-80a0-1837326baf04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:06.243790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1cce8-449a-41ed-80a0-1837326baf04 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:06.256323 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 197/391] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:06.262275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969628a7-45fe-4e5e-a374-5fb3f91fc3d9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:06.329032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:06.377348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969628a7-45fe-4e5e-a374-5fb3f91fc3d9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:06.407054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8d24f-c5ec-4f54-9dc4-3082e17fd7c5 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:06.407371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8d24f-c5ec-4f54-9dc4-3082e17fd7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:06.407609 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8d24f-c5ec-4f54-9dc4-3082e17fd7c5 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:06.410047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 198/392] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:06.417797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a18848-d6a6-4bfd-a891-5e70e3b45008 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:06.418302 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a18848-d6a6-4bfd-a891-5e70e3b45008 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:06.418800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a18848-d6a6-4bfd-a891-5e70e3b45008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:06.434369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac7276-cb13-40c2-be3c-888104748127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:06.435540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac7276-cb13-40c2-be3c-888104748127 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:06.435996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac7276-cb13-40c2-be3c-888104748127 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:06.436466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac7276-cb13-40c2-be3c-888104748127 None admin] PATH_INFO: `/v3/groups/374da9c91ed74150aa588ae8f9850085` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:06.437910 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac7276-cb13-40c2-be3c-888104748127 None admin] RBAC: Authorizing `identity:get_group(group_id=374da9c91ed74150aa588ae8f9850085)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:06.439941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac7276-cb13-40c2-be3c-888104748127 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:06.443565 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 195/393] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 20 19:15:06 2022] GET /identity/v3/groups/374da9c91ed74150aa588ae8f9850085 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:06.447629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac7276-cb13-40c2-be3c-888104748127 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:06.449478 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-19a18848-d6a6-4bfd-a891-5e70e3b45008 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:06.452736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-19a18848-d6a6-4bfd-a891-5e70e3b45008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:06.568264 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac7276-cb13-40c2-be3c-888104748127 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:06.578737 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:06.594489 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:06.609124 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2847d-04c0-462a-962b-df99481db0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:06.610520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2847d-04c0-462a-962b-df99481db0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:06.612088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2847d-04c0-462a-962b-df99481db0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:06.613225 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2847d-04c0-462a-962b-df99481db0e1 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:06.615187 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2847d-04c0-462a-962b-df99481db0e1 None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:06.617558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2847d-04c0-462a-962b-df99481db0e1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:06.620816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 196/394] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:15:06 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:06.623204 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 199/395] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:15:06.627863 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2847d-04c0-462a-962b-df99481db0e1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:06.686488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a18848-d6a6-4bfd-a891-5e70e3b45008 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:06.763801 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2847d-04c0-462a-962b-df99481db0e1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:06.800907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27d3e7-5b5c-41d3-a1ea-45af472f90fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:06.802075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27d3e7-5b5c-41d3-a1ea-45af472f90fa None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:06.802502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27d3e7-5b5c-41d3-a1ea-45af472f90fa None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:06.802992 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27d3e7-5b5c-41d3-a1ea-45af472f90fa None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d/groups/374da9c91ed74150aa588ae8f9850085/roles/d73c76bc61c44f3a94e66397b0d9c359` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:06.805955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27d3e7-5b5c-41d3-a1ea-45af472f90fa None admin] RBAC: Authorizing `identity:create_grant(project_id=dc870179720c49a5916bb6299e1ba91d, group_id=374da9c91ed74150aa588ae8f9850085, role_id=d73c76bc61c44f3a94e66397b0d9c359)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:06.807728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27d3e7-5b5c-41d3-a1ea-45af472f90fa None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:06.860242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a18848-d6a6-4bfd-a891-5e70e3b45008 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:06.885094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 197/396] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jul 20 19:15:06 2022] PUT /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d/groups/374da9c91ed74150aa588ae8f9850085/roles/d73c76bc61c44f3a94e66397b0d9c359 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:15:06.917480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9763b59-00dc-4ea4-b8b1-1764ed5c737d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:06.918587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9763b59-00dc-4ea4-b8b1-1764ed5c737d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:06.919045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9763b59-00dc-4ea4-b8b1-1764ed5c737d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:06.919477 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9763b59-00dc-4ea4-b8b1-1764ed5c737d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:06.931920 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9763b59-00dc-4ea4-b8b1-1764ed5c737d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f9763b59-00dc-4ea4-b8b1-1764ed5c737d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:06.940586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:06.941702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:06.942779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:06.942779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:06.942779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:06.942779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:06.942779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:06.942779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:06.942779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:06.942779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:06.942779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:06.942779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:06.942779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:15:06.942779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:06.945259 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 200/397] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:06.951031 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27d3e7-5b5c-41d3-a1ea-45af472f90fa None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:07.055689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:07.118726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27d3e7-5b5c-41d3-a1ea-45af472f90fa None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:07.128202 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ac2e2-cc94-404b-abd4-da93328cc0bb None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:07.132170 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ac2e2-cc94-404b-abd4-da93328cc0bb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:07.132170 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ac2e2-cc94-404b-abd4-da93328cc0bb None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:07.132170 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 201/398] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:15:07.136556 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d6ed3-3508-45c9-a351-f853f6ab2b83 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:07.136839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d6ed3-3508-45c9-a351-f853f6ab2b83 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:07.137115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d6ed3-3508-45c9-a351-f853f6ab2b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:07.161394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-320d6ed3-3508-45c9-a351-f853f6ab2b83 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:07.163514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-320d6ed3-3508-45c9-a351-f853f6ab2b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:07.166315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7dbb2-9746-4d81-b683-a3970c81be37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:07.167095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7dbb2-9746-4d81-b683-a3970c81be37 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:07.167380 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7dbb2-9746-4d81-b683-a3970c81be37 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:07.167658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7dbb2-9746-4d81-b683-a3970c81be37 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:07.168414 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7dbb2-9746-4d81-b683-a3970c81be37 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:07.169137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7dbb2-9746-4d81-b683-a3970c81be37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:07.171677 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7dbb2-9746-4d81-b683-a3970c81be37 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:07.186050 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 198/399] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:15:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:07.187327 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7dbb2-9746-4d81-b683-a3970c81be37 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:07.251190 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:07.306001 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7dbb2-9746-4d81-b683-a3970c81be37 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:07.321491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:07.324388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 202/400] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:15:07.349940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cfab5-66d3-46c1-8005-dc76bbcdfadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:07.350141 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d6ed3-3508-45c9-a351-f853f6ab2b83 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:07.351463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cfab5-66d3-46c1-8005-dc76bbcdfadc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:07.351811 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cfab5-66d3-46c1-8005-dc76bbcdfadc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:07.352027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cfab5-66d3-46c1-8005-dc76bbcdfadc None admin] PATH_INFO: `/v3/groups/374da9c91ed74150aa588ae8f9850085` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:07.354432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262cfab5-66d3-46c1-8005-dc76bbcdfadc None admin] RBAC: Authorizing `identity:get_group(group_id=374da9c91ed74150aa588ae8f9850085)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:07.358734 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262cfab5-66d3-46c1-8005-dc76bbcdfadc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:07.362090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 199/401] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 20 19:15:07 2022] GET /identity/v3/groups/374da9c91ed74150aa588ae8f9850085 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:07.366719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cfab5-66d3-46c1-8005-dc76bbcdfadc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:07.493242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d6ed3-3508-45c9-a351-f853f6ab2b83 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:07.540427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cfab5-66d3-46c1-8005-dc76bbcdfadc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:07.555376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae195a-d070-4709-a211-aff47902ca25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:07.556500 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae195a-d070-4709-a211-aff47902ca25 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:07.556966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae195a-d070-4709-a211-aff47902ca25 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:07.557458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae195a-d070-4709-a211-aff47902ca25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:07.577010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae195a-d070-4709-a211-aff47902ca25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:07.585419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d9ce9-5660-4071-a47a-15f1bb21fb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:07.586504 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d9ce9-5660-4071-a47a-15f1bb21fb47 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:07.586812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d9ce9-5660-4071-a47a-15f1bb21fb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:07.587088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d9ce9-5660-4071-a47a-15f1bb21fb47 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f7ae195a-d070-4709-a211-aff47902ca25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:07.590023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:07.590934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:07.591755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:07.591755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:07.591755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:07.591755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:07.591755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:07.591755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:07.591755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:07.591755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:07.591755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:07.591755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:07.591755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:15:07.591755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:07.593154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d9ce9-5660-4071-a47a-15f1bb21fb47 None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:07.593154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d9ce9-5660-4071-a47a-15f1bb21fb47 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:07.595042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 200/403] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:15:07 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:07.595254 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 203/403] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:15:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:07.605936 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d9ce9-5660-4071-a47a-15f1bb21fb47 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:07.607231 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae195a-d070-4709-a211-aff47902ca25 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:07.679150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:07.705405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:07.757200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d9ce9-5660-4071-a47a-15f1bb21fb47 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:07.797494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae195a-d070-4709-a211-aff47902ca25 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:07.829698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244df375-2617-4c62-a432-bef9eedd0242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:07.830377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244df375-2617-4c62-a432-bef9eedd0242 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:07.830660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244df375-2617-4c62-a432-bef9eedd0242 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:07.830955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244df375-2617-4c62-a432-bef9eedd0242 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:07.831713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244df375-2617-4c62-a432-bef9eedd0242 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:07.832013 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244df375-2617-4c62-a432-bef9eedd0242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:07.833401 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244df375-2617-4c62-a432-bef9eedd0242 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:07.851488 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 201/404] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:07.853853 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778272d4-206e-4d6a-861d-089d49d90d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:07.854763 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778272d4-206e-4d6a-861d-089d49d90d3b None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:07.855047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778272d4-206e-4d6a-861d-089d49d90d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:07.855324 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778272d4-206e-4d6a-861d-089d49d90d3b None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802/groups/374da9c91ed74150aa588ae8f9850085/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:07.856041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244df375-2617-4c62-a432-bef9eedd0242 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:07.857488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778272d4-206e-4d6a-861d-089d49d90d3b None admin] RBAC: Authorizing `identity:create_grant(project_id=3b6f3b860bdb40de962e435fd234c802, group_id=374da9c91ed74150aa588ae8f9850085, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:07.858996 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778272d4-206e-4d6a-861d-089d49d90d3b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:07.972277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244df375-2617-4c62-a432-bef9eedd0242 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:07.985253 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 204/405] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jul 20 19:15:07 2022] PUT /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802/groups/374da9c91ed74150aa588ae8f9850085/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:15:07.996029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:08.022208 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66b5f6-5b26-4377-b393-9dc27d82522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:08.023933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66b5f6-5b26-4377-b393-9dc27d82522e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:08.024413 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66b5f6-5b26-4377-b393-9dc27d82522e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:08.024832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66b5f6-5b26-4377-b393-9dc27d82522e None admin] PATH_INFO: `/v3/groups/374da9c91ed74150aa588ae8f9850085` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:08.026433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66b5f6-5b26-4377-b393-9dc27d82522e None admin] RBAC: Authorizing `identity:get_group(group_id=374da9c91ed74150aa588ae8f9850085)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:08.030880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66b5f6-5b26-4377-b393-9dc27d82522e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:08.030880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 202/406] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 20 19:15:07 2022] GET /identity/v3/groups/374da9c91ed74150aa588ae8f9850085 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:08.035684 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778272d4-206e-4d6a-861d-089d49d90d3b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:08.066141 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131aeb0-1ac3-444b-823f-135489b8f936 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:08.066656 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131aeb0-1ac3-444b-823f-135489b8f936 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:08.067127 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131aeb0-1ac3-444b-823f-135489b8f936 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:08.069025 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 203/407] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:08.074504 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1050d30-79bc-45a9-a144-67319641960c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:08.075079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1050d30-79bc-45a9-a144-67319641960c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:08.075504 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1050d30-79bc-45a9-a144-67319641960c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:08.099469 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f1050d30-79bc-45a9-a144-67319641960c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:08.106703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f1050d30-79bc-45a9-a144-67319641960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:08.155346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:08.164094 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778272d4-206e-4d6a-861d-089d49d90d3b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:08.205928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077895e-83da-4f6d-b7ee-1645d3de4723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:08.210729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077895e-83da-4f6d-b7ee-1645d3de4723 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:08.210729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077895e-83da-4f6d-b7ee-1645d3de4723 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:08.210729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077895e-83da-4f6d-b7ee-1645d3de4723 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:08.212283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077895e-83da-4f6d-b7ee-1645d3de4723 None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:08.215376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077895e-83da-4f6d-b7ee-1645d3de4723 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:08.219819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 205/408] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:15:08 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:08.226146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077895e-83da-4f6d-b7ee-1645d3de4723 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:08.267609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 204/409] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:08.293416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1050d30-79bc-45a9-a144-67319641960c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:08.353421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077895e-83da-4f6d-b7ee-1645d3de4723 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:08.391166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7308f4f-76fd-4737-9ad7-6ea655ab3089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:08.392150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7308f4f-76fd-4737-9ad7-6ea655ab3089 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:08.392435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7308f4f-76fd-4737-9ad7-6ea655ab3089 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:08.392709 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7308f4f-76fd-4737-9ad7-6ea655ab3089 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802/groups/374da9c91ed74150aa588ae8f9850085/roles/d73c76bc61c44f3a94e66397b0d9c359` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:08.395022 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7308f4f-76fd-4737-9ad7-6ea655ab3089 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b6f3b860bdb40de962e435fd234c802, group_id=374da9c91ed74150aa588ae8f9850085, role_id=d73c76bc61c44f3a94e66397b0d9c359)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:08.396477 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7308f4f-76fd-4737-9ad7-6ea655ab3089 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:08.447166 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1050d30-79bc-45a9-a144-67319641960c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:08.458363 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:08.474024 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 206/410] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jul 20 19:15:08 2022] PUT /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802/groups/374da9c91ed74150aa588ae8f9850085/roles/d73c76bc61c44f3a94e66397b0d9c359 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:15:08.485547 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6546022-9ebb-4624-95d2-0f20b8264730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:08.486426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6546022-9ebb-4624-95d2-0f20b8264730 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:08.486734 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6546022-9ebb-4624-95d2-0f20b8264730 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:08.487012 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6546022-9ebb-4624-95d2-0f20b8264730 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:08.500689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6546022-9ebb-4624-95d2-0f20b8264730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c6546022-9ebb-4624-95d2-0f20b8264730 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:08.511268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:08.512192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:08.512977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:08.512977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:08.512977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:08.512977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:08.512977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:08.512977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:08.512977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:08.512977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:08.512977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:08.512977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:08.512977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:08.512977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:08.513886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 205/411] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:15:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:08.521148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7308f4f-76fd-4737-9ad7-6ea655ab3089 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:08.570341 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:08.597225 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f287eef-22a6-4dce-b6a1-abb762e8aad8 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:08.597225 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f287eef-22a6-4dce-b6a1-abb762e8aad8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:08.597225 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f287eef-22a6-4dce-b6a1-abb762e8aad8 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:08.599131 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 206/412] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:15:08.610022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532d936-5f83-4741-b95f-d43f0eca5414 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:08.610343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532d936-5f83-4741-b95f-d43f0eca5414 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:08.610581 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532d936-5f83-4741-b95f-d43f0eca5414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:08.629270 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8532d936-5f83-4741-b95f-d43f0eca5414 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:08.630494 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8532d936-5f83-4741-b95f-d43f0eca5414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:08.709193 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 207/413] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:15:08.725022 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7308f4f-76fd-4737-9ad7-6ea655ab3089 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:08.736291 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532d936-5f83-4741-b95f-d43f0eca5414 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:08.763944 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1559510-3088-455a-a441-51d232820a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:08.765080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1559510-3088-455a-a441-51d232820a26 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:08.765610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1559510-3088-455a-a441-51d232820a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:08.766082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1559510-3088-455a-a441-51d232820a26 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:08.767070 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1559510-3088-455a-a441-51d232820a26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:08.767660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1559510-3088-455a-a441-51d232820a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:08.769367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1559510-3088-455a-a441-51d232820a26 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:08.786386 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 207/414] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:08.788134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1559510-3088-455a-a441-51d232820a26 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:08.878300 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:08.882196 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532d936-5f83-4741-b95f-d43f0eca5414 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:08.900420 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:08.915055 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1559510-3088-455a-a441-51d232820a26 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:08.940689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf15c6e-fae5-49de-930b-955ef4f052bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:08.941907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf15c6e-fae5-49de-930b-955ef4f052bf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:08.942199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf15c6e-fae5-49de-930b-955ef4f052bf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:08.942478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf15c6e-fae5-49de-930b-955ef4f052bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:08.955579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf15c6e-fae5-49de-930b-955ef4f052bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-faf15c6e-fae5-49de-930b-955ef4f052bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:08.964715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:08.965657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:08.966928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:08.966928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:08.966928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:08.966928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:08.966928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:08.966928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:08.966928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:08.966928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:08.966928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:08.966928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:08.966928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:15:08.966928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:08.966928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 208/415] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:08.972408 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf15c6e-fae5-49de-930b-955ef4f052bf None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:09.027396 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f606b76-1c45-46f7-b3d6-a8ccc1011950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:09.028949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606b76-1c45-46f7-b3d6-a8ccc1011950 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:09.029433 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606b76-1c45-46f7-b3d6-a8ccc1011950 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:09.029899 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606b76-1c45-46f7-b3d6-a8ccc1011950 None admin] PATH_INFO: `/v3/groups/0c22f66178db4f2692eed5d05b82156e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:09.035426 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f606b76-1c45-46f7-b3d6-a8ccc1011950 None admin] RBAC: Authorizing `identity:get_group(group_id=0c22f66178db4f2692eed5d05b82156e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:09.037260 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f606b76-1c45-46f7-b3d6-a8ccc1011950 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:09.040399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 208/416] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 20 19:15:08 2022] GET /identity/v3/groups/0c22f66178db4f2692eed5d05b82156e => generated 229 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:09.046122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f606b76-1c45-46f7-b3d6-a8ccc1011950 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:09.093122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf15c6e-fae5-49de-930b-955ef4f052bf None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:09.136020 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57cc25-202e-488b-8db2-3e5fb7c9dd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:09.136694 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57cc25-202e-488b-8db2-3e5fb7c9dd2f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:09.136980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57cc25-202e-488b-8db2-3e5fb7c9dd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:09.137259 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57cc25-202e-488b-8db2-3e5fb7c9dd2f None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:09.138070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57cc25-202e-488b-8db2-3e5fb7c9dd2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:09.138379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57cc25-202e-488b-8db2-3e5fb7c9dd2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:09.139783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57cc25-202e-488b-8db2-3e5fb7c9dd2f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:09.150787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 209/417] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:15:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:09.156530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57cc25-202e-488b-8db2-3e5fb7c9dd2f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:09.186246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:09.265436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f606b76-1c45-46f7-b3d6-a8ccc1011950 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:09.287510 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57cc25-202e-488b-8db2-3e5fb7c9dd2f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:09.312058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2bd7-e3b9-4386-a036-64b0bedd5ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:09.313197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2bd7-e3b9-4386-a036-64b0bedd5ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:09.313788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2bd7-e3b9-4386-a036-64b0bedd5ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:09.314063 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2bd7-e3b9-4386-a036-64b0bedd5ed6 None admin] PATH_INFO: `/v3/projects/19ff1600e760429b9e38b7ac11d31b62` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:09.315508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c2bd7-e3b9-4386-a036-64b0bedd5ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=19ff1600e760429b9e38b7ac11d31b62)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:09.317536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c2bd7-e3b9-4386-a036-64b0bedd5ed6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:09.320461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 209/418] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:15:09 2022] GET /identity/v3/projects/19ff1600e760429b9e38b7ac11d31b62 => generated 344 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:09.322210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74665c-e056-4ce3-b0e7-e111c65b3f46 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:09.322519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74665c-e056-4ce3-b0e7-e111c65b3f46 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:09.322843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74665c-e056-4ce3-b0e7-e111c65b3f46 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:09.327529 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822534c5-8a4c-40b7-8253-120d590d7172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:09.328448 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822534c5-8a4c-40b7-8253-120d590d7172 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:09.328623 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 210/419] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:09.329095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822534c5-8a4c-40b7-8253-120d590d7172 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:09.329541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822534c5-8a4c-40b7-8253-120d590d7172 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:09.329649 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74665c-e056-4ce3-b0e7-e111c65b3f46 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:09.359183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:09.407720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822534c5-8a4c-40b7-8253-120d590d7172 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:09.409848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822534c5-8a4c-40b7-8253-120d590d7172 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:09.438029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:09.467669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74665c-e056-4ce3-b0e7-e111c65b3f46 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:09.508052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219a5ea-b249-45ef-a1be-8bc97bb8eca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:09.509439 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219a5ea-b249-45ef-a1be-8bc97bb8eca3 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:09.509998 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219a5ea-b249-45ef-a1be-8bc97bb8eca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:09.510482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219a5ea-b249-45ef-a1be-8bc97bb8eca3 None admin] PATH_INFO: `/v3/projects/19ff1600e760429b9e38b7ac11d31b62/groups/0c22f66178db4f2692eed5d05b82156e/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:09.512771 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219a5ea-b249-45ef-a1be-8bc97bb8eca3 None admin] RBAC: Authorizing `identity:create_grant(project_id=19ff1600e760429b9e38b7ac11d31b62, group_id=0c22f66178db4f2692eed5d05b82156e, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:09.514661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219a5ea-b249-45ef-a1be-8bc97bb8eca3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:09.539302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 210/420] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:15:09.540892 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb991724-c339-474f-b6a1-fdd0999e9c51 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:09.541428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb991724-c339-474f-b6a1-fdd0999e9c51 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:09.541908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb991724-c339-474f-b6a1-fdd0999e9c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:09.560010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-fb991724-c339-474f-b6a1-fdd0999e9c51 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:09.561417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fb991724-c339-474f-b6a1-fdd0999e9c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:09.629450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 211/421] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jul 20 19:15:09 2022] PUT /identity/v3/projects/19ff1600e760429b9e38b7ac11d31b62/groups/0c22f66178db4f2692eed5d05b82156e/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:15:09.629450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219a5ea-b249-45ef-a1be-8bc97bb8eca3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:09.672711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 211/422] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:09.716287 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb991724-c339-474f-b6a1-fdd0999e9c51 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:09.786145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:09.815129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:09.828425 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219a5ea-b249-45ef-a1be-8bc97bb8eca3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:09.873074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb991724-c339-474f-b6a1-fdd0999e9c51 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:09.874389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dd549-3e21-4c93-88d1-3c40e0a7b14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:09.875445 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dd549-3e21-4c93-88d1-3c40e0a7b14e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:09.875935 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dd549-3e21-4c93-88d1-3c40e0a7b14e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:09.876210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dd549-3e21-4c93-88d1-3c40e0a7b14e None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:09.878500 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dd549-3e21-4c93-88d1-3c40e0a7b14e None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:09.880036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dd549-3e21-4c93-88d1-3c40e0a7b14e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:09.882742 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 212/423] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:15:09 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:09.888158 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dd549-3e21-4c93-88d1-3c40e0a7b14e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:09.921566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681c563-8e94-4aaa-b780-3263613b2289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:09.922464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681c563-8e94-4aaa-b780-3263613b2289 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:09.922895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681c563-8e94-4aaa-b780-3263613b2289 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:09.923173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681c563-8e94-4aaa-b780-3263613b2289 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:09.936962 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681c563-8e94-4aaa-b780-3263613b2289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-6681c563-8e94-4aaa-b780-3263613b2289 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:09.948629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:09.949587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:09.950375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:09.950375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:09.950375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:09.950375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:09.950375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:09.950375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:09.950375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:09.950375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:09.950375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:09.950375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:09.950375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:15:09.950375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:09.950375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 212/424] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:15:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:09.956060 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681c563-8e94-4aaa-b780-3263613b2289 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:10.025878 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dd549-3e21-4c93-88d1-3c40e0a7b14e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:10.066498 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc6689-3310-4d8d-b4ea-8d2a15523589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:10.068708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc6689-3310-4d8d-b4ea-8d2a15523589 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:10.069340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc6689-3310-4d8d-b4ea-8d2a15523589 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:10.069785 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc6689-3310-4d8d-b4ea-8d2a15523589 None admin] PATH_INFO: `/v3/groups/374da9c91ed74150aa588ae8f9850085` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:10.071293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc6689-3310-4d8d-b4ea-8d2a15523589 None admin] RBAC: Authorizing `identity:get_group(group_id=374da9c91ed74150aa588ae8f9850085)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:10.073201 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc6689-3310-4d8d-b4ea-8d2a15523589 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:10.075406 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 213/425] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 20 19:15:09 2022] GET /identity/v3/groups/374da9c91ed74150aa588ae8f9850085 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:10.080929 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc6689-3310-4d8d-b4ea-8d2a15523589 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:10.102755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:10.152296 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681c563-8e94-4aaa-b780-3263613b2289 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:10.177765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:10.221425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8456119-6e80-469e-9f0c-facdb20c11b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:10.222103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8456119-6e80-469e-9f0c-facdb20c11b2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:10.222380 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8456119-6e80-469e-9f0c-facdb20c11b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:10.222652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8456119-6e80-469e-9f0c-facdb20c11b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:10.223434 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8456119-6e80-469e-9f0c-facdb20c11b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:10.223736 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8456119-6e80-469e-9f0c-facdb20c11b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:10.225161 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8456119-6e80-469e-9f0c-facdb20c11b2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:10.238612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 213/426] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:10.244406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8456119-6e80-469e-9f0c-facdb20c11b2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:10.270911 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc6689-3310-4d8d-b4ea-8d2a15523589 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:10.312175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d707d38-4cef-4b01-8d0c-b8a2592b067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:10.313209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d707d38-4cef-4b01-8d0c-b8a2592b067f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:10.313967 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d707d38-4cef-4b01-8d0c-b8a2592b067f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:10.314429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d707d38-4cef-4b01-8d0c-b8a2592b067f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:10.318540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d707d38-4cef-4b01-8d0c-b8a2592b067f None admin] RBAC: Adding query filter params (group.id=374da9c91ed74150aa588ae8f9850085, role.id=9b386d2d84ef4d3b9f9401c95f06c53b, scope.project.id=dc870179720c49a5916bb6299e1ba91d) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:10.320570 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d707d38-4cef-4b01-8d0c-b8a2592b067f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:10.326463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d707d38-4cef-4b01-8d0c-b8a2592b067f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:10.338016 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 214/427] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 20 19:15:10 2022] GET /identity/v3/role_assignments?group.id=374da9c91ed74150aa588ae8f9850085&scope.project.id=dc870179720c49a5916bb6299e1ba91d&role.id=9b386d2d84ef4d3b9f9401c95f06c53b => generated 611 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:10.440620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8456119-6e80-469e-9f0c-facdb20c11b2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:10.510197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01997c-4943-4212-91e7-64cf81ed2381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:10.511343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01997c-4943-4212-91e7-64cf81ed2381 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:10.511930 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01997c-4943-4212-91e7-64cf81ed2381 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:10.512424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01997c-4943-4212-91e7-64cf81ed2381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:10.568480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:10.598481 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01997c-4943-4212-91e7-64cf81ed2381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:10.600368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01997c-4943-4212-91e7-64cf81ed2381 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:10.614135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784278d2-e56a-4bd8-b34a-141479e5c965 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:10.614438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784278d2-e56a-4bd8-b34a-141479e5c965 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:10.615083 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784278d2-e56a-4bd8-b34a-141479e5c965 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:10.617010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 215/428] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:15:10.622568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0e784-30fb-4c8d-970c-330a6e27678b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:10.622914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0e784-30fb-4c8d-970c-330a6e27678b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:10.623193 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0e784-30fb-4c8d-970c-330a6e27678b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:10.653800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-eaa0e784-30fb-4c8d-970c-330a6e27678b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:10.655432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eaa0e784-30fb-4c8d-970c-330a6e27678b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:10.745451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 216/429] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:10.758592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 214/430] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:10.764610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0e784-30fb-4c8d-970c-330a6e27678b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:10.777866 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:10.784308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01997c-4943-4212-91e7-64cf81ed2381 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:10.892351 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:10.910602 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0e784-30fb-4c8d-970c-330a6e27678b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:10.923304 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01997c-4943-4212-91e7-64cf81ed2381 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:10.951317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a010770-1751-435e-9c40-06809771b3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:10.952474 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a010770-1751-435e-9c40-06809771b3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:10.952900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a010770-1751-435e-9c40-06809771b3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:10.953081 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a010770-1751-435e-9c40-06809771b3d4 None admin] PATH_INFO: `/v3/projects/dc870179720c49a5916bb6299e1ba91d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:10.954460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a010770-1751-435e-9c40-06809771b3d4 None admin] RBAC: Authorizing `identity:get_project(project_id=dc870179720c49a5916bb6299e1ba91d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:10.956035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a010770-1751-435e-9c40-06809771b3d4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:10.958135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 217/431] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:15:10 2022] GET /identity/v3/projects/dc870179720c49a5916bb6299e1ba91d => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:10.968125 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a010770-1751-435e-9c40-06809771b3d4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:10.973311 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc52045-756d-4e95-8dd8-70153911909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:10.974446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52045-756d-4e95-8dd8-70153911909a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:10.975041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52045-756d-4e95-8dd8-70153911909a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:10.975534 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52045-756d-4e95-8dd8-70153911909a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:10.988538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc52045-756d-4e95-8dd8-70153911909a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-8bc52045-756d-4e95-8dd8-70153911909a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:10.998308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:10.999276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:11.000108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:11.000108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:11.000108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:11.000108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:11.000108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:11.000108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:11.000108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:11.000108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:11.000108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:11.000108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:11.000108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:15:11.000108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:11.002925 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 215/432] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:11.004456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0ad5e-40a6-44ed-9f6d-08760c7a8d0b None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:11.004944 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0ad5e-40a6-44ed-9f6d-08760c7a8d0b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:11.005463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0ad5e-40a6-44ed-9f6d-08760c7a8d0b None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:11.007928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 216/433] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:11.016219 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac94b9-6ee4-4400-a17f-c34d5e511b9a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:11.016816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac94b9-6ee4-4400-a17f-c34d5e511b9a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:11.017284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac94b9-6ee4-4400-a17f-c34d5e511b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:11.037345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-14ac94b9-6ee4-4400-a17f-c34d5e511b9a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:11.039676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-14ac94b9-6ee4-4400-a17f-c34d5e511b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:11.078374 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:11.105776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a010770-1751-435e-9c40-06809771b3d4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:11.141736 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 217/434] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:11.142977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac94b9-6ee4-4400-a17f-c34d5e511b9a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:11.172265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c76103-d236-4433-a337-8b12550fbad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:11.173266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c76103-d236-4433-a337-8b12550fbad2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:11.173542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c76103-d236-4433-a337-8b12550fbad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:11.173898 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c76103-d236-4433-a337-8b12550fbad2 None admin] PATH_INFO: `/v3/groups/374da9c91ed74150aa588ae8f9850085` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:11.175610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c76103-d236-4433-a337-8b12550fbad2 None admin] RBAC: Authorizing `identity:get_group(group_id=374da9c91ed74150aa588ae8f9850085)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:11.177082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c76103-d236-4433-a337-8b12550fbad2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:11.180395 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 218/435] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 20 19:15:10 2022] GET /identity/v3/groups/374da9c91ed74150aa588ae8f9850085 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:11.182314 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c76103-d236-4433-a337-8b12550fbad2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:11.220543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:11.263326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac94b9-6ee4-4400-a17f-c34d5e511b9a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:11.300384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c76103-d236-4433-a337-8b12550fbad2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:11.308177 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e436e3-2d48-4df4-a087-8f667c63f4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:11.309172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e436e3-2d48-4df4-a087-8f667c63f4fa None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:11.309589 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e436e3-2d48-4df4-a087-8f667c63f4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:11.310105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e436e3-2d48-4df4-a087-8f667c63f4fa None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:11.311215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e436e3-2d48-4df4-a087-8f667c63f4fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:11.311657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e436e3-2d48-4df4-a087-8f667c63f4fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:11.313548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e436e3-2d48-4df4-a087-8f667c63f4fa None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:11.323642 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 218/436] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:15:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:11.324713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e436e3-2d48-4df4-a087-8f667c63f4fa None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:11.346621 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16843b3f-d536-4c45-8498-846a2cef47e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:11.347461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16843b3f-d536-4c45-8498-846a2cef47e2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:11.347733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16843b3f-d536-4c45-8498-846a2cef47e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:11.348003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16843b3f-d536-4c45-8498-846a2cef47e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:11.359574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16843b3f-d536-4c45-8498-846a2cef47e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-16843b3f-d536-4c45-8498-846a2cef47e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:11.368550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:11.369634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:11.370589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:11.370589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:11.370589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:11.370589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:11.370589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:11.370589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:11.370589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:11.370589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:11.370589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:11.370589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:11.370589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:15:11.370589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:11.370589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 219/437] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:15:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:11.370589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16843b3f-d536-4c45-8498-846a2cef47e2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:11.383426 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:11.468350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e436e3-2d48-4df4-a087-8f667c63f4fa None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:11.504118 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:11.509726 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16843b3f-d536-4c45-8498-846a2cef47e2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:11.516317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c7f0b-2c3e-4a48-94d7-a6333effb260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:11.516913 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c7f0b-2c3e-4a48-94d7-a6333effb260 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:11.517194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c7f0b-2c3e-4a48-94d7-a6333effb260 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:11.517466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c7f0b-2c3e-4a48-94d7-a6333effb260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:11.518538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c7f0b-2c3e-4a48-94d7-a6333effb260 None admin] RBAC: Adding query filter params (group.id=374da9c91ed74150aa588ae8f9850085, role.id=d73c76bc61c44f3a94e66397b0d9c359, scope.project.id=dc870179720c49a5916bb6299e1ba91d) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:11.518882 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c7f0b-2c3e-4a48-94d7-a6333effb260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:11.520331 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c7f0b-2c3e-4a48-94d7-a6333effb260 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:11.531868 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 219/438] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 20 19:15:11 2022] GET /identity/v3/role_assignments?group.id=374da9c91ed74150aa588ae8f9850085&scope.project.id=dc870179720c49a5916bb6299e1ba91d&role.id=d73c76bc61c44f3a94e66397b0d9c359 => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:11.532957 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c7f0b-2c3e-4a48-94d7-a6333effb260 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:11.576735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d65f07-5b5d-4ad2-bfd0-b693bae79581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:11.578328 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d65f07-5b5d-4ad2-bfd0-b693bae79581 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:11.579154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d65f07-5b5d-4ad2-bfd0-b693bae79581 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:11.579968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d65f07-5b5d-4ad2-bfd0-b693bae79581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:11.654378 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c7f0b-2c3e-4a48-94d7-a6333effb260 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:11.695273 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba72164-14dd-4292-b544-25417f66327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:11.695964 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba72164-14dd-4292-b544-25417f66327f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:11.696243 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba72164-14dd-4292-b544-25417f66327f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:11.696502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba72164-14dd-4292-b544-25417f66327f None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:11.697268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba72164-14dd-4292-b544-25417f66327f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:11.697568 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba72164-14dd-4292-b544-25417f66327f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:11.699110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba72164-14dd-4292-b544-25417f66327f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:11.710140 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 220/439] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:11.717653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba72164-14dd-4292-b544-25417f66327f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:11.725799 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d65f07-5b5d-4ad2-bfd0-b693bae79581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:11.728996 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d65f07-5b5d-4ad2-bfd0-b693bae79581 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:11.744561 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:11.791978 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:11.862248 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba72164-14dd-4292-b544-25417f66327f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:11.901186 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 220/440] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:11.907212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d65f07-5b5d-4ad2-bfd0-b693bae79581 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:11.919966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538c670-33a9-45d5-9e06-d95f115d3012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:11.920629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538c670-33a9-45d5-9e06-d95f115d3012 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:11.920926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538c670-33a9-45d5-9e06-d95f115d3012 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:11.921190 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538c670-33a9-45d5-9e06-d95f115d3012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:12.017756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538c670-33a9-45d5-9e06-d95f115d3012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:12.019291 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538c670-33a9-45d5-9e06-d95f115d3012 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:12.054330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d65f07-5b5d-4ad2-bfd0-b693bae79581 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:12.064407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:12.090408 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:12.093225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2c29f-9a44-489a-88c4-48c55172fb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:12.094099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2c29f-9a44-489a-88c4-48c55172fb7d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:12.094376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2c29f-9a44-489a-88c4-48c55172fb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:12.094652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2c29f-9a44-489a-88c4-48c55172fb7d None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:12.095981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2c29f-9a44-489a-88c4-48c55172fb7d None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:12.097517 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2c29f-9a44-489a-88c4-48c55172fb7d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:12.099510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 221/441] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:15:11 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:12.105756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2c29f-9a44-489a-88c4-48c55172fb7d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:12.141980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 221/442] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:15:12.143460 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa642525-9978-44ce-811f-2a69cd44a0ad None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:12.144525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa642525-9978-44ce-811f-2a69cd44a0ad None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:12.144803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa642525-9978-44ce-811f-2a69cd44a0ad None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:12.146589 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 222/443] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:12.147846 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa642525-9978-44ce-811f-2a69cd44a0ad None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:12.208852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2c29f-9a44-489a-88c4-48c55172fb7d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:12.246727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548f2bc-0a09-477f-9a33-45c0bc6c2675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:12.247587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548f2bc-0a09-477f-9a33-45c0bc6c2675 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:12.247862 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548f2bc-0a09-477f-9a33-45c0bc6c2675 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:12.248184 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548f2bc-0a09-477f-9a33-45c0bc6c2675 None admin] PATH_INFO: `/v3/groups/374da9c91ed74150aa588ae8f9850085` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:12.249402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548f2bc-0a09-477f-9a33-45c0bc6c2675 None admin] RBAC: Authorizing `identity:get_group(group_id=374da9c91ed74150aa588ae8f9850085)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:12.250920 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548f2bc-0a09-477f-9a33-45c0bc6c2675 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:12.252574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 222/444] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 20 19:15:12 2022] GET /identity/v3/groups/374da9c91ed74150aa588ae8f9850085 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:12.253754 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35830b5-e7f7-42ab-ac45-b0c962cd10f1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:12.253987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35830b5-e7f7-42ab-ac45-b0c962cd10f1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:12.254253 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35830b5-e7f7-42ab-ac45-b0c962cd10f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:12.258813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa642525-9978-44ce-811f-2a69cd44a0ad None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:12.271372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e35830b5-e7f7-42ab-ac45-b0c962cd10f1 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:12.273433 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e35830b5-e7f7-42ab-ac45-b0c962cd10f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:12.299796 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fe276-5cb0-4ae9-991d-43689704d162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:12.300659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fe276-5cb0-4ae9-991d-43689704d162 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:12.300939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fe276-5cb0-4ae9-991d-43689704d162 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:12.301207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fe276-5cb0-4ae9-991d-43689704d162 None admin] PATH_INFO: `/v3/projects/3b6f3b860bdb40de962e435fd234c802` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:12.302391 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fe276-5cb0-4ae9-991d-43689704d162 None admin] RBAC: Authorizing `identity:get_project(project_id=3b6f3b860bdb40de962e435fd234c802)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:12.303899 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fe276-5cb0-4ae9-991d-43689704d162 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:12.305672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 223/445] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:15:12 2022] GET /identity/v3/projects/3b6f3b860bdb40de962e435fd234c802 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:12.306457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fe276-5cb0-4ae9-991d-43689704d162 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:12.311772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:12.329381 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:12.345450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 223/446] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:12.346448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35830b5-e7f7-42ab-ac45-b0c962cd10f1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:12.417753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fe276-5cb0-4ae9-991d-43689704d162 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:12.451491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4fbd1-bc9a-4564-81fd-33ff2f7d8691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:12.452135 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4fbd1-bc9a-4564-81fd-33ff2f7d8691 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:12.452408 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4fbd1-bc9a-4564-81fd-33ff2f7d8691 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:12.452671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4fbd1-bc9a-4564-81fd-33ff2f7d8691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:12.453496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4fbd1-bc9a-4564-81fd-33ff2f7d8691 None admin] RBAC: Adding query filter params (group.id=374da9c91ed74150aa588ae8f9850085, role.id=9b386d2d84ef4d3b9f9401c95f06c53b, scope.project.id=3b6f3b860bdb40de962e435fd234c802) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:12.453791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4fbd1-bc9a-4564-81fd-33ff2f7d8691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:12.455249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4fbd1-bc9a-4564-81fd-33ff2f7d8691 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:12.461670 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 224/447] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 20 19:15:12 2022] GET /identity/v3/role_assignments?group.id=374da9c91ed74150aa588ae8f9850085&scope.project.id=3b6f3b860bdb40de962e435fd234c802&role.id=9b386d2d84ef4d3b9f9401c95f06c53b => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:12.462458 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4fbd1-bc9a-4564-81fd-33ff2f7d8691 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:12.478633 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35830b5-e7f7-42ab-ac45-b0c962cd10f1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:12.518715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94ac1a-367a-491c-997e-e740eec9c607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:12.519972 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94ac1a-367a-491c-997e-e740eec9c607 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:12.520253 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94ac1a-367a-491c-997e-e740eec9c607 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:12.520529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94ac1a-367a-491c-997e-e740eec9c607 None admin] PATH_INFO: `/v3/groups/374da9c91ed74150aa588ae8f9850085` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:12.522100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94ac1a-367a-491c-997e-e740eec9c607 None admin] RBAC: Authorizing `identity:get_group(group_id=374da9c91ed74150aa588ae8f9850085)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:12.524099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94ac1a-367a-491c-997e-e740eec9c607 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:12.526366 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 224/448] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 20 19:15:12 2022] GET /identity/v3/groups/374da9c91ed74150aa588ae8f9850085 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:12.532212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94ac1a-367a-491c-997e-e740eec9c607 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:12.581214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:12.585293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:12.602596 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4fbd1-bc9a-4564-81fd-33ff2f7d8691 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:12.643577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ea780-c9b4-4bdd-9f7c-85bb1f72ec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:12.644371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ea780-c9b4-4bdd-9f7c-85bb1f72ec93 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:12.644644 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ea780-c9b4-4bdd-9f7c-85bb1f72ec93 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:12.646002 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ea780-c9b4-4bdd-9f7c-85bb1f72ec93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:12.654523 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94ac1a-367a-491c-997e-e740eec9c607 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:12.660284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ea780-c9b4-4bdd-9f7c-85bb1f72ec93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7d1ea780-c9b4-4bdd-9f7c-85bb1f72ec93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:12.668063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:12.669783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:12.671114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:12.671114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:12.671114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:12.671114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:12.671114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:12.671114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:12.671114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:12.671114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:12.671114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:12.671114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:12.671114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:12.671114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:12.671114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 225/449] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:15:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:12.677892 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ea780-c9b4-4bdd-9f7c-85bb1f72ec93 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:12.717144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d431b45-6421-43ef-a14d-93dd54ef95be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:12.717817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d431b45-6421-43ef-a14d-93dd54ef95be None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:12.718097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d431b45-6421-43ef-a14d-93dd54ef95be None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:12.718371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d431b45-6421-43ef-a14d-93dd54ef95be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:12.719332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d431b45-6421-43ef-a14d-93dd54ef95be None admin] RBAC: Adding query filter params (group.id=374da9c91ed74150aa588ae8f9850085, role.id=d73c76bc61c44f3a94e66397b0d9c359, scope.project.id=3b6f3b860bdb40de962e435fd234c802) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:12.720480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d431b45-6421-43ef-a14d-93dd54ef95be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:12.721231 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d431b45-6421-43ef-a14d-93dd54ef95be None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:12.730025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 225/450] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 20 19:15:12 2022] GET /identity/v3/role_assignments?group.id=374da9c91ed74150aa588ae8f9850085&scope.project.id=3b6f3b860bdb40de962e435fd234c802&role.id=d73c76bc61c44f3a94e66397b0d9c359 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:12.808205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ea780-c9b4-4bdd-9f7c-85bb1f72ec93 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:12.846188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfed8f-48e1-4690-96e5-11ffe40bc6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:12.846823 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfed8f-48e1-4690-96e5-11ffe40bc6ec None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:12.847109 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfed8f-48e1-4690-96e5-11ffe40bc6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:12.847381 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfed8f-48e1-4690-96e5-11ffe40bc6ec None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:12.848152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfed8f-48e1-4690-96e5-11ffe40bc6ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:12.848456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfed8f-48e1-4690-96e5-11ffe40bc6ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:12.849957 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfed8f-48e1-4690-96e5-11ffe40bc6ec None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:12.860101 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 226/451] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:12.866914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d431b45-6421-43ef-a14d-93dd54ef95be None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:12.976896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d431b45-6421-43ef-a14d-93dd54ef95be None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:12.979348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:13.012141 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaa691-6379-474a-ab84-fbaa017e014e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:13.012976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaa691-6379-474a-ab84-fbaa017e014e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:13.013414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaa691-6379-474a-ab84-fbaa017e014e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:13.013974 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaa691-6379-474a-ab84-fbaa017e014e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:13.085260 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaa691-6379-474a-ab84-fbaa017e014e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:13.086778 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaa691-6379-474a-ab84-fbaa017e014e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:13.188818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 226/452] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:13.194954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfed8f-48e1-4690-96e5-11ffe40bc6ec None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:13.204090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:13.293494 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfed8f-48e1-4690-96e5-11ffe40bc6ec None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:13.326804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf807df-fa1a-4fe3-8cfb-0b76596066c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:13.327665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf807df-fa1a-4fe3-8cfb-0b76596066c5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:13.327947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf807df-fa1a-4fe3-8cfb-0b76596066c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:13.328223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf807df-fa1a-4fe3-8cfb-0b76596066c5 None admin] PATH_INFO: `/v3/projects/19ff1600e760429b9e38b7ac11d31b62` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:13.329403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf807df-fa1a-4fe3-8cfb-0b76596066c5 None admin] RBAC: Authorizing `identity:get_project(project_id=19ff1600e760429b9e38b7ac11d31b62)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:13.330873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf807df-fa1a-4fe3-8cfb-0b76596066c5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:13.332558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 227/453] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:15:13 2022] GET /identity/v3/projects/19ff1600e760429b9e38b7ac11d31b62 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:13.338372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaa691-6379-474a-ab84-fbaa017e014e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:13.341583 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:13.436878 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaa691-6379-474a-ab84-fbaa017e014e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:13.470309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be34778-b68a-4b24-99cc-0c6e8f1bdf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:13.471115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be34778-b68a-4b24-99cc-0c6e8f1bdf4e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:13.471398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be34778-b68a-4b24-99cc-0c6e8f1bdf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:13.471666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be34778-b68a-4b24-99cc-0c6e8f1bdf4e None admin] PATH_INFO: `/v3/groups/0c22f66178db4f2692eed5d05b82156e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:13.472832 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be34778-b68a-4b24-99cc-0c6e8f1bdf4e None admin] RBAC: Authorizing `identity:get_group(group_id=0c22f66178db4f2692eed5d05b82156e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:13.474288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be34778-b68a-4b24-99cc-0c6e8f1bdf4e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:13.476523 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 227/454] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jul 20 19:15:13 2022] GET /identity/v3/groups/0c22f66178db4f2692eed5d05b82156e => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:13.482395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf807df-fa1a-4fe3-8cfb-0b76596066c5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:13.557880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:13.582081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf807df-fa1a-4fe3-8cfb-0b76596066c5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:13.615530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e989481-4a32-413c-a9ce-b0a624d67c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:13.616342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e989481-4a32-413c-a9ce-b0a624d67c99 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:13.616626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e989481-4a32-413c-a9ce-b0a624d67c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:13.616896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e989481-4a32-413c-a9ce-b0a624d67c99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:13.617726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e989481-4a32-413c-a9ce-b0a624d67c99 None admin] RBAC: Adding query filter params (group.id=0c22f66178db4f2692eed5d05b82156e, role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=19ff1600e760429b9e38b7ac11d31b62) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:13.618032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e989481-4a32-413c-a9ce-b0a624d67c99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:13.619491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e989481-4a32-413c-a9ce-b0a624d67c99 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:13.625211 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 228/455] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jul 20 19:15:13 2022] GET /identity/v3/role_assignments?group.id=0c22f66178db4f2692eed5d05b82156e&scope.project.id=19ff1600e760429b9e38b7ac11d31b62&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:16.016644 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f0fab-0a3f-4927-a0a5-663b5e242983 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:16.016644 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f0fab-0a3f-4927-a0a5-663b5e242983 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:16.016644 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f0fab-0a3f-4927-a0a5-663b5e242983 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:16.017576 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 228/456] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:16.022395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffb83b-cf45-403b-87fb-1e461c229e56 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:16.022958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffb83b-cf45-403b-87fb-1e461c229e56 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:16.022958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffb83b-cf45-403b-87fb-1e461c229e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:16.047664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-86ffb83b-cf45-403b-87fb-1e461c229e56 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:16.048839 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-86ffb83b-cf45-403b-87fb-1e461c229e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:16.136643 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 229/457] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:16.188423 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f0fab-0a3f-4927-a0a5-663b5e242983 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:16.291026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:16.313434 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db121f3-4c6b-4176-a01d-7ba95bd1c79d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:16.313702 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db121f3-4c6b-4176-a01d-7ba95bd1c79d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:16.313970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db121f3-4c6b-4176-a01d-7ba95bd1c79d None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:16.315367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 230/458] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:15:16.320760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893ffb6-b42a-4a6a-8e70-635e7d4273f2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:16.321212 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893ffb6-b42a-4a6a-8e70-635e7d4273f2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:16.321621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893ffb6-b42a-4a6a-8e70-635e7d4273f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:16.348408 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d893ffb6-b42a-4a6a-8e70-635e7d4273f2 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:16.350140 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d893ffb6-b42a-4a6a-8e70-635e7d4273f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:16.353891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f0fab-0a3f-4927-a0a5-663b5e242983 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:16.421909 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5927b5f-981d-4e5b-bce4-c5281631d1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:16.422733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5927b5f-981d-4e5b-bce4-c5281631d1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:16.423018 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5927b5f-981d-4e5b-bce4-c5281631d1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:16.423293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5927b5f-981d-4e5b-bce4-c5281631d1f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:16.446487 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5927b5f-981d-4e5b-bce4-c5281631d1f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:16.448388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5927b5f-981d-4e5b-bce4-c5281631d1f9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:16.468008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a5927b5f-981d-4e5b-bce4-c5281631d1f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:16.468008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:16.468008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:16.468008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:16.468008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:16.468008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:16.468008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:16.468008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:16.468008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:16.468008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:16.468008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:16.468008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:16.468008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:16.468008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:16.468008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:16.469085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:16.470144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:16.470144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:16.470144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:16.470144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:16.472257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 229/459] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:16.479216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5927b5f-981d-4e5b-bce4-c5281631d1f9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:16.509429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:16.510214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 231/460] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:15:16.533934 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893ffb6-b42a-4a6a-8e70-635e7d4273f2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:16.664749 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893ffb6-b42a-4a6a-8e70-635e7d4273f2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:16.676503 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5927b5f-981d-4e5b-bce4-c5281631d1f9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:16.702088 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:16.703267 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10bdb8-77b2-421a-ba52-82a975dac3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:16.704254 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10bdb8-77b2-421a-ba52-82a975dac3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:16.704675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10bdb8-77b2-421a-ba52-82a975dac3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:16.705084 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10bdb8-77b2-421a-ba52-82a975dac3f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:16.713976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefc313-fbd1-4b70-82b0-d6c9304ca83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:16.714966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefc313-fbd1-4b70-82b0-d6c9304ca83a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:16.715428 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefc313-fbd1-4b70-82b0-d6c9304ca83a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:16.715879 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefc313-fbd1-4b70-82b0-d6c9304ca83a None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:16.716789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefc313-fbd1-4b70-82b0-d6c9304ca83a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:16.716894 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10bdb8-77b2-421a-ba52-82a975dac3f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:16.717401 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefc313-fbd1-4b70-82b0-d6c9304ca83a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:16.718358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10bdb8-77b2-421a-ba52-82a975dac3f1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:16.719458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefc313-fbd1-4b70-82b0-d6c9304ca83a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:16.737432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-9c10bdb8-77b2-421a-ba52-82a975dac3f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:16.737432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:16.737432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:16.737432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:16.737432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:16.737432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:16.737432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:16.737432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:16.737432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:16.737432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:16.737432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:16.737432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:16.737432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:16.737432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:16.737432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:16.747635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:16.748490 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:16.748490 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:16.748490 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:16.748490 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:16.748710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 230/462] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:16.748710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9744d3b-8a2e-401e-b604-6f9b91219600 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:16.748710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9744d3b-8a2e-401e-b604-6f9b91219600 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:16.748710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9744d3b-8a2e-401e-b604-6f9b91219600 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:16.748710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 231/463] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:16.749024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 232/463] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:16.749099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9744d3b-8a2e-401e-b604-6f9b91219600 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:16.750521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10bdb8-77b2-421a-ba52-82a975dac3f1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:16.808172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:16.857718 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9744d3b-8a2e-401e-b604-6f9b91219600 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:16.864719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10bdb8-77b2-421a-ba52-82a975dac3f1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:16.893623 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbda10-fb37-4d2d-bf56-6b3413be4866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:16.894389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbda10-fb37-4d2d-bf56-6b3413be4866 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:16.894693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbda10-fb37-4d2d-bf56-6b3413be4866 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:16.894977 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbda10-fb37-4d2d-bf56-6b3413be4866 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:16.895818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbda10-fb37-4d2d-bf56-6b3413be4866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:16.896152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbda10-fb37-4d2d-bf56-6b3413be4866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:16.897743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbda10-fb37-4d2d-bf56-6b3413be4866 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:16.904455 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ed969-20a2-4cdc-a40e-8121f9ec9e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:16.905500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ed969-20a2-4cdc-a40e-8121f9ec9e95 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:16.905978 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ed969-20a2-4cdc-a40e-8121f9ec9e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:16.906457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ed969-20a2-4cdc-a40e-8121f9ec9e95 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:16.907520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ed969-20a2-4cdc-a40e-8121f9ec9e95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:16.909189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ed969-20a2-4cdc-a40e-8121f9ec9e95 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:16.910838 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 232/464] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:16.912804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b445c-a904-4463-b6c0-91cd30f22e0b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:16.913091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b445c-a904-4463-b6c0-91cd30f22e0b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:16.913471 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b445c-a904-4463-b6c0-91cd30f22e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:16.935744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b56b445c-a904-4463-b6c0-91cd30f22e0b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:16.935744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b56b445c-a904-4463-b6c0-91cd30f22e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:16.982665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:17.006811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 233/465] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:17.007526 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b445c-a904-4463-b6c0-91cd30f22e0b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:17.019529 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 233/466] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:15:16 2022] POST /identity/v3/users => generated 246 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:15:17.021984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d2835-41c0-48ea-ba6e-c986c7f58c85 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:17.022466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d2835-41c0-48ea-ba6e-c986c7f58c85 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:17.023549 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d2835-41c0-48ea-ba6e-c986c7f58c85 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:17.025571 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 234/467] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:17.035512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66326dc6-8f94-4dd7-be5e-d2f7ff46c030 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:17.036222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66326dc6-8f94-4dd7-be5e-d2f7ff46c030 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:17.036990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66326dc6-8f94-4dd7-be5e-d2f7ff46c030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:17.076207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-66326dc6-8f94-4dd7-be5e-d2f7ff46c030 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:17.080616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-66326dc6-8f94-4dd7-be5e-d2f7ff46c030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:17.230642 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 235/468] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:17.231666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66326dc6-8f94-4dd7-be5e-d2f7ff46c030 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:17.234416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b445c-a904-4463-b6c0-91cd30f22e0b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:17.288826 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:17.309377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a640fa7-4d4e-4ecc-ba33-9fce2eacd9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:17.310053 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a640fa7-4d4e-4ecc-ba33-9fce2eacd9a3 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:17.310342 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a640fa7-4d4e-4ecc-ba33-9fce2eacd9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:17.310621 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a640fa7-4d4e-4ecc-ba33-9fce2eacd9a3 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:17.311375 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a640fa7-4d4e-4ecc-ba33-9fce2eacd9a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:17.313625 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a640fa7-4d4e-4ecc-ba33-9fce2eacd9a3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:17.397822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66326dc6-8f94-4dd7-be5e-d2f7ff46c030 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:17.436476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 234/469] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:15:17 2022] POST /identity/v3/users => generated 248 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:15:17.437566 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a640fa7-4d4e-4ecc-ba33-9fce2eacd9a3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:17.439774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e39342-e006-470e-a794-8ebc9de4b693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:17.444020 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e39342-e006-470e-a794-8ebc9de4b693 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:17.444690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e39342-e006-470e-a794-8ebc9de4b693 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:17.445148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e39342-e006-470e-a794-8ebc9de4b693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:17.457470 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e39342-e006-470e-a794-8ebc9de4b693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:17.459363 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e39342-e006-470e-a794-8ebc9de4b693 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:17.480037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-22e39342-e006-470e-a794-8ebc9de4b693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:17.480037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:17.480037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:17.480037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:17.480037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:17.480037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:17.480037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:17.480037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:17.480037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:17.480037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:17.480037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:17.480037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:17.480037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:17.480037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:17.480037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:17.481061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:17.481933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:17.481933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:17.481933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:17.481933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:17.482149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:17.484443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 236/470] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:17.492436 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e39342-e006-470e-a794-8ebc9de4b693 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:17.582717 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a640fa7-4d4e-4ecc-ba33-9fce2eacd9a3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:17.626958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecc2b8-3370-4d23-9a09-c32f29c0c84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:17.627868 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecc2b8-3370-4d23-9a09-c32f29c0c84a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:17.628214 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecc2b8-3370-4d23-9a09-c32f29c0c84a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:17.628559 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecc2b8-3370-4d23-9a09-c32f29c0c84a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:17.642257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecc2b8-3370-4d23-9a09-c32f29c0c84a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:17.643940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecc2b8-3370-4d23-9a09-c32f29c0c84a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:17.664520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-feecc2b8-3370-4d23-9a09-c32f29c0c84a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:17.664520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:17.664520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:17.664520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:17.664520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:17.664520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:17.664520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:17.664520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:17.664520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:17.664520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:17.664520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:17.664520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:17.664520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:17.664520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:17.664520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:17.665431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:17.666286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:17.666286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:17.666286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:17.666286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:17.666498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:17.667173 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 235/471] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:17.673160 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecc2b8-3370-4d23-9a09-c32f29c0c84a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:17.691720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e39342-e006-470e-a794-8ebc9de4b693 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:17.743480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6d8dc-f3fd-44db-8534-75ec5d20c057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:17.744071 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6d8dc-f3fd-44db-8534-75ec5d20c057 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:17.744350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6d8dc-f3fd-44db-8534-75ec5d20c057 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:17.744619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6d8dc-f3fd-44db-8534-75ec5d20c057 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:17.745346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6d8dc-f3fd-44db-8534-75ec5d20c057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:17.745652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6d8dc-f3fd-44db-8534-75ec5d20c057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:17.747111 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6d8dc-f3fd-44db-8534-75ec5d20c057 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:17.761026 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 237/472] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:17.762379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511a1c8-a712-4f1b-9743-43228a5b763b None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:17.762692 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511a1c8-a712-4f1b-9743-43228a5b763b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:17.762975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511a1c8-a712-4f1b-9743-43228a5b763b None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:17.764252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 238/473] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:17.767536 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511a1c8-a712-4f1b-9743-43228a5b763b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:17.783065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:17.806994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecc2b8-3370-4d23-9a09-c32f29c0c84a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:17.855036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fcf17-1495-4e7f-8ea4-35d0a0766cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:17.855737 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fcf17-1495-4e7f-8ea4-35d0a0766cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:17.856017 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fcf17-1495-4e7f-8ea4-35d0a0766cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:17.856290 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fcf17-1495-4e7f-8ea4-35d0a0766cb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:17.857031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fcf17-1495-4e7f-8ea4-35d0a0766cb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:17.857332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fcf17-1495-4e7f-8ea4-35d0a0766cb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:17.859271 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fcf17-1495-4e7f-8ea4-35d0a0766cb6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:17.875399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 236/474] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:17.878725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c40c5-3aa6-42c4-a2eb-1c29dbc2a19f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:17.878725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c40c5-3aa6-42c4-a2eb-1c29dbc2a19f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:17.878725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c40c5-3aa6-42c4-a2eb-1c29dbc2a19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:17.891579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511a1c8-a712-4f1b-9743-43228a5b763b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:17.904060 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6c6c40c5-3aa6-42c4-a2eb-1c29dbc2a19f None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:17.905786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6c6c40c5-3aa6-42c4-a2eb-1c29dbc2a19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:17.936838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56f0b5-8e47-4e21-93ec-1a8da07364b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:17.938600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56f0b5-8e47-4e21-93ec-1a8da07364b0 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:17.939059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56f0b5-8e47-4e21-93ec-1a8da07364b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:17.939502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56f0b5-8e47-4e21-93ec-1a8da07364b0 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:17.940537 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56f0b5-8e47-4e21-93ec-1a8da07364b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:17.942812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56f0b5-8e47-4e21-93ec-1a8da07364b0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:17.990749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 237/475] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:17.990749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c40c5-3aa6-42c4-a2eb-1c29dbc2a19f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:18.067045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:18.078960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 239/476] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:15:17 2022] POST /identity/v3/users => generated 248 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:15:18.080622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56f0b5-8e47-4e21-93ec-1a8da07364b0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:18.092611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:18.109025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c40c5-3aa6-42c4-a2eb-1c29dbc2a19f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:18.149357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc8006-ab1b-425f-b20a-0fa9fe174543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:18.150203 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc8006-ab1b-425f-b20a-0fa9fe174543 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:18.150805 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc8006-ab1b-425f-b20a-0fa9fe174543 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:18.150934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc8006-ab1b-425f-b20a-0fa9fe174543 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:18.151755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc8006-ab1b-425f-b20a-0fa9fe174543 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:18.153355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc8006-ab1b-425f-b20a-0fa9fe174543 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:18.244899 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 238/477] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:15:17 2022] POST /identity/v3/users => generated 249 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:15:18.249365 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56f0b5-8e47-4e21-93ec-1a8da07364b0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:18.304664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5620b5-f781-4b6e-9209-444311b2b1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:18.305362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5620b5-f781-4b6e-9209-444311b2b1cb None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:18.305649 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5620b5-f781-4b6e-9209-444311b2b1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:18.305926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5620b5-f781-4b6e-9209-444311b2b1cb None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:18.306720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5620b5-f781-4b6e-9209-444311b2b1cb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:18.308154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5620b5-f781-4b6e-9209-444311b2b1cb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:18.347079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.sql.core [None req-2a5620b5-f781-4b6e-9209-444311b2b1cb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 19:15:18.347079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 19:15:18.347079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [parameters: {'id': 'd9ff3c499ae04111a9dc4d6b50ec2258', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 19:15:18.347079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80399) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 19:15:18.363880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-2a5620b5-f781-4b6e-9209-444311b2b1cb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 19:15:18.363880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:18.363880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:15:18.363880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:15:18.363880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:15:18.363880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:15:18.363880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:15:18.363880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:15:18.363880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:15:18.363880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:15:18.363880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:15:18.363880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:15:18.363880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:15:18.363880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result.read() Jul 20 19:15:18.363880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return ref.to_dict() Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:15:18.364856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application yield resource Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise self.value Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application session.commit() Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 19:15:18.366206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.session.flush() Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application compat.raise_( Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 19:15:18.367108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:15:18.367976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result.read() Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:15:18.368767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [parameters: {'id': 'd9ff3c499ae04111a9dc4d6b50ec2258', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:18.371449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 19:15:18.373478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:18.375660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 240/478] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jul 20 19:15:18 2022] POST /identity/v3/roles => generated 144 bytes in 285 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:18.377405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc8006-ab1b-425f-b20a-0fa9fe174543 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:18.503871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc8006-ab1b-425f-b20a-0fa9fe174543 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:18.532568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:18.541960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efff8a0-15d2-43ae-8fb5-4fc592f87412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:18.542807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efff8a0-15d2-43ae-8fb5-4fc592f87412 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:18.543087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efff8a0-15d2-43ae-8fb5-4fc592f87412 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:18.543354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efff8a0-15d2-43ae-8fb5-4fc592f87412 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:18.555006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efff8a0-15d2-43ae-8fb5-4fc592f87412 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2efff8a0-15d2-43ae-8fb5-4fc592f87412 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:18.563511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:18.564404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:18.565212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:18.565212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:18.565212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:18.565212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:18.565212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:18.565212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:18.565212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:18.565212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:18.565212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:18.565212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:18.565212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:15:18.565212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:18.565212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 239/479] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:15:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:18.575570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5620b5-f781-4b6e-9209-444311b2b1cb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:18.652866 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:18.689968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5620b5-f781-4b6e-9209-444311b2b1cb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:18.729629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0214bd-f0bc-4854-be7c-199a205bf74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:18.730315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0214bd-f0bc-4854-be7c-199a205bf74e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:18.730594 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0214bd-f0bc-4854-be7c-199a205bf74e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:18.738886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0214bd-f0bc-4854-be7c-199a205bf74e None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:18.739861 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0214bd-f0bc-4854-be7c-199a205bf74e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:18.740183 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0214bd-f0bc-4854-be7c-199a205bf74e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:18.741672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0214bd-f0bc-4854-be7c-199a205bf74e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:18.751369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 241/480] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:19.433888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3502c-2b02-4e3d-8689-6b7ad9c101b9 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:19.434394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3502c-2b02-4e3d-8689-6b7ad9c101b9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:19.434468 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3502c-2b02-4e3d-8689-6b7ad9c101b9 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:19.436131 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 240/481] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:19.441572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f4c3f-3b0c-4946-8178-3e89f610062c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:19.441966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f4c3f-3b0c-4946-8178-3e89f610062c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:19.442169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f4c3f-3b0c-4946-8178-3e89f610062c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:19.460015 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ac9f4c3f-3b0c-4946-8178-3e89f610062c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:19.461218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ac9f4c3f-3b0c-4946-8178-3e89f610062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:19.553263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 242/482] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:19.586725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3502c-2b02-4e3d-8689-6b7ad9c101b9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:19.735920 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3502c-2b02-4e3d-8689-6b7ad9c101b9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:19.782563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4ddee-d85b-4c14-a160-9ae34a8ae407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:19.783880 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4ddee-d85b-4c14-a160-9ae34a8ae407 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:19.784435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4ddee-d85b-4c14-a160-9ae34a8ae407 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:19.784922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4ddee-d85b-4c14-a160-9ae34a8ae407 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:19.800903 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4ddee-d85b-4c14-a160-9ae34a8ae407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a7d4ddee-d85b-4c14-a160-9ae34a8ae407 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:19.810185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:19.811223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:19.812031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:19.812031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:19.812031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:19.812031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:19.812031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:19.812031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:19.812031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:19.812031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:19.812031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:19.812031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:19.812031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:19.812031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:19.815176 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 241/483] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:19.822706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f4c3f-3b0c-4946-8178-3e89f610062c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:19.917984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:19.966433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f4c3f-3b0c-4946-8178-3e89f610062c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:19.993885 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca94924-f3ca-4dda-9886-a592f346297f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:19.994178 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca94924-f3ca-4dda-9886-a592f346297f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:19.994455 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca94924-f3ca-4dda-9886-a592f346297f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:19.996112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 242/484] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:20.001408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b35465-0714-4242-8448-ddb07ff0ca7b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:20.001917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b35465-0714-4242-8448-ddb07ff0ca7b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:20.002386 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b35465-0714-4242-8448-ddb07ff0ca7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:20.006620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73023a-57b2-4247-9ac1-fe6599135d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:20.007309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73023a-57b2-4247-9ac1-fe6599135d21 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:20.007582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73023a-57b2-4247-9ac1-fe6599135d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:20.007847 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73023a-57b2-4247-9ac1-fe6599135d21 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:20.008595 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73023a-57b2-4247-9ac1-fe6599135d21 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:20.008895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73023a-57b2-4247-9ac1-fe6599135d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:20.010251 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73023a-57b2-4247-9ac1-fe6599135d21 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:20.019061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 243/485] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:20.027658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73023a-57b2-4247-9ac1-fe6599135d21 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:20.030659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-05b35465-0714-4242-8448-ddb07ff0ca7b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:20.032097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-05b35465-0714-4242-8448-ddb07ff0ca7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:20.082752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:20.110708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 243/486] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:15:20.149358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b35465-0714-4242-8448-ddb07ff0ca7b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:20.201786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73023a-57b2-4247-9ac1-fe6599135d21 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:20.260888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:20.285447 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4b496-e912-47aa-8024-930255d8c824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:20.286256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4b496-e912-47aa-8024-930255d8c824 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:20.286605 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4b496-e912-47aa-8024-930255d8c824 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:20.286896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4b496-e912-47aa-8024-930255d8c824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:20.296215 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b35465-0714-4242-8448-ddb07ff0ca7b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:20.312621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4b496-e912-47aa-8024-930255d8c824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:20.314596 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4b496-e912-47aa-8024-930255d8c824 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:20.350435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-18f4b496-e912-47aa-8024-930255d8c824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:20.350435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:20.350435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:20.350435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:20.350435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:20.350435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:20.350435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:20.350435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:20.350435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:20.350435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:20.350435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:20.350435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:20.350435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:20.350435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:20.350435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:20.351349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:20.352192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:20.352192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:20.352192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:20.352192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:20.354885 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 244/487] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:20.359794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4ae9d-a11e-429e-bba1-362dd238a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:20.361492 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4b496-e912-47aa-8024-930255d8c824 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:20.362623 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4ae9d-a11e-429e-bba1-362dd238a7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:20.363487 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4ae9d-a11e-429e-bba1-362dd238a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:20.366440 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4ae9d-a11e-429e-bba1-362dd238a7b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:20.388103 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4ae9d-a11e-429e-bba1-362dd238a7b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-fbb4ae9d-a11e-429e-bba1-362dd238a7b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:20.398961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:20.399913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:20.400727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:20.400727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:20.400727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:20.400727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:20.400727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:20.400727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:20.400727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:20.400727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:20.400727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:20.400727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:20.400727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:20.400727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:20.404559 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 244/488] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:20.413222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4ae9d-a11e-429e-bba1-362dd238a7b6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:20.505888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:20.593838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4b496-e912-47aa-8024-930255d8c824 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:20.632546 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4ae9d-a11e-429e-bba1-362dd238a7b6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:20.670534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259d79f-3ec5-4734-b319-e7188e0cdb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:20.671588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259d79f-3ec5-4734-b319-e7188e0cdb71 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:20.671970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259d79f-3ec5-4734-b319-e7188e0cdb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:20.672344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259d79f-3ec5-4734-b319-e7188e0cdb71 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:20.673113 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259d79f-3ec5-4734-b319-e7188e0cdb71 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:20.673416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259d79f-3ec5-4734-b319-e7188e0cdb71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:20.674852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259d79f-3ec5-4734-b319-e7188e0cdb71 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:20.679488 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cea806-1a8c-468a-98c2-3f2304ea59dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:20.680182 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cea806-1a8c-468a-98c2-3f2304ea59dc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:20.680467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cea806-1a8c-468a-98c2-3f2304ea59dc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:20.680744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cea806-1a8c-468a-98c2-3f2304ea59dc None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:20.681495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cea806-1a8c-468a-98c2-3f2304ea59dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:20.681802 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cea806-1a8c-468a-98c2-3f2304ea59dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:20.683269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cea806-1a8c-468a-98c2-3f2304ea59dc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:20.686085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 245/489] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:20.692167 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259d79f-3ec5-4734-b319-e7188e0cdb71 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:20.713305 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 245/490] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:20.719983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cea806-1a8c-468a-98c2-3f2304ea59dc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:20.799656 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:20.804485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:20.808135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259d79f-3ec5-4734-b319-e7188e0cdb71 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:20.863696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e933a39-8ee0-4270-a463-a29320ab469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:20.864841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e933a39-8ee0-4270-a463-a29320ab469b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:20.865130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e933a39-8ee0-4270-a463-a29320ab469b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:20.865667 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e933a39-8ee0-4270-a463-a29320ab469b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:20.879591 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e933a39-8ee0-4270-a463-a29320ab469b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:20.882503 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e933a39-8ee0-4270-a463-a29320ab469b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:20.888281 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cea806-1a8c-468a-98c2-3f2304ea59dc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:20.909791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4e933a39-8ee0-4270-a463-a29320ab469b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:20.909791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:20.909791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:20.909791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:20.909791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:20.909791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:20.909791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:20.909791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:20.909791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:20.909791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:20.909791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:20.909791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:20.909791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:20.909791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:20.909791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:20.910744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:20.911661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:20.911661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:20.911661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:20.911661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:20.911661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 246/491] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:20.912754 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7097fd-d9a0-49af-97a8-f9e450672a0a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:20.914843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7097fd-d9a0-49af-97a8-f9e450672a0a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:20.914843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7097fd-d9a0-49af-97a8-f9e450672a0a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:20.914843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 247/492] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:20.917734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c420d24-458e-4f4a-aec1-35b2c95d5707 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:20.917734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c420d24-458e-4f4a-aec1-35b2c95d5707 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:20.917734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c420d24-458e-4f4a-aec1-35b2c95d5707 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:20.917734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 248/493] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:20.922424 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c420d24-458e-4f4a-aec1-35b2c95d5707 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:20.932960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced2814-efda-4545-b675-8af9ccd4841b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:20.933703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced2814-efda-4545-b675-8af9ccd4841b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:20.933980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced2814-efda-4545-b675-8af9ccd4841b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:20.934251 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced2814-efda-4545-b675-8af9ccd4841b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:20.942315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced2814-efda-4545-b675-8af9ccd4841b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:20.944396 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced2814-efda-4545-b675-8af9ccd4841b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7ced2814-efda-4545-b675-8af9ccd4841b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:20.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:20.961409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:20.962319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:20.962319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:20.962319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:20.962319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:20.962319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:20.962319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:20.962319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:20.962319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:20.962319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:15:20.962319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:20.962319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 246/494] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jul 20 19:15:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:20.962935 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f68c84-71e2-4556-9ffa-659939ceab34 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:20.963476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f68c84-71e2-4556-9ffa-659939ceab34 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:20.963476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f68c84-71e2-4556-9ffa-659939ceab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:20.979530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d1f68c84-71e2-4556-9ffa-659939ceab34 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:20.980752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d1f68c84-71e2-4556-9ffa-659939ceab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:21.037749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c420d24-458e-4f4a-aec1-35b2c95d5707 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:21.062698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 247/495] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:21.062698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8c12c-cb5e-44cc-a7ed-c12ab34bc7b2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:21.062698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8c12c-cb5e-44cc-a7ed-c12ab34bc7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:21.062698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8c12c-cb5e-44cc-a7ed-c12ab34bc7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:21.078978 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f6f8c12c-cb5e-44cc-a7ed-c12ab34bc7b2 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:21.080317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f6f8c12c-cb5e-44cc-a7ed-c12ab34bc7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:21.082873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a1a83-5c82-427f-9116-a97a9bb1d3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:21.085018 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a1a83-5c82-427f-9116-a97a9bb1d3af None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:21.085307 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a1a83-5c82-427f-9116-a97a9bb1d3af None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:21.085582 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a1a83-5c82-427f-9116-a97a9bb1d3af None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:21.086323 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a1a83-5c82-427f-9116-a97a9bb1d3af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:21.086629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a1a83-5c82-427f-9116-a97a9bb1d3af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:21.088040 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a1a83-5c82-427f-9116-a97a9bb1d3af None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:21.100872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:21.108729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 249/496] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:21.108729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a1a83-5c82-427f-9116-a97a9bb1d3af None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:21.120863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:21.166943 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 248/497] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:21.166943 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8c12c-cb5e-44cc-a7ed-c12ab34bc7b2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:21.218629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a1a83-5c82-427f-9116-a97a9bb1d3af None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:21.259346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee0dfc-6184-4c32-962f-46929d671c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:21.260255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee0dfc-6184-4c32-962f-46929d671c9c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:21.260435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee0dfc-6184-4c32-962f-46929d671c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:21.261648 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee0dfc-6184-4c32-962f-46929d671c9c None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:21.262539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee0dfc-6184-4c32-962f-46929d671c9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:21.262875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee0dfc-6184-4c32-962f-46929d671c9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:21.264344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee0dfc-6184-4c32-962f-46929d671c9c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:21.290438 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8c12c-cb5e-44cc-a7ed-c12ab34bc7b2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:21.314774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 250/498] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 20 19:15:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:21.314774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee0dfc-6184-4c32-962f-46929d671c9c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:21.326933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cae5d5-e00e-4bf9-82fb-2250ba0f501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:21.327735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cae5d5-e00e-4bf9-82fb-2250ba0f501a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:21.328015 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cae5d5-e00e-4bf9-82fb-2250ba0f501a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:21.328293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cae5d5-e00e-4bf9-82fb-2250ba0f501a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:21.340052 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cae5d5-e00e-4bf9-82fb-2250ba0f501a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-23cae5d5-e00e-4bf9-82fb-2250ba0f501a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:21.347905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:21.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:21.349844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:21.349844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:21.349844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:21.349844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:21.349844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:21.349844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:21.349844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:21.349844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:21.349844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:21.349844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:21.349844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:21.349844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:21.354104 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 249/499] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:21.355013 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cae5d5-e00e-4bf9-82fb-2250ba0f501a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:21.372654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:21.397002 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:21.430909 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee0dfc-6184-4c32-962f-46929d671c9c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:21.461526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cae5d5-e00e-4bf9-82fb-2250ba0f501a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:21.466285 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33655e47-0f18-473c-82bd-cba07b35f5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:21.467109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33655e47-0f18-473c-82bd-cba07b35f5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:21.467388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33655e47-0f18-473c-82bd-cba07b35f5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:21.467659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33655e47-0f18-473c-82bd-cba07b35f5e2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:21.476977 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33655e47-0f18-473c-82bd-cba07b35f5e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:21.478454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33655e47-0f18-473c-82bd-cba07b35f5e2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-33655e47-0f18-473c-82bd-cba07b35f5e2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:21.494432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:21.495408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:21.496297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:21.496297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:21.496297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:21.496297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:21.496297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:21.496297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:21.496297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:21.496297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:21.496297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:15:21.496297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:21.496297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 251/500] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:21.497552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33655e47-0f18-473c-82bd-cba07b35f5e2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:21.498731 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28ee6e-39f7-490f-820f-b98a4996f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:21.499530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28ee6e-39f7-490f-820f-b98a4996f9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:21.499806 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28ee6e-39f7-490f-820f-b98a4996f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:21.500297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28ee6e-39f7-490f-820f-b98a4996f9c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:21.512227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28ee6e-39f7-490f-820f-b98a4996f9c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-fd28ee6e-39f7-490f-820f-b98a4996f9c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:21.520032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:21.529794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:21.530602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:21.530602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:21.530602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:21.530602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:21.530602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:21.530602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:21.530602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:21.530602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:21.530602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:21.530602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:21.530602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:21.530602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:21.530602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 250/501] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:21.530602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28ee6e-39f7-490f-820f-b98a4996f9c7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:21.615940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:21.617701 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33655e47-0f18-473c-82bd-cba07b35f5e2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:21.644500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28ee6e-39f7-490f-820f-b98a4996f9c7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:21.649822 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:21.656423 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb412591-41cb-4d18-b586-46c428882bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:21.657116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb412591-41cb-4d18-b586-46c428882bff None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:21.657340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb412591-41cb-4d18-b586-46c428882bff None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:21.657608 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb412591-41cb-4d18-b586-46c428882bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:21.680810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397571d-6e29-436b-ad27-83895acce868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:21.681534 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397571d-6e29-436b-ad27-83895acce868 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:21.681759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397571d-6e29-436b-ad27-83895acce868 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:21.682119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397571d-6e29-436b-ad27-83895acce868 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:21.682875 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397571d-6e29-436b-ad27-83895acce868 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:21.683182 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397571d-6e29-436b-ad27-83895acce868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:21.684582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397571d-6e29-436b-ad27-83895acce868 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:21.693497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 251/502] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:21.694435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397571d-6e29-436b-ad27-83895acce868 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:21.732943 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb412591-41cb-4d18-b586-46c428882bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:21.734431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb412591-41cb-4d18-b586-46c428882bff None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:21.793510 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397571d-6e29-436b-ad27-83895acce868 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:21.827772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f756d7b-083e-4cc9-819e-c13dbbddd208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:21.828446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f756d7b-083e-4cc9-819e-c13dbbddd208 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:21.828725 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f756d7b-083e-4cc9-819e-c13dbbddd208 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:21.828999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f756d7b-083e-4cc9-819e-c13dbbddd208 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:21.829841 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f756d7b-083e-4cc9-819e-c13dbbddd208 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:21.830148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f756d7b-083e-4cc9-819e-c13dbbddd208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:21.831620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f756d7b-083e-4cc9-819e-c13dbbddd208 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:21.834975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 252/503] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:21.835812 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb412591-41cb-4d18-b586-46c428882bff None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:21.843378 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:21.865879 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:21.868733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 252/504] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 20 19:15:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:21.870113 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4116bbc-231b-450e-8088-b99fa88d0d3e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:21.870404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4116bbc-231b-450e-8088-b99fa88d0d3e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:21.870704 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4116bbc-231b-450e-8088-b99fa88d0d3e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:21.874708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 253/505] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:21.874708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4116bbc-231b-450e-8088-b99fa88d0d3e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:21.944035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb412591-41cb-4d18-b586-46c428882bff None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:21.977058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65f837-65ea-49f6-9498-9b33e2526191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:21.977392 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4116bbc-231b-450e-8088-b99fa88d0d3e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:21.977719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65f837-65ea-49f6-9498-9b33e2526191 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:21.977998 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65f837-65ea-49f6-9498-9b33e2526191 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:21.978271 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65f837-65ea-49f6-9498-9b33e2526191 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:21.979054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65f837-65ea-49f6-9498-9b33e2526191 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:21.979365 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65f837-65ea-49f6-9498-9b33e2526191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:21.980757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65f837-65ea-49f6-9498-9b33e2526191 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:21.991109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 253/506] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:21.991962 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65f837-65ea-49f6-9498-9b33e2526191 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:22.016066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0d576-25d2-4d10-a149-1e7ba6d34489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:22.016860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0d576-25d2-4d10-a149-1e7ba6d34489 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:22.017136 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0d576-25d2-4d10-a149-1e7ba6d34489 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:22.017406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0d576-25d2-4d10-a149-1e7ba6d34489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:22.028498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0d576-25d2-4d10-a149-1e7ba6d34489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:22.029960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0d576-25d2-4d10-a149-1e7ba6d34489 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:22.049433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f2e0d576-25d2-4d10-a149-1e7ba6d34489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:22.049433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:22.049433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:22.049433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:22.049433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:22.049433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:22.049433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:22.049433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:22.049433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:22.049433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:22.049433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:22.049433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:22.049433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:22.049433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:22.049433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:22.050364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:22.051495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:22.051495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:22.051495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:22.051495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:22.051495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 254/507] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:22.051495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0d576-25d2-4d10-a149-1e7ba6d34489 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:22.089126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:22.097609 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65f837-65ea-49f6-9498-9b33e2526191 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:22.099814 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:22.132941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2974db1-e4f3-45f5-a546-61954e29ae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:22.133736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2974db1-e4f3-45f5-a546-61954e29ae4d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:22.134015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2974db1-e4f3-45f5-a546-61954e29ae4d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:22.134287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2974db1-e4f3-45f5-a546-61954e29ae4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:22.144627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2974db1-e4f3-45f5-a546-61954e29ae4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:22.146845 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2974db1-e4f3-45f5-a546-61954e29ae4d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:22.151772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0d576-25d2-4d10-a149-1e7ba6d34489 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:22.165102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f2974db1-e4f3-45f5-a546-61954e29ae4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:22.165102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:22.165102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:22.165102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:22.165102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:22.165102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:22.165102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:22.165102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:22.165102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:22.165102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:22.165102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:22.165102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:22.165102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:22.165102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:22.165102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:22.166025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:22.166915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:22.166915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:22.166915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:22.166915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:22.166915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 254/508] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:22.167680 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27375be-92f0-4532-984b-8f421ba5ff09 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:22.167857 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27375be-92f0-4532-984b-8f421ba5ff09 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:22.168121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27375be-92f0-4532-984b-8f421ba5ff09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:22.185330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e27375be-92f0-4532-984b-8f421ba5ff09 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:22.186514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e27375be-92f0-4532-984b-8f421ba5ff09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:22.187907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34b140-2ba3-4f24-aea5-41c57b58ffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:22.188561 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34b140-2ba3-4f24-aea5-41c57b58ffb1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:22.188839 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34b140-2ba3-4f24-aea5-41c57b58ffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:22.189114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34b140-2ba3-4f24-aea5-41c57b58ffb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:22.261839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 255/509] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:22.261839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27375be-92f0-4532-984b-8f421ba5ff09 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:22.263802 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34b140-2ba3-4f24-aea5-41c57b58ffb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:22.265268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34b140-2ba3-4f24-aea5-41c57b58ffb1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:22.315562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:22.334041 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:22.359827 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27375be-92f0-4532-984b-8f421ba5ff09 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:22.372891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 255/510] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:22.373749 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34b140-2ba3-4f24-aea5-41c57b58ffb1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:22.397586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf0e5e-3f0f-4505-902d-a855254921c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:22.398374 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf0e5e-3f0f-4505-902d-a855254921c6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:22.398654 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf0e5e-3f0f-4505-902d-a855254921c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:22.398951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf0e5e-3f0f-4505-902d-a855254921c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:22.409975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf0e5e-3f0f-4505-902d-a855254921c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:22.412302 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf0e5e-3f0f-4505-902d-a855254921c6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:22.435651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-9acf0e5e-3f0f-4505-902d-a855254921c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:22.435651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:22.435651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:22.435651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:22.435651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:22.435651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:22.435651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:22.435651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:22.435651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:22.435651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:22.435651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:22.435651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:22.435651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:22.435651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:22.435651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:22.436564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:22.437692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:22.437692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:22.437692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:22.437692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:22.437692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 256/511] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:22.437964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf0e5e-3f0f-4505-902d-a855254921c6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:22.474786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34b140-2ba3-4f24-aea5-41c57b58ffb1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:22.512661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf3ac1-ca95-4aeb-8bd3-914e94d3b171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:22.513246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf3ac1-ca95-4aeb-8bd3-914e94d3b171 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:22.513528 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf3ac1-ca95-4aeb-8bd3-914e94d3b171 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:22.513806 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf3ac1-ca95-4aeb-8bd3-914e94d3b171 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:22.514528 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf3ac1-ca95-4aeb-8bd3-914e94d3b171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:22.514861 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf3ac1-ca95-4aeb-8bd3-914e94d3b171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:22.516248 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf3ac1-ca95-4aeb-8bd3-914e94d3b171 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:22.528740 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 256/512] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:22.529558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf3ac1-ca95-4aeb-8bd3-914e94d3b171 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:22.538626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:22.549584 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf0e5e-3f0f-4505-902d-a855254921c6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:22.575296 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:22.584564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2aa3b-d541-46e0-80d1-04a716d18436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:22.585235 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2aa3b-d541-46e0-80d1-04a716d18436 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:22.585514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2aa3b-d541-46e0-80d1-04a716d18436 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:22.585798 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2aa3b-d541-46e0-80d1-04a716d18436 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:22.586525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2aa3b-d541-46e0-80d1-04a716d18436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:22.586856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2aa3b-d541-46e0-80d1-04a716d18436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:22.588237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2aa3b-d541-46e0-80d1-04a716d18436 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:22.600463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 257/513] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:22.601423 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2aa3b-d541-46e0-80d1-04a716d18436 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:22.631653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf3ac1-ca95-4aeb-8bd3-914e94d3b171 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:22.666529 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fbaf9-a72a-46a0-9c4b-4f7b2afde273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:22.667347 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fbaf9-a72a-46a0-9c4b-4f7b2afde273 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:22.667626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fbaf9-a72a-46a0-9c4b-4f7b2afde273 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:22.667897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fbaf9-a72a-46a0-9c4b-4f7b2afde273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:22.677915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fbaf9-a72a-46a0-9c4b-4f7b2afde273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:22.679414 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fbaf9-a72a-46a0-9c4b-4f7b2afde273 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:22.697459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-ee6fbaf9-a72a-46a0-9c4b-4f7b2afde273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:22.697459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:22.697459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:22.697459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:22.697459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:22.697459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:22.697459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:22.697459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:22.697459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:22.697459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:22.697459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:22.697459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:22.697459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:22.697459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:22.697459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:22.698431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:22.699342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:22.699342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:22.699342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:22.699342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:22.699342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 257/514] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:22.699602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fbaf9-a72a-46a0-9c4b-4f7b2afde273 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:22.705788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2aa3b-d541-46e0-80d1-04a716d18436 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:22.740176 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649b6b1-d90c-436f-913d-dab73f119aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:22.740964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649b6b1-d90c-436f-913d-dab73f119aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:22.741247 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649b6b1-d90c-436f-913d-dab73f119aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:22.741518 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649b6b1-d90c-436f-913d-dab73f119aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:22.752037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649b6b1-d90c-436f-913d-dab73f119aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:22.753540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649b6b1-d90c-436f-913d-dab73f119aa2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:22.757624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:22.773168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c649b6b1-d90c-436f-913d-dab73f119aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:22.773168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:22.773168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:22.773168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:22.773168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:22.773168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:22.773168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:22.773168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:22.773168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:22.773168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:22.773168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:22.773168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:22.773168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:22.773168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:22.773168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:22.774388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:22.775294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:22.775294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:22.775294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:22.775294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:22.775294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 258/515] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:22.775294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649b6b1-d90c-436f-913d-dab73f119aa2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:22.801250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fbaf9-a72a-46a0-9c4b-4f7b2afde273 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:22.816098 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:22.836370 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa916e-ae28-4002-99da-86ff7856f16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:22.837077 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa916e-ae28-4002-99da-86ff7856f16d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:22.837358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa916e-ae28-4002-99da-86ff7856f16d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:22.837624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa916e-ae28-4002-99da-86ff7856f16d None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:22.838343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa916e-ae28-4002-99da-86ff7856f16d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:22.838643 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa916e-ae28-4002-99da-86ff7856f16d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:22.840059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa916e-ae28-4002-99da-86ff7856f16d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:22.851367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 258/516] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:22.852598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa916e-ae28-4002-99da-86ff7856f16d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:22.876397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649b6b1-d90c-436f-913d-dab73f119aa2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:22.912892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebec010-66dc-4324-865c-b1d4ad0760c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:22.913687 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebec010-66dc-4324-865c-b1d4ad0760c3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:22.913965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebec010-66dc-4324-865c-b1d4ad0760c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:22.914235 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebec010-66dc-4324-865c-b1d4ad0760c3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:22.921575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebec010-66dc-4324-865c-b1d4ad0760c3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:22.923077 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebec010-66dc-4324-865c-b1d4ad0760c3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-9ebec010-66dc-4324-865c-b1d4ad0760c3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:22.937872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:22.938850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:22.939789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:22.939789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:22.939789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:22.939789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:22.939789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:22.939789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:22.939789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:22.939789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:22.939789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:15:22.939789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:22.939789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 259/517] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:22.940355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebec010-66dc-4324-865c-b1d4ad0760c3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:22.956978 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa916e-ae28-4002-99da-86ff7856f16d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:22.974426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:22.990587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd636db9-b07a-4c33-a565-e683441165e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:22.991405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd636db9-b07a-4c33-a565-e683441165e1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:22.991687 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd636db9-b07a-4c33-a565-e683441165e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:22.991960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd636db9-b07a-4c33-a565-e683441165e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:22.998931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd636db9-b07a-4c33-a565-e683441165e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:23.000378 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd636db9-b07a-4c33-a565-e683441165e1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:23.015684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-dd636db9-b07a-4c33-a565-e683441165e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:23.015684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:23.015684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:23.015684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:23.015684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:23.015684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:23.015684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:23.015684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:23.015684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:23.015684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:23.015684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:23.015684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:23.015684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:23.015684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:23.015684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:23.016639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:23.017478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:23.017478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:23.017478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:23.017478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:23.017478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:23.017478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:23.017478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:23.017478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:23.017478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 259/518] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:23.018244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd636db9-b07a-4c33-a565-e683441165e1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:23.039369 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:23.043164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebec010-66dc-4324-865c-b1d4ad0760c3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:23.079037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb6dd7-ef19-4135-a384-3751c3a96434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:23.079702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb6dd7-ef19-4135-a384-3751c3a96434 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:23.079982 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb6dd7-ef19-4135-a384-3751c3a96434 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:23.080259 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb6dd7-ef19-4135-a384-3751c3a96434 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:23.080983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb6dd7-ef19-4135-a384-3751c3a96434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:23.081287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb6dd7-ef19-4135-a384-3751c3a96434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:23.082665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb6dd7-ef19-4135-a384-3751c3a96434 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:23.095130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 260/519] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:23.095777 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb6dd7-ef19-4135-a384-3751c3a96434 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:23.120412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd636db9-b07a-4c33-a565-e683441165e1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:23.154469 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd66884-9835-4056-90dc-16358fc0d00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:23.155157 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd66884-9835-4056-90dc-16358fc0d00b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:23.155432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd66884-9835-4056-90dc-16358fc0d00b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:23.155701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd66884-9835-4056-90dc-16358fc0d00b None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:23.156413 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd66884-9835-4056-90dc-16358fc0d00b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:23.156712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd66884-9835-4056-90dc-16358fc0d00b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:23.158070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd66884-9835-4056-90dc-16358fc0d00b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:23.169466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 260/520] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:23.169834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd66884-9835-4056-90dc-16358fc0d00b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:23.200755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb6dd7-ef19-4135-a384-3751c3a96434 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:23.214963 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:23.234468 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bd42a-b20a-434c-b032-97ec076a3995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:23.235290 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bd42a-b20a-434c-b032-97ec076a3995 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:23.235561 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bd42a-b20a-434c-b032-97ec076a3995 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:23.235830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bd42a-b20a-434c-b032-97ec076a3995 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:23.244419 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bd42a-b20a-434c-b032-97ec076a3995 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:23.245870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bd42a-b20a-434c-b032-97ec076a3995 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d41bd42a-b20a-434c-b032-97ec076a3995 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:23.260692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:23.261800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:23.263069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:23.263069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:23.263069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:23.263069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:23.263069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:23.263069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:23.263069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:23.263069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:23.263069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:15:23.263069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:23.263069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 261/521] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:23.263714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bd42a-b20a-434c-b032-97ec076a3995 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:23.281824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd66884-9835-4056-90dc-16358fc0d00b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:23.293221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:23.319481 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd7036-c2ea-428f-b127-35c48dfe70d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:23.320146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd7036-c2ea-428f-b127-35c48dfe70d3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:23.320423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd7036-c2ea-428f-b127-35c48dfe70d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:23.320693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd7036-c2ea-428f-b127-35c48dfe70d3 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:23.321526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd7036-c2ea-428f-b127-35c48dfe70d3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:23.321828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd7036-c2ea-428f-b127-35c48dfe70d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:23.323273 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd7036-c2ea-428f-b127-35c48dfe70d3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:23.341376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 261/522] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 20 19:15:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:23.342181 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd7036-c2ea-428f-b127-35c48dfe70d3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:23.375685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bd42a-b20a-434c-b032-97ec076a3995 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:23.410611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffded007-d3de-4897-ad90-d0b99a261a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:23.411321 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffded007-d3de-4897-ad90-d0b99a261a13 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:23.411596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffded007-d3de-4897-ad90-d0b99a261a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:23.411954 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffded007-d3de-4897-ad90-d0b99a261a13 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:23.412736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffded007-d3de-4897-ad90-d0b99a261a13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:23.413046 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffded007-d3de-4897-ad90-d0b99a261a13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:23.414479 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffded007-d3de-4897-ad90-d0b99a261a13 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:23.434535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 262/523] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:23.435585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffded007-d3de-4897-ad90-d0b99a261a13 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:23.450040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:23.455971 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd7036-c2ea-428f-b127-35c48dfe70d3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:23.489808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3cc96-7a63-4153-a5c4-5d62e2847d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:23.490483 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3cc96-7a63-4153-a5c4-5d62e2847d01 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:23.490796 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3cc96-7a63-4153-a5c4-5d62e2847d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:23.491074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3cc96-7a63-4153-a5c4-5d62e2847d01 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:23.491772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3cc96-7a63-4153-a5c4-5d62e2847d01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:23.493284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3cc96-7a63-4153-a5c4-5d62e2847d01 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:23.521741 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:23.543382 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffded007-d3de-4897-ad90-d0b99a261a13 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:23.577290 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2cbbc-e606-4b69-b9f3-75872828b148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:23.578080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2cbbc-e606-4b69-b9f3-75872828b148 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:23.578380 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2cbbc-e606-4b69-b9f3-75872828b148 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:23.578637 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2cbbc-e606-4b69-b9f3-75872828b148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:23.585503 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2cbbc-e606-4b69-b9f3-75872828b148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:23.587007 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2cbbc-e606-4b69-b9f3-75872828b148 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:23.602252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c4c2cbbc-e606-4b69-b9f3-75872828b148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:23.602252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:23.602252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:23.602252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:23.602252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:23.602252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:23.602252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:23.602252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:23.602252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:23.602252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:23.602252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:23.602252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:23.602252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:23.602252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:23.602252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:23.603283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:23.604257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:23.604257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:23.604257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:23.604257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:23.604257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:23.604257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:23.604257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:23.604257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:23.604257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 263/524] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:23.604257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2cbbc-e606-4b69-b9f3-75872828b148 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:23.618081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 262/525] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:15:23 2022] POST /identity/v3/users => generated 247 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:15:23.618942 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3cc96-7a63-4153-a5c4-5d62e2847d01 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:23.726984 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2cbbc-e606-4b69-b9f3-75872828b148 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:23.741802 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3cc96-7a63-4153-a5c4-5d62e2847d01 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:23.767401 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28117c5-030e-4bdc-888f-a52f144c0b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:23.768027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28117c5-030e-4bdc-888f-a52f144c0b9b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:23.768302 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28117c5-030e-4bdc-888f-a52f144c0b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:23.768569 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28117c5-030e-4bdc-888f-a52f144c0b9b None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:23.769411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28117c5-030e-4bdc-888f-a52f144c0b9b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:23.770151 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28117c5-030e-4bdc-888f-a52f144c0b9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:23.771755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28117c5-030e-4bdc-888f-a52f144c0b9b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:23.780868 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:23.785945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d76c9-f283-4cd4-9ef9-31083be3d713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:23.786639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d76c9-f283-4cd4-9ef9-31083be3d713 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:23.786949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d76c9-f283-4cd4-9ef9-31083be3d713 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:23.787245 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d76c9-f283-4cd4-9ef9-31083be3d713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:23.792925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 264/526] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 20 19:15:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:23.793802 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28117c5-030e-4bdc-888f-a52f144c0b9b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:23.814174 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:23.871363 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d76c9-f283-4cd4-9ef9-31083be3d713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:23.872834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d76c9-f283-4cd4-9ef9-31083be3d713 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:23.921149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28117c5-030e-4bdc-888f-a52f144c0b9b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:23.966275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cd960-0f17-4cfb-b79c-99bc862e6989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:23.966964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cd960-0f17-4cfb-b79c-99bc862e6989 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:23.967246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cd960-0f17-4cfb-b79c-99bc862e6989 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:23.967519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cd960-0f17-4cfb-b79c-99bc862e6989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:23.968357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cd960-0f17-4cfb-b79c-99bc862e6989 None admin] RBAC: Adding query filter params (role.id=33cbf420a4284279a9010e820bcece79, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=e3fd38ebb5514af686204d0b02a91edd) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:23.968666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cd960-0f17-4cfb-b79c-99bc862e6989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:23.970112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cd960-0f17-4cfb-b79c-99bc862e6989 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:23.982705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 265/527] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:15:23 2022] GET /identity/v3/role_assignments?user.id=e3fd38ebb5514af686204d0b02a91edd&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=33cbf420a4284279a9010e820bcece79 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:23.982705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cd960-0f17-4cfb-b79c-99bc862e6989 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:23.982985 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 263/528] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:23.982985 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d76c9-f283-4cd4-9ef9-31083be3d713 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:24.050762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:24.074999 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:24.120993 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d76c9-f283-4cd4-9ef9-31083be3d713 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:24.126344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cd960-0f17-4cfb-b79c-99bc862e6989 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:24.179182 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4c917-b681-432c-9fb0-0961dd4b00b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:24.179846 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4c917-b681-432c-9fb0-0961dd4b00b4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:24.180125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4c917-b681-432c-9fb0-0961dd4b00b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:24.180399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4c917-b681-432c-9fb0-0961dd4b00b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:24.181409 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452d174-5039-4207-83c3-58e05b1dadf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:24.182182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452d174-5039-4207-83c3-58e05b1dadf8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:24.182555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452d174-5039-4207-83c3-58e05b1dadf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:24.182948 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452d174-5039-4207-83c3-58e05b1dadf8 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:24.183837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452d174-5039-4207-83c3-58e05b1dadf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:24.184242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452d174-5039-4207-83c3-58e05b1dadf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:24.185901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452d174-5039-4207-83c3-58e05b1dadf8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:24.205035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 266/529] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:24.206095 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452d174-5039-4207-83c3-58e05b1dadf8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:24.276937 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4c917-b681-432c-9fb0-0961dd4b00b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:24.278480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4c917-b681-432c-9fb0-0961dd4b00b4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:24.339019 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:24.347010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452d174-5039-4207-83c3-58e05b1dadf8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:24.374626 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:24.396031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86c43a-7606-4a99-871a-8dcd23d10024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:24.396852 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 264/530] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:24.397320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86c43a-7606-4a99-871a-8dcd23d10024 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:24.397749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86c43a-7606-4a99-871a-8dcd23d10024 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:24.397860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4c917-b681-432c-9fb0-0961dd4b00b4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:24.398253 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86c43a-7606-4a99-871a-8dcd23d10024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:24.413573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86c43a-7606-4a99-871a-8dcd23d10024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:24.415115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86c43a-7606-4a99-871a-8dcd23d10024 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:24.436520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-8d86c43a-7606-4a99-871a-8dcd23d10024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:24.436520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:24.436520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:24.436520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:24.436520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:24.436520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:24.436520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:24.436520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:24.436520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:24.436520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:24.436520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:24.436520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:24.436520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:24.436520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:24.436520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:24.437740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:24.438613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:24.438613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:24.438613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:24.438613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:24.443770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 267/531] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:24.444784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86c43a-7606-4a99-871a-8dcd23d10024 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:24.542299 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4c917-b681-432c-9fb0-0961dd4b00b4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:24.585105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86c43a-7606-4a99-871a-8dcd23d10024 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:24.586809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24593300-38a0-42d7-9526-8f0038db2f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:24.587798 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24593300-38a0-42d7-9526-8f0038db2f8c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:24.589133 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24593300-38a0-42d7-9526-8f0038db2f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:24.589562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24593300-38a0-42d7-9526-8f0038db2f8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:24.590560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24593300-38a0-42d7-9526-8f0038db2f8c None admin] RBAC: Adding query filter params (role.id=33cbf420a4284279a9010e820bcece79, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=dbc7e1bc2eb943eba57a0009635de70d) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:24.591069 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24593300-38a0-42d7-9526-8f0038db2f8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:24.592670 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24593300-38a0-42d7-9526-8f0038db2f8c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:24.600380 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 265/532] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:15:24 2022] GET /identity/v3/role_assignments?user.id=dbc7e1bc2eb943eba57a0009635de70d&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=33cbf420a4284279a9010e820bcece79 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:24.601518 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24593300-38a0-42d7-9526-8f0038db2f8c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:24.643521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:24.644770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f322f6-6c9e-4aca-933d-ac9d134f1851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:24.647530 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f322f6-6c9e-4aca-933d-ac9d134f1851 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:24.647807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f322f6-6c9e-4aca-933d-ac9d134f1851 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:24.648081 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f322f6-6c9e-4aca-933d-ac9d134f1851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:24.677696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f322f6-6c9e-4aca-933d-ac9d134f1851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:24.679784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f322f6-6c9e-4aca-933d-ac9d134f1851 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:24.727056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c1f322f6-6c9e-4aca-933d-ac9d134f1851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:24.727056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:24.727056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:24.727056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:24.727056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:24.727056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:24.727056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:24.727056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:24.727056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:24.727056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:24.727056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:24.727056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:24.727056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:24.727056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:24.727056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:24.728405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:24.729264 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:24.729264 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:24.729264 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:24.729264 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:24.734427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 268/533] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:24.740805 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f322f6-6c9e-4aca-933d-ac9d134f1851 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:24.783008 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24593300-38a0-42d7-9526-8f0038db2f8c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:24.785616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:24.848210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96449d1-e015-4e83-bf3e-5d492c76b254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:24.849102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96449d1-e015-4e83-bf3e-5d492c76b254 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:24.849383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96449d1-e015-4e83-bf3e-5d492c76b254 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:24.849654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96449d1-e015-4e83-bf3e-5d492c76b254 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:24.850387 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96449d1-e015-4e83-bf3e-5d492c76b254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:24.850699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96449d1-e015-4e83-bf3e-5d492c76b254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:24.852109 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96449d1-e015-4e83-bf3e-5d492c76b254 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:24.873003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 266/534] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:24.878303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96449d1-e015-4e83-bf3e-5d492c76b254 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:24.963103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:24.984745 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f322f6-6c9e-4aca-933d-ac9d134f1851 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:24.986685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96449d1-e015-4e83-bf3e-5d492c76b254 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:25.024729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce721529-0678-4c74-8516-2c927098119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:25.025681 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce721529-0678-4c74-8516-2c927098119a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:25.025971 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce721529-0678-4c74-8516-2c927098119a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:25.026252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce721529-0678-4c74-8516-2c927098119a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:25.034661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce721529-0678-4c74-8516-2c927098119a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:25.036744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce721529-0678-4c74-8516-2c927098119a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:25.053405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-ce721529-0678-4c74-8516-2c927098119a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:25.053405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:25.053405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:25.053405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:25.053405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:25.053405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:25.053405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:25.053405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:25.053405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:25.053405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:25.053405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:25.053405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:25.053405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:25.053405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:25.053405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:25.054289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:25.055284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:25.055284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:25.055284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:25.055284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:25.055284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:25.055284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:25.055284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:25.055284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:25.055284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 267/535] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:25.060323 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce721529-0678-4c74-8516-2c927098119a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:25.083137 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be50140-1cb4-4f2e-982b-0f5b5d894bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:25.083932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be50140-1cb4-4f2e-982b-0f5b5d894bfb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:25.084210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be50140-1cb4-4f2e-982b-0f5b5d894bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:25.084488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be50140-1cb4-4f2e-982b-0f5b5d894bfb None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:25.085232 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be50140-1cb4-4f2e-982b-0f5b5d894bfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:25.085542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be50140-1cb4-4f2e-982b-0f5b5d894bfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:25.090660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be50140-1cb4-4f2e-982b-0f5b5d894bfb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:25.119825 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 269/536] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:25.124521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be50140-1cb4-4f2e-982b-0f5b5d894bfb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:25.271861 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce721529-0678-4c74-8516-2c927098119a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:25.312502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:25.331309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be50140-1cb4-4f2e-982b-0f5b5d894bfb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:25.370230 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa7fe9-d77c-4cad-9ac3-54b543f57b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:25.371168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa7fe9-d77c-4cad-9ac3-54b543f57b5c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:25.371889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa7fe9-d77c-4cad-9ac3-54b543f57b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:25.372273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa7fe9-d77c-4cad-9ac3-54b543f57b5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:25.380744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa7fe9-d77c-4cad-9ac3-54b543f57b5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:25.382363 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa7fe9-d77c-4cad-9ac3-54b543f57b5c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:25.398191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c9fa7fe9-d77c-4cad-9ac3-54b543f57b5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:25.398191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:25.398191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:25.398191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:25.398191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:25.398191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:25.398191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:25.398191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:25.398191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:25.398191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:25.398191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:25.398191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:25.398191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:25.398191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:25.398191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:25.399130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:25.399988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:25.399988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:25.399988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:25.399988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:25.399988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:25.399988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:25.399988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:25.399988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:25.400405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 270/537] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:25.400472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5387c-62f4-4501-b9e8-6a6fe8ab85f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:25.400802 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5387c-62f4-4501-b9e8-6a6fe8ab85f0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:25.401087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5387c-62f4-4501-b9e8-6a6fe8ab85f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:25.401358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5387c-62f4-4501-b9e8-6a6fe8ab85f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:25.402165 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5387c-62f4-4501-b9e8-6a6fe8ab85f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:25.402475 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5387c-62f4-4501-b9e8-6a6fe8ab85f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:25.410983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5387c-62f4-4501-b9e8-6a6fe8ab85f0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:25.411427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa7fe9-d77c-4cad-9ac3-54b543f57b5c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:25.443292 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:25.447585 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 268/538] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:25.449349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5387c-62f4-4501-b9e8-6a6fe8ab85f0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:25.602869 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa7fe9-d77c-4cad-9ac3-54b543f57b5c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:25.636424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5387c-62f4-4501-b9e8-6a6fe8ab85f0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:25.668289 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7da91-9207-4e2c-afc1-09c013020312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:25.668954 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7da91-9207-4e2c-afc1-09c013020312 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:25.669238 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7da91-9207-4e2c-afc1-09c013020312 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:25.669513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7da91-9207-4e2c-afc1-09c013020312 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:25.670312 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7da91-9207-4e2c-afc1-09c013020312 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:25.670624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7da91-9207-4e2c-afc1-09c013020312 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:25.673167 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7da91-9207-4e2c-afc1-09c013020312 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:25.697632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 271/539] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:25.701435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7da91-9207-4e2c-afc1-09c013020312 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:25.702992 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36210ca-36a9-46af-90c2-83144c118410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:25.703660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36210ca-36a9-46af-90c2-83144c118410 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:25.703941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36210ca-36a9-46af-90c2-83144c118410 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:25.704215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36210ca-36a9-46af-90c2-83144c118410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:25.705053 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36210ca-36a9-46af-90c2-83144c118410 None admin] RBAC: Adding query filter params (role.id=33cbf420a4284279a9010e820bcece79, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=f2fcf925f9ec45b3b2cbea7e6acc0522) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:25.705359 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36210ca-36a9-46af-90c2-83144c118410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:25.710198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36210ca-36a9-46af-90c2-83144c118410 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:25.719025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:25.726863 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 269/540] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:15:25 2022] GET /identity/v3/role_assignments?user.id=f2fcf925f9ec45b3b2cbea7e6acc0522&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=33cbf420a4284279a9010e820bcece79 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:25.849764 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7da91-9207-4e2c-afc1-09c013020312 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:25.891920 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12ae86-f65e-424f-b80f-f6a7b08e3ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:25.892577 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12ae86-f65e-424f-b80f-f6a7b08e3ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:25.892859 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12ae86-f65e-424f-b80f-f6a7b08e3ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:25.893165 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12ae86-f65e-424f-b80f-f6a7b08e3ef5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:25.894050 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12ae86-f65e-424f-b80f-f6a7b08e3ef5 None admin] RBAC: Adding query filter params (role.id=33cbf420a4284279a9010e820bcece79, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=454b9259519c4332a8a36131c8273786) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:25.894358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12ae86-f65e-424f-b80f-f6a7b08e3ef5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:25.896335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12ae86-f65e-424f-b80f-f6a7b08e3ef5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:25.906874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 272/541] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:15:25 2022] GET /identity/v3/role_assignments?user.id=454b9259519c4332a8a36131c8273786&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=33cbf420a4284279a9010e820bcece79 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:26.066959 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a641c9-b344-428e-89a3-3b55090ecae2 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:26.067981 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a641c9-b344-428e-89a3-3b55090ecae2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:26.068201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a641c9-b344-428e-89a3-3b55090ecae2 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:26.069972 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 270/542] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:26.075518 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbdd64-6fcf-48ea-883b-90dcc24156d6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:26.075815 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbdd64-6fcf-48ea-883b-90dcc24156d6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:26.076091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbdd64-6fcf-48ea-883b-90dcc24156d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:26.095532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-50dbdd64-6fcf-48ea-883b-90dcc24156d6 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:26.096728 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-50dbdd64-6fcf-48ea-883b-90dcc24156d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:26.165699 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:26.171796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 273/543] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:26.207051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a641c9-b344-428e-89a3-3b55090ecae2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:26.208329 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f9cc1-3e97-4f07-9807-502411b74f30 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:26.208615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f9cc1-3e97-4f07-9807-502411b74f30 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:26.208890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f9cc1-3e97-4f07-9807-502411b74f30 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:26.210265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 274/544] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:15:26.222088 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d2509-fab2-4274-b773-adb8018f8367 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:26.222371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d2509-fab2-4274-b773-adb8018f8367 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:26.222810 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d2509-fab2-4274-b773-adb8018f8367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:26.244527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bf9d2509-fab2-4274-b773-adb8018f8367 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:26.245705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bf9d2509-fab2-4274-b773-adb8018f8367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:26.311046 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:26.386711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 275/545] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:15:26.402370 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a641c9-b344-428e-89a3-3b55090ecae2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:26.431402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d2509-fab2-4274-b773-adb8018f8367 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:26.455454 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c7fb5-d595-4540-9c1d-c2a3acdb1ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:26.456270 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c7fb5-d595-4540-9c1d-c2a3acdb1ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:26.456545 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c7fb5-d595-4540-9c1d-c2a3acdb1ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:26.456816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c7fb5-d595-4540-9c1d-c2a3acdb1ce9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:26.475531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c7fb5-d595-4540-9c1d-c2a3acdb1ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-9e9c7fb5-d595-4540-9c1d-c2a3acdb1ce9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:26.491004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:26.491953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:26.492759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:26.492759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:26.492759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:26.492759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:26.492759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:26.492759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:26.492759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:26.492759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:26.492759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:26.492759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:26.492759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:26.492759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:26.494610 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 271/546] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:26.503717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c7fb5-d595-4540-9c1d-c2a3acdb1ce9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:26.628660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d2509-fab2-4274-b773-adb8018f8367 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:26.677374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c7fb5-d595-4540-9c1d-c2a3acdb1ce9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:26.702814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:26.707320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50beddb-1484-43d4-883d-414ee81b9746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:26.709013 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50beddb-1484-43d4-883d-414ee81b9746 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:26.709299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50beddb-1484-43d4-883d-414ee81b9746 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:26.711204 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50beddb-1484-43d4-883d-414ee81b9746 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:26.727072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:26.734770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50beddb-1484-43d4-883d-414ee81b9746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a50beddb-1484-43d4-883d-414ee81b9746 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:26.746145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:26.747145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:26.747926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:26.747926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:26.747926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:26.747926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:26.747926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:26.747926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:26.747926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:26.747926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:26.747926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:26.747926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:26.747926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:26.747926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:26.752138 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f292e72-2f6d-49ff-9ada-d6a8cb0362bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:26.752824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f292e72-2f6d-49ff-9ada-d6a8cb0362bc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:26.753104 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f292e72-2f6d-49ff-9ada-d6a8cb0362bc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:26.753377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f292e72-2f6d-49ff-9ada-d6a8cb0362bc None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:26.754138 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f292e72-2f6d-49ff-9ada-d6a8cb0362bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:26.755014 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f292e72-2f6d-49ff-9ada-d6a8cb0362bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:26.756655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f292e72-2f6d-49ff-9ada-d6a8cb0362bc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:26.758228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 276/547] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:26.759175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50beddb-1484-43d4-883d-414ee81b9746 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:26.776304 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 272/548] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:26.781303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f292e72-2f6d-49ff-9ada-d6a8cb0362bc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:26.907337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50beddb-1484-43d4-883d-414ee81b9746 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:26.958303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f292e72-2f6d-49ff-9ada-d6a8cb0362bc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:26.966336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f95e6-da87-4f61-8866-c29f12f1313f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:26.967337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f95e6-da87-4f61-8866-c29f12f1313f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:26.967816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f95e6-da87-4f61-8866-c29f12f1313f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:26.968727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f95e6-da87-4f61-8866-c29f12f1313f None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:26.970047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f95e6-da87-4f61-8866-c29f12f1313f None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:26.970713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f95e6-da87-4f61-8866-c29f12f1313f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:26.972689 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f95e6-da87-4f61-8866-c29f12f1313f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:26.984734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 277/549] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:26.986691 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbfa41-6547-40e3-a1cc-b0d91117b253 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:26.987146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbfa41-6547-40e3-a1cc-b0d91117b253 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:26.987935 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbfa41-6547-40e3-a1cc-b0d91117b253 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:26.994224 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 278/550] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:26.995549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbfa41-6547-40e3-a1cc-b0d91117b253 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:27.001088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd359f8-0376-48d8-bdb9-88117c2424b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:27.001891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd359f8-0376-48d8-bdb9-88117c2424b4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:27.002167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd359f8-0376-48d8-bdb9-88117c2424b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:27.002440 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd359f8-0376-48d8-bdb9-88117c2424b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:27.014182 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd359f8-0376-48d8-bdb9-88117c2424b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:27.015792 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd359f8-0376-48d8-bdb9-88117c2424b4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:27.037620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-ecd359f8-0376-48d8-bdb9-88117c2424b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:27.037620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:27.037620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:27.037620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:27.037620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:27.037620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:27.037620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:27.037620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:27.037620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:27.037620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:27.037620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:27.037620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:27.037620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:27.037620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:27.037620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:27.038624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:27.039832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:27.039832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:27.039832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:27.039832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:27.039832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 273/551] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:27.040428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9024dd4-2d28-46d5-be3a-5b7b3f007523 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:27.040651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9024dd4-2d28-46d5-be3a-5b7b3f007523 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:27.040922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9024dd4-2d28-46d5-be3a-5b7b3f007523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:27.066446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:27.068848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d9024dd4-2d28-46d5-be3a-5b7b3f007523 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:27.070867 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d9024dd4-2d28-46d5-be3a-5b7b3f007523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:27.109077 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:27.124198 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbfa41-6547-40e3-a1cc-b0d91117b253 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:27.164869 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695682b7-da08-4164-a4b9-1d9cf35e8e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:27.166355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695682b7-da08-4164-a4b9-1d9cf35e8e2a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:27.166956 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 274/552] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:27.167222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695682b7-da08-4164-a4b9-1d9cf35e8e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:27.167782 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695682b7-da08-4164-a4b9-1d9cf35e8e2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:27.168025 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9024dd4-2d28-46d5-be3a-5b7b3f007523 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:27.188986 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695682b7-da08-4164-a4b9-1d9cf35e8e2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:27.193054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695682b7-da08-4164-a4b9-1d9cf35e8e2a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:27.221796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-695682b7-da08-4164-a4b9-1d9cf35e8e2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:27.221796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:27.221796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:27.221796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:27.221796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:27.221796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:27.221796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:27.221796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:27.221796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:27.221796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:27.221796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:27.221796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:27.221796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:27.221796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:27.221796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:27.222824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:27.224942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:27.224942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:27.224942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:27.224942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:27.227383 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 279/553] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:27.229046 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695682b7-da08-4164-a4b9-1d9cf35e8e2a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:27.323579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9024dd4-2d28-46d5-be3a-5b7b3f007523 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:27.360950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695682b7-da08-4164-a4b9-1d9cf35e8e2a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:27.376679 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa62e8-5e1f-413d-a40e-f0e105f86dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:27.378014 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa62e8-5e1f-413d-a40e-f0e105f86dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:27.378493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa62e8-5e1f-413d-a40e-f0e105f86dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:27.379022 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:27.379189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa62e8-5e1f-413d-a40e-f0e105f86dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:27.380111 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa62e8-5e1f-413d-a40e-f0e105f86dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:27.380621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa62e8-5e1f-413d-a40e-f0e105f86dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:27.382178 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa62e8-5e1f-413d-a40e-f0e105f86dd8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:27.395172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 275/554] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:27.396255 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa62e8-5e1f-413d-a40e-f0e105f86dd8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:27.403325 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2af600-5b48-4163-a814-ef35125581d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:27.404241 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2af600-5b48-4163-a814-ef35125581d7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:27.404645 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2af600-5b48-4163-a814-ef35125581d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:27.405021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2af600-5b48-4163-a814-ef35125581d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:27.417542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2af600-5b48-4163-a814-ef35125581d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-fa2af600-5b48-4163-a814-ef35125581d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:27.425632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:27.427529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:27.428580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:27.428580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:27.428580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:27.428580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:27.428580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:27.428580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:27.428580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:27.428580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:27.428580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:27.428580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:27.428580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:27.428580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:27.429598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:27.435199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 280/555] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:27.436152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2af600-5b48-4163-a814-ef35125581d7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:27.511554 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa62e8-5e1f-413d-a40e-f0e105f86dd8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:27.540335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2af600-5b48-4163-a814-ef35125581d7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:27.549080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e05c5-23cd-458a-a299-889acd6c43fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:27.549943 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e05c5-23cd-458a-a299-889acd6c43fa None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:27.550396 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e05c5-23cd-458a-a299-889acd6c43fa None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:27.553133 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e05c5-23cd-458a-a299-889acd6c43fa None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:27.553133 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e05c5-23cd-458a-a299-889acd6c43fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:27.553133 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e05c5-23cd-458a-a299-889acd6c43fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:27.553845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e05c5-23cd-458a-a299-889acd6c43fa None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:27.567739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 276/556] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:27.568998 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e05c5-23cd-458a-a299-889acd6c43fa None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:27.577516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185a3af-69da-4974-a3be-850302908a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:27.578316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185a3af-69da-4974-a3be-850302908a12 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:27.578596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185a3af-69da-4974-a3be-850302908a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:27.578913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185a3af-69da-4974-a3be-850302908a12 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:27.587191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185a3af-69da-4974-a3be-850302908a12 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:27.588901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185a3af-69da-4974-a3be-850302908a12 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b185a3af-69da-4974-a3be-850302908a12 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:27.604295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:27.605310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:27.606755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:27.606755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:27.606755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:27.606755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:27.606755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:27.606755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:27.606755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:27.606755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:27.606755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:15:27.606755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:27.610357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 281/557] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:15:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:27.611288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185a3af-69da-4974-a3be-850302908a12 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:27.638166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:27.670104 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:27.690190 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e05c5-23cd-458a-a299-889acd6c43fa None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:27.719473 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185a3af-69da-4974-a3be-850302908a12 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:27.731338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac10d7-0810-4287-bf02-de4f31dcd10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:27.732415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac10d7-0810-4287-bf02-de4f31dcd10a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:27.732901 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac10d7-0810-4287-bf02-de4f31dcd10a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:27.733377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac10d7-0810-4287-bf02-de4f31dcd10a None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:27.734449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac10d7-0810-4287-bf02-de4f31dcd10a None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:27.735037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac10d7-0810-4287-bf02-de4f31dcd10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:27.737957 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac10d7-0810-4287-bf02-de4f31dcd10a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:27.748592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 277/558] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:27.749752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac10d7-0810-4287-bf02-de4f31dcd10a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:27.762157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe371965-30b0-4430-b8ab-f15d56d3a554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:27.762941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe371965-30b0-4430-b8ab-f15d56d3a554 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:27.763223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe371965-30b0-4430-b8ab-f15d56d3a554 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:27.763498 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe371965-30b0-4430-b8ab-f15d56d3a554 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:27.771886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe371965-30b0-4430-b8ab-f15d56d3a554 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:27.773387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe371965-30b0-4430-b8ab-f15d56d3a554 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-fe371965-30b0-4430-b8ab-f15d56d3a554 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:27.788874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:27.789976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:27.790981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:27.790981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:27.790981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:27.790981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:27.790981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:27.790981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:27.790981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:27.790981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:27.790981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:15:27.790981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:27.790981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 282/559] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jul 20 19:15:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:27.791613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe371965-30b0-4430-b8ab-f15d56d3a554 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:27.869548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac10d7-0810-4287-bf02-de4f31dcd10a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:27.881124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:27.905135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe371965-30b0-4430-b8ab-f15d56d3a554 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:27.910522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859713bf-15df-42a5-8c92-117cc452d16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:27.912062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859713bf-15df-42a5-8c92-117cc452d16d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:27.912348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859713bf-15df-42a5-8c92-117cc452d16d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:27.912625 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859713bf-15df-42a5-8c92-117cc452d16d None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:27.913471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859713bf-15df-42a5-8c92-117cc452d16d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:27.913775 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859713bf-15df-42a5-8c92-117cc452d16d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:27.915325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859713bf-15df-42a5-8c92-117cc452d16d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:27.939064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 278/560] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jul 20 19:15:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:27.940006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859713bf-15df-42a5-8c92-117cc452d16d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:27.945765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:27.955517 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc977f-725b-4f36-b399-bea73ba30a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:27.960385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc977f-725b-4f36-b399-bea73ba30a15 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:27.960385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc977f-725b-4f36-b399-bea73ba30a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:27.960385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc977f-725b-4f36-b399-bea73ba30a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:27.974418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc977f-725b-4f36-b399-bea73ba30a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:27.976519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc977f-725b-4f36-b399-bea73ba30a15 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:28.001966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-cafc977f-725b-4f36-b399-bea73ba30a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:28.001966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:28.001966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:28.001966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:28.001966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:28.001966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:28.001966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:28.001966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:28.001966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:28.001966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:28.001966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:28.001966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:28.001966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:28.001966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:28.001966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:28.003039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:28.003941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:28.003941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:28.003941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:28.003941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:28.005324 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 283/561] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:28.006352 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc977f-725b-4f36-b399-bea73ba30a15 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:28.057516 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859713bf-15df-42a5-8c92-117cc452d16d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:28.100551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8af5-8d90-446c-8386-5cefbba3eae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:28.102286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8af5-8d90-446c-8386-5cefbba3eae9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:28.103197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8af5-8d90-446c-8386-5cefbba3eae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:28.108979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8af5-8d90-446c-8386-5cefbba3eae9 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:28.108979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd8af5-8d90-446c-8386-5cefbba3eae9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:28.108979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd8af5-8d90-446c-8386-5cefbba3eae9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:28.108979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd8af5-8d90-446c-8386-5cefbba3eae9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:28.133668 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 279/562] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 20 19:15:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:28.135774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8af5-8d90-446c-8386-5cefbba3eae9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:28.138525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc977f-725b-4f36-b399-bea73ba30a15 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:28.182343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c626c-53bc-43e4-8954-a7217df0a20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:28.183581 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c626c-53bc-43e4-8954-a7217df0a20d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:28.184099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c626c-53bc-43e4-8954-a7217df0a20d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:28.184609 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c626c-53bc-43e4-8954-a7217df0a20d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:28.188316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:28.222903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:28.257929 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c626c-53bc-43e4-8954-a7217df0a20d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:28.259452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c626c-53bc-43e4-8954-a7217df0a20d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:28.261229 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8af5-8d90-446c-8386-5cefbba3eae9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:28.296459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84d1ef-331e-4458-ae4a-056cbadd65cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:28.297129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84d1ef-331e-4458-ae4a-056cbadd65cb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:28.297411 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84d1ef-331e-4458-ae4a-056cbadd65cb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:28.297682 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84d1ef-331e-4458-ae4a-056cbadd65cb None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:28.299194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84d1ef-331e-4458-ae4a-056cbadd65cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:28.299194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84d1ef-331e-4458-ae4a-056cbadd65cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:28.300108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84d1ef-331e-4458-ae4a-056cbadd65cb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:28.311942 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 280/563] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:28.312656 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84d1ef-331e-4458-ae4a-056cbadd65cb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:28.369013 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 284/564] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:28.370580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62c748-1d47-414a-8f7d-5ea7f784da87 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:28.370900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62c748-1d47-414a-8f7d-5ea7f784da87 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:28.371202 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62c748-1d47-414a-8f7d-5ea7f784da87 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:28.372480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 285/565] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:28.373555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39c5b5-b7d0-4e19-8c81-d276e8ec2ce9 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:28.373883 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39c5b5-b7d0-4e19-8c81-d276e8ec2ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:28.374089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39c5b5-b7d0-4e19-8c81-d276e8ec2ce9 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:28.379830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 286/566] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:28.380639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39c5b5-b7d0-4e19-8c81-d276e8ec2ce9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:28.416902 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:28.418478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84d1ef-331e-4458-ae4a-056cbadd65cb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:28.441601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:28.453426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3a924-d21f-410e-be24-5aaa077f3aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:28.454218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3a924-d21f-410e-be24-5aaa077f3aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:28.454499 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3a924-d21f-410e-be24-5aaa077f3aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:28.454803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3a924-d21f-410e-be24-5aaa077f3aa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:28.465242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3a924-d21f-410e-be24-5aaa077f3aa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:28.466733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3a924-d21f-410e-be24-5aaa077f3aa5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:28.483058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39c5b5-b7d0-4e19-8c81-d276e8ec2ce9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:28.484435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b2c3a924-d21f-410e-be24-5aaa077f3aa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:28.484435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:28.484435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:28.484435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:28.484435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:28.484435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:28.484435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:28.484435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:28.484435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:28.484435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:28.484435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:28.484435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:28.484435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:28.484435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:28.484435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:28.485315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:28.486200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:28.486200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:28.486200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:28.486200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:28.486200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 281/567] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:28.487468 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3a924-d21f-410e-be24-5aaa077f3aa5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:28.522277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60c99f-5f19-4970-8e61-8fcafbfa2068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:28.523101 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60c99f-5f19-4970-8e61-8fcafbfa2068 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:28.523381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60c99f-5f19-4970-8e61-8fcafbfa2068 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:28.523651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60c99f-5f19-4970-8e61-8fcafbfa2068 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:28.531287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60c99f-5f19-4970-8e61-8fcafbfa2068 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:28.532749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60c99f-5f19-4970-8e61-8fcafbfa2068 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7b60c99f-5f19-4970-8e61-8fcafbfa2068 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:28.548364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:28.556449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:28.558391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:28.558391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:28.558391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:28.558391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:28.558391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:28.558391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:28.558391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:28.558391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:28.558391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:15:28.558391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:28.558391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 287/568] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:28.558391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183df9a-c4ae-42a2-8d40-8f1ff0fea202 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:28.558391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183df9a-c4ae-42a2-8d40-8f1ff0fea202 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:28.559149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183df9a-c4ae-42a2-8d40-8f1ff0fea202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:28.569302 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a183df9a-c4ae-42a2-8d40-8f1ff0fea202 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:28.570437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a183df9a-c4ae-42a2-8d40-8f1ff0fea202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:28.595122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3a924-d21f-410e-be24-5aaa077f3aa5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:28.630315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0889d-2fba-4ec9-950d-7828ea1558e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:28.631132 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0889d-2fba-4ec9-950d-7828ea1558e2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:28.631416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0889d-2fba-4ec9-950d-7828ea1558e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:28.631687 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0889d-2fba-4ec9-950d-7828ea1558e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:28.636256 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 288/569] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:28.637513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6063c-5125-41e5-9d1f-72b8c2c2d152 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:28.637796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6063c-5125-41e5-9d1f-72b8c2c2d152 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:28.638073 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6063c-5125-41e5-9d1f-72b8c2c2d152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:28.642140 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0889d-2fba-4ec9-950d-7828ea1558e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:28.643633 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0889d-2fba-4ec9-950d-7828ea1558e2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:28.663049 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0ed6063c-5125-41e5-9d1f-72b8c2c2d152 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:28.664223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0ed6063c-5125-41e5-9d1f-72b8c2c2d152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:28.665232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-81f0889d-2fba-4ec9-950d-7828ea1558e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:28.665232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:28.665232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:28.665232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:28.665232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:28.665232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:28.665232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:28.665232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:28.665232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:28.665232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:28.665232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:28.665232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:28.665232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:28.665232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:28.665232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:28.666094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:28.667466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:28.667466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:28.667466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:28.667466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:28.667466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 282/570] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:28.667466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0889d-2fba-4ec9-950d-7828ea1558e2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:28.683529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:28.698231 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:28.743110 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 289/571] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:28.743110 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6063c-5125-41e5-9d1f-72b8c2c2d152 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:28.780476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0889d-2fba-4ec9-950d-7828ea1558e2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:28.815218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c7040-f8bf-44c1-a041-df940545793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:28.815878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c7040-f8bf-44c1-a041-df940545793a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:28.816159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c7040-f8bf-44c1-a041-df940545793a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:28.816459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c7040-f8bf-44c1-a041-df940545793a None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:28.817773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c7040-f8bf-44c1-a041-df940545793a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:28.818075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c7040-f8bf-44c1-a041-df940545793a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:28.819742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c7040-f8bf-44c1-a041-df940545793a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:28.831486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 283/572] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:28.832649 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c7040-f8bf-44c1-a041-df940545793a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:28.841616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6063c-5125-41e5-9d1f-72b8c2c2d152 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:28.875363 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b31c33-d028-4393-8029-e055c549d2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:28.876032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b31c33-d028-4393-8029-e055c549d2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:28.876309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b31c33-d028-4393-8029-e055c549d2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:28.876579 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b31c33-d028-4393-8029-e055c549d2e0 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:28.877420 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b31c33-d028-4393-8029-e055c549d2e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:28.877727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b31c33-d028-4393-8029-e055c549d2e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:28.879802 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b31c33-d028-4393-8029-e055c549d2e0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:28.897706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 290/573] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 20 19:15:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:28.898437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b31c33-d028-4393-8029-e055c549d2e0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:28.912783 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:28.921696 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:28.935983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c7040-f8bf-44c1-a041-df940545793a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:28.969523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38e76b-734a-47a7-945e-e4ac5bf536a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:28.970317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38e76b-734a-47a7-945e-e4ac5bf536a6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:28.970596 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38e76b-734a-47a7-945e-e4ac5bf536a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:28.970893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38e76b-734a-47a7-945e-e4ac5bf536a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:28.981127 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38e76b-734a-47a7-945e-e4ac5bf536a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5a38e76b-734a-47a7-945e-e4ac5bf536a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:28.989280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:28.990250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:28.991147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:28.991147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:28.991147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:28.991147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:28.991147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:28.991147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:28.991147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:28.991147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:28.991147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:28.991147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:28.991147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:28.991147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:28.991147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 284/574] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:28.991841 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38e76b-734a-47a7-945e-e4ac5bf536a6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:28.998573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b31c33-d028-4393-8029-e055c549d2e0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:29.032394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271aac73-836f-42b1-9f65-f9e8b611063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:29.033050 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aac73-836f-42b1-9f65-f9e8b611063b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:29.033328 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aac73-836f-42b1-9f65-f9e8b611063b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:29.033599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aac73-836f-42b1-9f65-f9e8b611063b None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:29.034322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271aac73-836f-42b1-9f65-f9e8b611063b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:29.034627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271aac73-836f-42b1-9f65-f9e8b611063b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:29.036657 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271aac73-836f-42b1-9f65-f9e8b611063b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:29.047786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 291/575] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:29.048581 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271aac73-836f-42b1-9f65-f9e8b611063b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:29.098445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38e76b-734a-47a7-945e-e4ac5bf536a6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:29.118389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:29.132406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd8a06-02f9-42a8-8897-0f9b6fffd1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:29.133216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd8a06-02f9-42a8-8897-0f9b6fffd1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:29.133485 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd8a06-02f9-42a8-8897-0f9b6fffd1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:29.133757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd8a06-02f9-42a8-8897-0f9b6fffd1f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:29.144203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd8a06-02f9-42a8-8897-0f9b6fffd1f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:29.148875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271aac73-836f-42b1-9f65-f9e8b611063b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d2dd8a06-02f9-42a8-8897-0f9b6fffd1f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:29.152810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:29.153849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:29.154729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:29.154729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:29.154729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:29.154729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:29.154729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:29.154729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:29.154729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:29.154729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:29.154729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:29.154729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:29.154729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:29.154729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:29.154729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 285/576] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:29.155435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd8a06-02f9-42a8-8897-0f9b6fffd1f4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:29.164945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:29.185062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11fe1d-2107-42af-b899-e687bd4a4e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:29.185856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11fe1d-2107-42af-b899-e687bd4a4e82 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:29.186136 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11fe1d-2107-42af-b899-e687bd4a4e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:29.186697 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11fe1d-2107-42af-b899-e687bd4a4e82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:29.194329 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11fe1d-2107-42af-b899-e687bd4a4e82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:29.195827 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11fe1d-2107-42af-b899-e687bd4a4e82 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:29.211171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-be11fe1d-2107-42af-b899-e687bd4a4e82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:29.211171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:29.211171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:29.211171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:29.211171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:29.211171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:29.211171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:29.211171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:29.211171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:29.211171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:29.211171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:29.211171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:29.211171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:29.211171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:29.211171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:29.212282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:29.213533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:29.213533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:29.213533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:29.213533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:29.213533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:29.213533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:29.213533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:29.213533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:29.213533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 292/577] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:29.213533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11fe1d-2107-42af-b899-e687bd4a4e82 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:29.259264 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd8a06-02f9-42a8-8897-0f9b6fffd1f4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:29.296330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c7d66-6b97-4273-af91-872439d6b36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:29.297124 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c7d66-6b97-4273-af91-872439d6b36c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:29.297397 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c7d66-6b97-4273-af91-872439d6b36c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:29.297661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c7d66-6b97-4273-af91-872439d6b36c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:29.309340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c7d66-6b97-4273-af91-872439d6b36c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:29.310826 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c7d66-6b97-4273-af91-872439d6b36c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:29.316380 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11fe1d-2107-42af-b899-e687bd4a4e82 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:29.328153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-848c7d66-6b97-4273-af91-872439d6b36c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:29.328153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:29.328153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:29.328153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:29.328153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:29.328153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:29.328153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:29.328153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:29.328153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:29.328153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:29.328153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:29.328153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:29.328153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:29.328153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:29.328153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:29.329061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:29.330427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:29.330427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:29.330427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:29.330427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:29.330427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 286/578] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:29.330427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c7d66-6b97-4273-af91-872439d6b36c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:29.352400 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:29.359119 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa92ee-6a1a-4cbe-b212-497f4c0d4433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:29.359792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa92ee-6a1a-4cbe-b212-497f4c0d4433 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:29.360072 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa92ee-6a1a-4cbe-b212-497f4c0d4433 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:29.360353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa92ee-6a1a-4cbe-b212-497f4c0d4433 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:29.362824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa92ee-6a1a-4cbe-b212-497f4c0d4433 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:29.363140 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa92ee-6a1a-4cbe-b212-497f4c0d4433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:29.365087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa92ee-6a1a-4cbe-b212-497f4c0d4433 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:29.373824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 293/579] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:29.374721 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa92ee-6a1a-4cbe-b212-497f4c0d4433 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:29.396500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:29.439456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c7d66-6b97-4273-af91-872439d6b36c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:29.473583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b6b87-c03d-4a51-bb55-d06b0173ce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:29.474467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b6b87-c03d-4a51-bb55-d06b0173ce11 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:29.474786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b6b87-c03d-4a51-bb55-d06b0173ce11 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:29.475057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b6b87-c03d-4a51-bb55-d06b0173ce11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:29.481340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa92ee-6a1a-4cbe-b212-497f4c0d4433 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:29.481823 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b6b87-c03d-4a51-bb55-d06b0173ce11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:29.483335 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b6b87-c03d-4a51-bb55-d06b0173ce11 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:29.497744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-689b6b87-c03d-4a51-bb55-d06b0173ce11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:29.497744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:29.497744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:29.497744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:29.497744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:29.497744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:29.497744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:29.497744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:29.497744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:29.497744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:29.497744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:29.497744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:29.497744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:29.497744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:29.497744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:29.498665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:29.499710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:29.499710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:29.499710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:29.499710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:29.499710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:29.499710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:29.499710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:29.499710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:29.504098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 287/580] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:29.504602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b6b87-c03d-4a51-bb55-d06b0173ce11 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:29.514490 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc8352-27b0-4644-99a0-7b2c09de8fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:29.515185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc8352-27b0-4644-99a0-7b2c09de8fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:29.515463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc8352-27b0-4644-99a0-7b2c09de8fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:29.515731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc8352-27b0-4644-99a0-7b2c09de8fd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:29.516474 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc8352-27b0-4644-99a0-7b2c09de8fd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:29.516780 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc8352-27b0-4644-99a0-7b2c09de8fd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:29.518207 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc8352-27b0-4644-99a0-7b2c09de8fd7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:29.527026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 294/581] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:29.530996 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc8352-27b0-4644-99a0-7b2c09de8fd7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:29.636738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:29.642817 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b6b87-c03d-4a51-bb55-d06b0173ce11 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:29.660929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:29.677526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b521a-7e4d-4a7a-8a1d-5371593c585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:29.678178 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b521a-7e4d-4a7a-8a1d-5371593c585f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:29.678453 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b521a-7e4d-4a7a-8a1d-5371593c585f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:29.678747 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b521a-7e4d-4a7a-8a1d-5371593c585f None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:29.679532 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b521a-7e4d-4a7a-8a1d-5371593c585f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:29.679829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b521a-7e4d-4a7a-8a1d-5371593c585f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:29.680115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc8352-27b0-4644-99a0-7b2c09de8fd7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:29.681253 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b521a-7e4d-4a7a-8a1d-5371593c585f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:29.694248 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 288/582] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:29.695102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b521a-7e4d-4a7a-8a1d-5371593c585f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:29.715099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa535e6-ef46-44f8-862b-86292c3f425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:29.715760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa535e6-ef46-44f8-862b-86292c3f425a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:29.716035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa535e6-ef46-44f8-862b-86292c3f425a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:29.716306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa535e6-ef46-44f8-862b-86292c3f425a None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:29.717023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa535e6-ef46-44f8-862b-86292c3f425a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:29.717350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa535e6-ef46-44f8-862b-86292c3f425a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:29.718712 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa535e6-ef46-44f8-862b-86292c3f425a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:29.730499 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 295/583] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:29.731174 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa535e6-ef46-44f8-862b-86292c3f425a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:29.799571 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b521a-7e4d-4a7a-8a1d-5371593c585f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:29.831749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa535e6-ef46-44f8-862b-86292c3f425a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:29.834958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68063c7e-2dea-4191-97bb-9b73482218f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:29.835746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68063c7e-2dea-4191-97bb-9b73482218f0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:29.836022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68063c7e-2dea-4191-97bb-9b73482218f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:29.836286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68063c7e-2dea-4191-97bb-9b73482218f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:29.846522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68063c7e-2dea-4191-97bb-9b73482218f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:29.848131 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68063c7e-2dea-4191-97bb-9b73482218f0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:29.848874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:29.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-68063c7e-2dea-4191-97bb-9b73482218f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:29.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:29.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:29.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:29.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:29.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:29.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:29.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:29.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:29.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:29.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:29.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:29.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:29.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:29.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:29.867006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:29.868184 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:29.868184 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:29.868184 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:29.868184 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:29.868454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9037937-92ea-4580-9daa-87373c821429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:29.868454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9037937-92ea-4580-9daa-87373c821429 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:29.868454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9037937-92ea-4580-9daa-87373c821429 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:29.868454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9037937-92ea-4580-9daa-87373c821429 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:29.868780 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9037937-92ea-4580-9daa-87373c821429 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:29.868780 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9037937-92ea-4580-9daa-87373c821429 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:29.869724 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9037937-92ea-4580-9daa-87373c821429 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:29.870846 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 289/584] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:29.872078 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68063c7e-2dea-4191-97bb-9b73482218f0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:29.881966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 296/585] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:29.881966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9037937-92ea-4580-9daa-87373c821429 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:29.904787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:29.973778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68063c7e-2dea-4191-97bb-9b73482218f0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:29.987227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9037937-92ea-4580-9daa-87373c821429 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:30.007949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02522b1-1040-46a9-bf81-73605f81fc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:30.008736 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02522b1-1040-46a9-bf81-73605f81fc4b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:30.009011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02522b1-1040-46a9-bf81-73605f81fc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:30.009279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02522b1-1040-46a9-bf81-73605f81fc4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:30.019864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02522b1-1040-46a9-bf81-73605f81fc4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:30.021313 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02522b1-1040-46a9-bf81-73605f81fc4b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:30.022552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beeff8c-4920-42ae-bd09-77dbcc2028e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:30.023469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beeff8c-4920-42ae-bd09-77dbcc2028e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:30.023752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beeff8c-4920-42ae-bd09-77dbcc2028e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:30.024026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beeff8c-4920-42ae-bd09-77dbcc2028e5 None admin] PATH_INFO: `/v3/projects/50abbf0c38634795be669ec69da1f06d/users/e3fd38ebb5514af686204d0b02a91edd/roles/33cbf420a4284279a9010e820bcece79` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:30.038699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f02522b1-1040-46a9-bf81-73605f81fc4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:30.038699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:30.038699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:30.038699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:30.038699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:30.038699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:30.038699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:30.038699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:30.038699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:30.038699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:30.038699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:30.038699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:30.038699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:30.038699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:30.038699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:30.039732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:30.040611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:30.040611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:30.040611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:30.040611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:30.040864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beeff8c-4920-42ae-bd09-77dbcc2028e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=50abbf0c38634795be669ec69da1f06d, user_id=e3fd38ebb5514af686204d0b02a91edd, role_id=33cbf420a4284279a9010e820bcece79)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:30.040939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 290/586] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:30.041006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beeff8c-4920-42ae-bd09-77dbcc2028e5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:30.041074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02522b1-1040-46a9-bf81-73605f81fc4b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:30.102127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 297/587] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:15:29 2022] PUT /identity/v3/projects/50abbf0c38634795be669ec69da1f06d/users/e3fd38ebb5514af686204d0b02a91edd/roles/33cbf420a4284279a9010e820bcece79 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:15:30.103053 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beeff8c-4920-42ae-bd09-77dbcc2028e5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:30.135814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:30.138256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:30.158019 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02522b1-1040-46a9-bf81-73605f81fc4b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:30.197687 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6b0b7-a154-458a-ac8b-5f556c0e849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:30.198537 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6b0b7-a154-458a-ac8b-5f556c0e849e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:30.198847 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6b0b7-a154-458a-ac8b-5f556c0e849e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:30.199120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6b0b7-a154-458a-ac8b-5f556c0e849e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:30.208033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6b0b7-a154-458a-ac8b-5f556c0e849e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:30.209523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6b0b7-a154-458a-ac8b-5f556c0e849e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:30.218727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beeff8c-4920-42ae-bd09-77dbcc2028e5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:30.225730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-fda6b0b7-a154-458a-ac8b-5f556c0e849e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:30.225730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:30.225730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:30.225730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:30.225730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:30.225730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:30.225730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:30.225730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:30.225730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:30.225730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:30.225730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:30.225730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:30.225730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:30.225730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:30.225730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:30.226743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:30.227658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:30.227658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:30.227658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:30.227658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:30.227658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:30.227658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:30.227658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:30.227658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:30.230848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 291/588] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:30.232307 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6b0b7-a154-458a-ac8b-5f556c0e849e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:30.268414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2b522-ae4e-4340-94bd-d20ed90a6bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:30.269090 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2b522-ae4e-4340-94bd-d20ed90a6bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:30.269471 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2b522-ae4e-4340-94bd-d20ed90a6bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:30.269728 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2b522-ae4e-4340-94bd-d20ed90a6bc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:30.270473 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2b522-ae4e-4340-94bd-d20ed90a6bc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:30.270794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2b522-ae4e-4340-94bd-d20ed90a6bc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:30.272192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2b522-ae4e-4340-94bd-d20ed90a6bc2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:30.290813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 298/589] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:30.291671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2b522-ae4e-4340-94bd-d20ed90a6bc2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:30.353168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6b0b7-a154-458a-ac8b-5f556c0e849e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:30.388588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:30.390093 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bab343-ed44-4990-9b93-2de05ecb0f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:30.390774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bab343-ed44-4990-9b93-2de05ecb0f3a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:30.391056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bab343-ed44-4990-9b93-2de05ecb0f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:30.391322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bab343-ed44-4990-9b93-2de05ecb0f3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:30.392158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bab343-ed44-4990-9b93-2de05ecb0f3a None admin] RBAC: Adding query filter params (role.id=33cbf420a4284279a9010e820bcece79, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=fde62f4ce7af42eca1fe5a7b6807d1ae) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:30.392461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bab343-ed44-4990-9b93-2de05ecb0f3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:30.393886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bab343-ed44-4990-9b93-2de05ecb0f3a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:30.400089 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 292/590] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:15:30 2022] GET /identity/v3/role_assignments?user.id=fde62f4ce7af42eca1fe5a7b6807d1ae&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=33cbf420a4284279a9010e820bcece79 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:30.400917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bab343-ed44-4990-9b93-2de05ecb0f3a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:30.406317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2b522-ae4e-4340-94bd-d20ed90a6bc2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:30.411423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:30.459431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9671ff-320d-496c-be3a-2809a46cdba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:30.460138 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9671ff-320d-496c-be3a-2809a46cdba0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:30.460414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9671ff-320d-496c-be3a-2809a46cdba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:30.460829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9671ff-320d-496c-be3a-2809a46cdba0 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:30.461572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9671ff-320d-496c-be3a-2809a46cdba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:30.461879 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9671ff-320d-496c-be3a-2809a46cdba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:30.464277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9671ff-320d-496c-be3a-2809a46cdba0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:30.485148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 299/591] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:30.486134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9671ff-320d-496c-be3a-2809a46cdba0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:30.522632 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bab343-ed44-4990-9b93-2de05ecb0f3a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:30.561959 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b805b5-1509-4a78-bd2e-78cedf3b508d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:30.563109 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b805b5-1509-4a78-bd2e-78cedf3b508d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:30.563698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b805b5-1509-4a78-bd2e-78cedf3b508d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:30.564166 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b805b5-1509-4a78-bd2e-78cedf3b508d None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:30.565161 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b805b5-1509-4a78-bd2e-78cedf3b508d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:30.565802 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b805b5-1509-4a78-bd2e-78cedf3b508d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:30.569176 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b805b5-1509-4a78-bd2e-78cedf3b508d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:30.583914 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 293/592] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:30.585087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b805b5-1509-4a78-bd2e-78cedf3b508d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:30.623711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9671ff-320d-496c-be3a-2809a46cdba0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:30.665452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f542a-2774-44de-ba56-d8803b0e7c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:30.666407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f542a-2774-44de-ba56-d8803b0e7c41 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:30.666888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f542a-2774-44de-ba56-d8803b0e7c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:30.667258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f542a-2774-44de-ba56-d8803b0e7c41 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:30.675366 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f542a-2774-44de-ba56-d8803b0e7c41 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:30.677558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f542a-2774-44de-ba56-d8803b0e7c41 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:30.678782 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-8e2f542a-2774-44de-ba56-d8803b0e7c41 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:30.694938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:30.696144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:30.697297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:30.697297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:30.697297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:30.697297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:30.697297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:30.697297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:30.697297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:30.697297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:30.697297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:15:30.697297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:30.699302 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 300/593] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:30.700357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f542a-2774-44de-ba56-d8803b0e7c41 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:30.709829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:30.723538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b805b5-1509-4a78-bd2e-78cedf3b508d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:30.767484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5aacf-77d3-495c-a6bc-0b79c2faab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:30.768659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5aacf-77d3-495c-a6bc-0b79c2faab69 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:30.769141 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5aacf-77d3-495c-a6bc-0b79c2faab69 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:30.769661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5aacf-77d3-495c-a6bc-0b79c2faab69 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:30.779403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5aacf-77d3-495c-a6bc-0b79c2faab69 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:30.781366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5aacf-77d3-495c-a6bc-0b79c2faab69 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-10c5aacf-77d3-495c-a6bc-0b79c2faab69 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:30.798999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:30.800006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:30.801502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:30.801502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:30.801502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:30.801502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:30.801502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:30.801502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:30.801502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:30.801502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:30.801502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:15:30.801502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:30.804400 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 294/594] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:30.805715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5aacf-77d3-495c-a6bc-0b79c2faab69 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:30.820904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f542a-2774-44de-ba56-d8803b0e7c41 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:30.869776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e4d88-adb5-4347-bac0-f60fdc2b1cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:30.870727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e4d88-adb5-4347-bac0-f60fdc2b1cfa None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:30.871296 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e4d88-adb5-4347-bac0-f60fdc2b1cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:30.871580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e4d88-adb5-4347-bac0-f60fdc2b1cfa None admin] PATH_INFO: `/v3/projects/50abbf0c38634795be669ec69da1f06d/users/dbc7e1bc2eb943eba57a0009635de70d/roles/33cbf420a4284279a9010e820bcece79` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:30.893350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e4d88-adb5-4347-bac0-f60fdc2b1cfa None admin] RBAC: Authorizing `identity:create_grant(project_id=50abbf0c38634795be669ec69da1f06d, user_id=dbc7e1bc2eb943eba57a0009635de70d, role_id=33cbf420a4284279a9010e820bcece79)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:30.895803 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e4d88-adb5-4347-bac0-f60fdc2b1cfa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:30.918326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5aacf-77d3-495c-a6bc-0b79c2faab69 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:30.949374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:30.958504 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990f0e0-615c-47fd-b4b6-762674ad3fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:30.959301 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990f0e0-615c-47fd-b4b6-762674ad3fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:30.959677 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990f0e0-615c-47fd-b4b6-762674ad3fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:30.960042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990f0e0-615c-47fd-b4b6-762674ad3fa2 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:30.960977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990f0e0-615c-47fd-b4b6-762674ad3fa2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:30.961383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990f0e0-615c-47fd-b4b6-762674ad3fa2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:30.962952 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990f0e0-615c-47fd-b4b6-762674ad3fa2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:30.979594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 301/595] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:15:30 2022] PUT /identity/v3/projects/50abbf0c38634795be669ec69da1f06d/users/dbc7e1bc2eb943eba57a0009635de70d/roles/33cbf420a4284279a9010e820bcece79 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:15:30.981195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e4d88-adb5-4347-bac0-f60fdc2b1cfa None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:30.984998 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 295/596] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 20 19:15:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:30.988970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990f0e0-615c-47fd-b4b6-762674ad3fa2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:31.117061 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:31.194772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990f0e0-615c-47fd-b4b6-762674ad3fa2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:31.204017 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e4d88-adb5-4347-bac0-f60fdc2b1cfa None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:31.229995 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0c3b6-0c5a-4158-84ce-626d131e5ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:31.230821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0c3b6-0c5a-4158-84ce-626d131e5ebc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:31.231098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0c3b6-0c5a-4158-84ce-626d131e5ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:31.231365 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0c3b6-0c5a-4158-84ce-626d131e5ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:31.244407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0c3b6-0c5a-4158-84ce-626d131e5ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:31.245866 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0c3b6-0c5a-4158-84ce-626d131e5ebc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:31.247894 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0b54c-07bd-4d12-adf0-f5c97ca0193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:31.255560 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0b54c-07bd-4d12-adf0-f5c97ca0193e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:31.256255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0b54c-07bd-4d12-adf0-f5c97ca0193e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:31.256532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0b54c-07bd-4d12-adf0-f5c97ca0193e None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:31.257706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0b54c-07bd-4d12-adf0-f5c97ca0193e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:31.258014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0b54c-07bd-4d12-adf0-f5c97ca0193e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:31.259540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0b54c-07bd-4d12-adf0-f5c97ca0193e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:31.266495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5be0c3b6-0c5a-4158-84ce-626d131e5ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:31.266495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:31.266495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:31.266495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:31.266495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:31.266495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:31.266495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:31.266495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:31.266495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:31.266495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:31.266495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:31.266495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:31.266495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:31.266495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:31.266495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:31.267478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:31.268367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:31.268367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:31.268367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:31.268367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:31.268367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 296/597] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:31.276071 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0c3b6-0c5a-4158-84ce-626d131e5ebc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:31.282789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 302/598] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 20 19:15:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:31.291808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0b54c-07bd-4d12-adf0-f5c97ca0193e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:31.346326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:31.428931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0c3b6-0c5a-4158-84ce-626d131e5ebc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:31.467183 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80666cad-dcf2-4983-8fb5-86e9ac451ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:31.468666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80666cad-dcf2-4983-8fb5-86e9ac451ffc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:31.468945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80666cad-dcf2-4983-8fb5-86e9ac451ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:31.469215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80666cad-dcf2-4983-8fb5-86e9ac451ffc None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:31.469932 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80666cad-dcf2-4983-8fb5-86e9ac451ffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:31.470232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80666cad-dcf2-4983-8fb5-86e9ac451ffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:31.471614 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80666cad-dcf2-4983-8fb5-86e9ac451ffc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:31.485561 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 297/599] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:31.491713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80666cad-dcf2-4983-8fb5-86e9ac451ffc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:31.546983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0b54c-07bd-4d12-adf0-f5c97ca0193e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:31.576356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:31.599545 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80666cad-dcf2-4983-8fb5-86e9ac451ffc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:31.611819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:31.619251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52287a80-b9fe-4c66-9056-53b3209c4b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:31.620644 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52287a80-b9fe-4c66-9056-53b3209c4b80 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:31.621022 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52287a80-b9fe-4c66-9056-53b3209c4b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:31.621299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52287a80-b9fe-4c66-9056-53b3209c4b80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:31.637080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07de597-16bb-48d9-974d-d3e5de1f9bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:31.638320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07de597-16bb-48d9-974d-d3e5de1f9bba None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:31.638787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07de597-16bb-48d9-974d-d3e5de1f9bba None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:31.639211 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07de597-16bb-48d9-974d-d3e5de1f9bba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:31.647145 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07de597-16bb-48d9-974d-d3e5de1f9bba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:31.647410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52287a80-b9fe-4c66-9056-53b3209c4b80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:31.649033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07de597-16bb-48d9-974d-d3e5de1f9bba None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:31.650350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52287a80-b9fe-4c66-9056-53b3209c4b80 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:31.666626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e07de597-16bb-48d9-974d-d3e5de1f9bba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:31.666626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:31.666626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:31.666626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:31.666626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:31.666626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:31.666626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:31.666626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:31.666626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:31.666626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:31.666626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:31.666626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:31.666626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:31.666626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:31.666626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:31.667791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:31.668774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:31.668774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:31.668774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:31.668774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:31.668774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:31.668774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:31.668774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:31.668774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:31.675103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 298/600] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:31.676996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07de597-16bb-48d9-974d-d3e5de1f9bba None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:31.690650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-52287a80-b9fe-4c66-9056-53b3209c4b80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:31.690650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:31.690650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:31.690650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:31.690650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:31.690650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:31.690650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:31.690650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:31.690650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:31.690650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:31.690650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:31.690650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:31.690650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:31.690650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:31.690650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:31.691886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:31.694188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:31.694188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:31.694188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:31.694188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:31.699192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 303/601] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:31.704318 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52287a80-b9fe-4c66-9056-53b3209c4b80 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:31.817875 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07de597-16bb-48d9-974d-d3e5de1f9bba None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:31.877143 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52287a80-b9fe-4c66-9056-53b3209c4b80 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:31.921393 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be480e2e-67c7-454e-b992-32ed92244693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:31.922703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be480e2e-67c7-454e-b992-32ed92244693 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:31.923192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be480e2e-67c7-454e-b992-32ed92244693 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:31.923939 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be480e2e-67c7-454e-b992-32ed92244693 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:31.925607 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be480e2e-67c7-454e-b992-32ed92244693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:31.926349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be480e2e-67c7-454e-b992-32ed92244693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:31.928905 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be480e2e-67c7-454e-b992-32ed92244693 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:31.945309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 304/602] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:31.950436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be480e2e-67c7-454e-b992-32ed92244693 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:31.952679 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2673240-6edc-42aa-9d9e-c50fc6d5410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:31.955456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2673240-6edc-42aa-9d9e-c50fc6d5410c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:31.956002 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2673240-6edc-42aa-9d9e-c50fc6d5410c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:31.956482 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2673240-6edc-42aa-9d9e-c50fc6d5410c None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:31.958245 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2673240-6edc-42aa-9d9e-c50fc6d5410c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:31.959110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2673240-6edc-42aa-9d9e-c50fc6d5410c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:31.962455 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2673240-6edc-42aa-9d9e-c50fc6d5410c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:31.989996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 299/603] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:31.997082 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2673240-6edc-42aa-9d9e-c50fc6d5410c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:32.020914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:32.025854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:32.151194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2673240-6edc-42aa-9d9e-c50fc6d5410c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:32.195466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be480e2e-67c7-454e-b992-32ed92244693 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:32.219113 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f02f59-2c00-4ac7-8a58-9759d4063228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:32.220833 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f02f59-2c00-4ac7-8a58-9759d4063228 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:32.221314 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f02f59-2c00-4ac7-8a58-9759d4063228 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:32.221804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f02f59-2c00-4ac7-8a58-9759d4063228 None admin] PATH_INFO: `/v3/projects/50abbf0c38634795be669ec69da1f06d/users/454b9259519c4332a8a36131c8273786/roles/33cbf420a4284279a9010e820bcece79` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:32.250580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90217e0-592e-4e9b-b86c-9c0e0a830aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:32.258811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90217e0-592e-4e9b-b86c-9c0e0a830aae None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:32.258811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90217e0-592e-4e9b-b86c-9c0e0a830aae None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:32.258811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90217e0-592e-4e9b-b86c-9c0e0a830aae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:32.260834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f02f59-2c00-4ac7-8a58-9759d4063228 None admin] RBAC: Authorizing `identity:create_grant(project_id=50abbf0c38634795be669ec69da1f06d, user_id=454b9259519c4332a8a36131c8273786, role_id=33cbf420a4284279a9010e820bcece79)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:32.261746 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90217e0-592e-4e9b-b86c-9c0e0a830aae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:32.262701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f02f59-2c00-4ac7-8a58-9759d4063228 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:32.264154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90217e0-592e-4e9b-b86c-9c0e0a830aae None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:32.284152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d90217e0-592e-4e9b-b86c-9c0e0a830aae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:32.284152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:32.284152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:32.284152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:32.284152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:32.284152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:32.284152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:32.284152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:32.284152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:32.284152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:32.284152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:32.284152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:32.284152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:32.284152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:32.284152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:32.285336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:32.286354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:32.286354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:32.286354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:32.286354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:32.286354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:32.286354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:32.286354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:32.286354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:32.290749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 305/604] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:32.295697 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90217e0-592e-4e9b-b86c-9c0e0a830aae None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:32.398120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 300/605] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:15:31 2022] PUT /identity/v3/projects/50abbf0c38634795be669ec69da1f06d/users/454b9259519c4332a8a36131c8273786/roles/33cbf420a4284279a9010e820bcece79 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:15:32.483511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:32.516508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90217e0-592e-4e9b-b86c-9c0e0a830aae None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:32.578657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499dc0a-e210-4fec-af69-a70d8972e8e6 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:32.579242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499dc0a-e210-4fec-af69-a70d8972e8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:32.579662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499dc0a-e210-4fec-af69-a70d8972e8e6 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:32.581723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df25b9c-3d6b-4ab6-ba29-826a04c67658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:32.582047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 301/606] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:32.586563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df25b9c-3d6b-4ab6-ba29-826a04c67658 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:32.586563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df25b9c-3d6b-4ab6-ba29-826a04c67658 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:32.586563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df25b9c-3d6b-4ab6-ba29-826a04c67658 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:32.586563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df25b9c-3d6b-4ab6-ba29-826a04c67658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:32.586563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df25b9c-3d6b-4ab6-ba29-826a04c67658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:32.586563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df25b9c-3d6b-4ab6-ba29-826a04c67658 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:32.589026 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0f0a1-e43b-4286-a047-ae8804450882 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:32.589891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0f0a1-e43b-4286-a047-ae8804450882 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:32.590732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0f0a1-e43b-4286-a047-ae8804450882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:32.612152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 306/607] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:32.619754 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df25b9c-3d6b-4ab6-ba29-826a04c67658 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:32.625947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bcf0f0a1-e43b-4286-a047-ae8804450882 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:32.627890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bcf0f0a1-e43b-4286-a047-ae8804450882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:32.759300 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:32.769394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 302/608] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:32.781661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df25b9c-3d6b-4ab6-ba29-826a04c67658 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:32.797559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0f0a1-e43b-4286-a047-ae8804450882 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:32.855460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f04ece-b9b8-49c5-8fc2-e7e2314b51a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:32.856677 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f04ece-b9b8-49c5-8fc2-e7e2314b51a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:32.857137 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f04ece-b9b8-49c5-8fc2-e7e2314b51a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:32.857559 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f04ece-b9b8-49c5-8fc2-e7e2314b51a5 None admin] PATH_INFO: `/v3/projects/50abbf0c38634795be669ec69da1f06d/users/f2fcf925f9ec45b3b2cbea7e6acc0522/roles/33cbf420a4284279a9010e820bcece79` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:32.888291 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f04ece-b9b8-49c5-8fc2-e7e2314b51a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=50abbf0c38634795be669ec69da1f06d, user_id=f2fcf925f9ec45b3b2cbea7e6acc0522, role_id=33cbf420a4284279a9010e820bcece79)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:32.890223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f04ece-b9b8-49c5-8fc2-e7e2314b51a5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:32.895577 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:32.935588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0f0a1-e43b-4286-a047-ae8804450882 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:32.976469 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f3101-ace8-4267-be7f-3c21f60a5725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:32.977286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f3101-ace8-4267-be7f-3c21f60a5725 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:32.977562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f3101-ace8-4267-be7f-3c21f60a5725 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:32.977829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f3101-ace8-4267-be7f-3c21f60a5725 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:32.989344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f3101-ace8-4267-be7f-3c21f60a5725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-936f3101-ace8-4267-be7f-3c21f60a5725 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:32.997407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:33.000979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:33.001996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:33.001996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:33.001996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:33.001996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:33.001996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:33.001996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:33.001996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:33.001996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:33.001996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:33.001996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:33.001996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:33.001996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:33.001996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 303/609] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:33.001996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89010f-4278-408a-a0d4-2f86f50066bc None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:33.004030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89010f-4278-408a-a0d4-2f86f50066bc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:33.004030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89010f-4278-408a-a0d4-2f86f50066bc None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:33.004030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 304/610] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:33.005600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89010f-4278-408a-a0d4-2f86f50066bc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:33.043550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 307/611] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:15:32 2022] PUT /identity/v3/projects/50abbf0c38634795be669ec69da1f06d/users/f2fcf925f9ec45b3b2cbea7e6acc0522/roles/33cbf420a4284279a9010e820bcece79 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:15:33.045582 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ceb8b-982b-43be-981e-dd3668eb53a7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:33.045874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ceb8b-982b-43be-981e-dd3668eb53a7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:33.046149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ceb8b-982b-43be-981e-dd3668eb53a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:33.088455 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8d4ceb8b-982b-43be-981e-dd3668eb53a7 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:33.093430 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8d4ceb8b-982b-43be-981e-dd3668eb53a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:33.103184 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:33.168940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89010f-4278-408a-a0d4-2f86f50066bc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:33.221281 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 308/612] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:33.249497 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ceb8b-982b-43be-981e-dd3668eb53a7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:33.253036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99ad8e-33d2-4d50-836e-b0cadda6963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:33.253804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99ad8e-33d2-4d50-836e-b0cadda6963a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:33.254230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99ad8e-33d2-4d50-836e-b0cadda6963a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:33.254522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99ad8e-33d2-4d50-836e-b0cadda6963a None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:33.255251 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99ad8e-33d2-4d50-836e-b0cadda6963a None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:33.255559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99ad8e-33d2-4d50-836e-b0cadda6963a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:33.256967 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99ad8e-33d2-4d50-836e-b0cadda6963a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:33.269829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 305/613] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:33.276242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99ad8e-33d2-4d50-836e-b0cadda6963a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:33.454999 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ceb8b-982b-43be-981e-dd3668eb53a7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:33.485956 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:33.494908 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f78a2-eb0f-43c2-af96-2aebd1a0ec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:33.503446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f78a2-eb0f-43c2-af96-2aebd1a0ec15 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:33.503446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f78a2-eb0f-43c2-af96-2aebd1a0ec15 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:33.503446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f78a2-eb0f-43c2-af96-2aebd1a0ec15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:33.509619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f78a2-eb0f-43c2-af96-2aebd1a0ec15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-229f78a2-eb0f-43c2-af96-2aebd1a0ec15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:33.518364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:33.519398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:33.520722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:33.520722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:33.520722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:33.520722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:33.520722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:33.520722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:33.520722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:33.520722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:33.520722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:33.520722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:33.520722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:33.520722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:33.520722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 309/614] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:33.526837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f78a2-eb0f-43c2-af96-2aebd1a0ec15 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:33.533061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99ad8e-33d2-4d50-836e-b0cadda6963a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:33.563950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:33.601067 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e60b92-564f-45a2-82c0-44b8f90c3b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:33.601879 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e60b92-564f-45a2-82c0-44b8f90c3b4a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:33.602158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e60b92-564f-45a2-82c0-44b8f90c3b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:33.602436 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e60b92-564f-45a2-82c0-44b8f90c3b4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:33.630280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e60b92-564f-45a2-82c0-44b8f90c3b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:33.634286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e60b92-564f-45a2-82c0-44b8f90c3b4a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:33.667029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-82e60b92-564f-45a2-82c0-44b8f90c3b4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:33.667029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:33.667029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:33.667029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:33.667029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:33.667029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:33.667029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:33.667029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:33.667029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:33.667029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:33.667029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:33.667029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:33.667029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:33.667029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:33.667029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:33.668005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:33.668898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:33.668898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:33.668898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:33.668898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:33.675972 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 306/615] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:33.676884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e60b92-564f-45a2-82c0-44b8f90c3b4a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:33.739677 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f78a2-eb0f-43c2-af96-2aebd1a0ec15 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:33.789491 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311256b0-18df-468e-b9d0-077ac4f6fbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:33.790164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311256b0-18df-468e-b9d0-077ac4f6fbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:33.790445 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311256b0-18df-468e-b9d0-077ac4f6fbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:33.790740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311256b0-18df-468e-b9d0-077ac4f6fbb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:33.791605 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311256b0-18df-468e-b9d0-077ac4f6fbb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:33.792017 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311256b0-18df-468e-b9d0-077ac4f6fbb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:33.793660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311256b0-18df-468e-b9d0-077ac4f6fbb9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:33.803152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 310/616] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:33.804599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d21ee-b9bf-48bf-8b33-1e62e55a496a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:33.804888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d21ee-b9bf-48bf-8b33-1e62e55a496a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:33.805162 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d21ee-b9bf-48bf-8b33-1e62e55a496a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:33.810636 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 311/617] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:33.811849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d21ee-b9bf-48bf-8b33-1e62e55a496a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:33.827261 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e60b92-564f-45a2-82c0-44b8f90c3b4a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:33.863684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316defd3-1c7d-4787-a833-63f912644b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:33.864538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316defd3-1c7d-4787-a833-63f912644b8b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:33.864815 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316defd3-1c7d-4787-a833-63f912644b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:33.865141 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316defd3-1c7d-4787-a833-63f912644b8b None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:33.865864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316defd3-1c7d-4787-a833-63f912644b8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:33.866212 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316defd3-1c7d-4787-a833-63f912644b8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:33.867625 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316defd3-1c7d-4787-a833-63f912644b8b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:33.875138 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:33.880696 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 307/618] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:33.882080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf375b9-e176-433a-b15c-cbd7f1c26aff None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:33.882421 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf375b9-e176-433a-b15c-cbd7f1c26aff None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:33.882707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf375b9-e176-433a-b15c-cbd7f1c26aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:33.902603 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-dcf375b9-e176-433a-b15c-cbd7f1c26aff None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:33.903860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dcf375b9-e176-433a-b15c-cbd7f1c26aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:33.930229 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:33.934551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d21ee-b9bf-48bf-8b33-1e62e55a496a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:33.973175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c8832-80d5-49e8-8c4f-aa0c226eb957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:33.973958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c8832-80d5-49e8-8c4f-aa0c226eb957 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:33.974231 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c8832-80d5-49e8-8c4f-aa0c226eb957 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:33.974494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c8832-80d5-49e8-8c4f-aa0c226eb957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:33.978289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 308/619] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:33.979883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf375b9-e176-433a-b15c-cbd7f1c26aff None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:33.994583 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c8832-80d5-49e8-8c4f-aa0c226eb957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:33.996097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c8832-80d5-49e8-8c4f-aa0c226eb957 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:34.030714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-170c8832-80d5-49e8-8c4f-aa0c226eb957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:34.030714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:34.030714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:34.030714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:34.030714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:34.030714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:34.030714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:34.030714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:34.030714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:34.030714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:34.030714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:34.030714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:34.030714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:34.030714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:34.030714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:34.031836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:34.034219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:34.034219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:34.034219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:34.034219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:34.034219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 312/620] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:34.034219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c8832-80d5-49e8-8c4f-aa0c226eb957 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:34.086461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf375b9-e176-433a-b15c-cbd7f1c26aff None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:34.122429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6fc26-688d-43c7-820f-2ff399465208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:34.123643 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6fc26-688d-43c7-820f-2ff399465208 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:34.124080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6fc26-688d-43c7-820f-2ff399465208 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:34.124422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6fc26-688d-43c7-820f-2ff399465208 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:34.132618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6fc26-688d-43c7-820f-2ff399465208 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:34.134166 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6fc26-688d-43c7-820f-2ff399465208 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:34.138337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:34.142041 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c8832-80d5-49e8-8c4f-aa0c226eb957 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-93b6fc26-688d-43c7-820f-2ff399465208 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:34.152154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:34.154198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:34.156693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:34.156693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:34.156693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:34.156693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:34.156693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:34.156693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:34.156693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:34.156693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:34.156693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:15:34.156693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:34.161011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 309/621] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jul 20 19:15:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:34.161011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6fc26-688d-43c7-820f-2ff399465208 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:34.179154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfd95f-0797-4044-ae12-f2b45eef12f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:34.180045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfd95f-0797-4044-ae12-f2b45eef12f2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:34.180328 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfd95f-0797-4044-ae12-f2b45eef12f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:34.180599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfd95f-0797-4044-ae12-f2b45eef12f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:34.183996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:34.192908 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cfd95f-0797-4044-ae12-f2b45eef12f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-33cfd95f-0797-4044-ae12-f2b45eef12f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:34.201435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:34.203692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:34.205711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:34.205711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:34.205711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:34.205711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:34.205711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:34.205711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:34.205711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:34.205711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:34.205711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:34.205711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:34.205711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:34.205711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:34.211451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 313/622] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:34.211451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfd95f-0797-4044-ae12-f2b45eef12f2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:34.268854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6fc26-688d-43c7-820f-2ff399465208 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:34.306719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236f7ad-32fe-4905-80b9-2f76da6e02f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:34.307385 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236f7ad-32fe-4905-80b9-2f76da6e02f9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:34.307661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236f7ad-32fe-4905-80b9-2f76da6e02f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:34.307957 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236f7ad-32fe-4905-80b9-2f76da6e02f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:34.308840 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236f7ad-32fe-4905-80b9-2f76da6e02f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:34.309148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236f7ad-32fe-4905-80b9-2f76da6e02f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:34.310511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236f7ad-32fe-4905-80b9-2f76da6e02f9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:34.319040 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfd95f-0797-4044-ae12-f2b45eef12f2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:34.325472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 310/623] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:34.326399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236f7ad-32fe-4905-80b9-2f76da6e02f9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:34.361203 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86296d58-df57-4d49-bdb7-c6f4d86267ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:34.361908 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86296d58-df57-4d49-bdb7-c6f4d86267ff None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:34.362191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86296d58-df57-4d49-bdb7-c6f4d86267ff None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:34.362464 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86296d58-df57-4d49-bdb7-c6f4d86267ff None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:34.363436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86296d58-df57-4d49-bdb7-c6f4d86267ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:34.363771 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86296d58-df57-4d49-bdb7-c6f4d86267ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:34.365501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86296d58-df57-4d49-bdb7-c6f4d86267ff None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:34.387167 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 314/624] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 20 19:15:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:34.388054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86296d58-df57-4d49-bdb7-c6f4d86267ff None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:34.408252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:34.427849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:34.449097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236f7ad-32fe-4905-80b9-2f76da6e02f9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:34.486791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28ddab-9c2f-47ad-ade4-1639e18392bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:34.487705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28ddab-9c2f-47ad-ade4-1639e18392bb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:34.488654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28ddab-9c2f-47ad-ade4-1639e18392bb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:34.489131 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28ddab-9c2f-47ad-ade4-1639e18392bb None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:34.490374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28ddab-9c2f-47ad-ade4-1639e18392bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:34.490853 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28ddab-9c2f-47ad-ade4-1639e18392bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:34.492545 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28ddab-9c2f-47ad-ade4-1639e18392bb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:34.497120 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86296d58-df57-4d49-bdb7-c6f4d86267ff None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:34.502217 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 311/625] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:34.503266 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28ddab-9c2f-47ad-ade4-1639e18392bb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:34.551739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b2ea1-9764-46f2-8726-c343abb240ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:34.552563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b2ea1-9764-46f2-8726-c343abb240ae None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:34.552842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b2ea1-9764-46f2-8726-c343abb240ae None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:34.553111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b2ea1-9764-46f2-8726-c343abb240ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:34.564675 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b2ea1-9764-46f2-8726-c343abb240ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:34.567773 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b2ea1-9764-46f2-8726-c343abb240ae None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d21b2ea1-9764-46f2-8726-c343abb240ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:34.589054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:34.590054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:34.591026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:34.591026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:34.591026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:34.591026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:34.591026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:34.591026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:34.591026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:34.591026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:34.591026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:15:34.591026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:34.592319 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 315/626] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:15:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:34.593101 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b2ea1-9764-46f2-8726-c343abb240ae None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:34.650700 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28ddab-9c2f-47ad-ade4-1639e18392bb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:34.688400 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:34.701382 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bbdd7-0db5-4ddd-b7ad-3b62c4ffcadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:34.702617 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbdd7-0db5-4ddd-b7ad-3b62c4ffcadd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:34.703312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbdd7-0db5-4ddd-b7ad-3b62c4ffcadd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:34.703781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbdd7-0db5-4ddd-b7ad-3b62c4ffcadd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:34.713209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b2ea1-9764-46f2-8726-c343abb240ae None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:34.720875 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:34.749593 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44669033-c855-423a-b148-aaa0ed9aad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:34.751290 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44669033-c855-423a-b148-aaa0ed9aad1b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:34.751290 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44669033-c855-423a-b148-aaa0ed9aad1b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:34.751290 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44669033-c855-423a-b148-aaa0ed9aad1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:34.763737 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44669033-c855-423a-b148-aaa0ed9aad1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:34.765903 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44669033-c855-423a-b148-aaa0ed9aad1b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:34.788960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-44669033-c855-423a-b148-aaa0ed9aad1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:34.788960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:34.788960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:34.788960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:34.788960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:34.788960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:34.788960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:34.788960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:34.788960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:34.788960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:34.788960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:34.788960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:34.788960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:34.788960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:34.788960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:34.790074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:34.791275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:34.791275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:34.791275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:34.791275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:34.794832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bbdd7-0db5-4ddd-b7ad-3b62c4ffcadd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:34.796579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bbdd7-0db5-4ddd-b7ad-3b62c4ffcadd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:34.797226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 316/627] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:34.798206 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44669033-c855-423a-b148-aaa0ed9aad1b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:34.912707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 312/628] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:34.912707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bbdd7-0db5-4ddd-b7ad-3b62c4ffcadd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:34.926343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44669033-c855-423a-b148-aaa0ed9aad1b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:34.958702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:34.959364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:34.964934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a359d-54c2-48d0-8358-22e7500126f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:34.965602 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a359d-54c2-48d0-8358-22e7500126f2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:34.965892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a359d-54c2-48d0-8358-22e7500126f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:34.966144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a359d-54c2-48d0-8358-22e7500126f2 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:34.973870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a359d-54c2-48d0-8358-22e7500126f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:34.973870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a359d-54c2-48d0-8358-22e7500126f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:34.973870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a359d-54c2-48d0-8358-22e7500126f2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:34.986829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 317/629] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jul 20 19:15:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:34.988238 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92d610-65d8-40de-ac0d-1fb477cec6a3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:34.988525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92d610-65d8-40de-ac0d-1fb477cec6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:34.988804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92d610-65d8-40de-ac0d-1fb477cec6a3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:34.990223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 318/630] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:34.991428 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92d610-65d8-40de-ac0d-1fb477cec6a3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:35.027734 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bbdd7-0db5-4ddd-b7ad-3b62c4ffcadd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:35.065515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afb806-9176-44b4-9aa2-e5be13235520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:35.066785 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afb806-9176-44b4-9aa2-e5be13235520 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:35.067161 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afb806-9176-44b4-9aa2-e5be13235520 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:35.067405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afb806-9176-44b4-9aa2-e5be13235520 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:35.068132 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afb806-9176-44b4-9aa2-e5be13235520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:35.068437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afb806-9176-44b4-9aa2-e5be13235520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:35.069816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afb806-9176-44b4-9aa2-e5be13235520 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:35.082499 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 313/631] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:35.083355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afb806-9176-44b4-9aa2-e5be13235520 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:35.106707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92d610-65d8-40de-ac0d-1fb477cec6a3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:35.144877 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12075ec-abfc-4939-b8b0-0ce8fa90b72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:35.145664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12075ec-abfc-4939-b8b0-0ce8fa90b72a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:35.145941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12075ec-abfc-4939-b8b0-0ce8fa90b72a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:35.146215 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12075ec-abfc-4939-b8b0-0ce8fa90b72a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:35.160975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12075ec-abfc-4939-b8b0-0ce8fa90b72a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:35.162490 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12075ec-abfc-4939-b8b0-0ce8fa90b72a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:35.182306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e12075ec-abfc-4939-b8b0-0ce8fa90b72a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:35.182306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:35.182306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:35.182306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:35.182306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:35.182306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:35.182306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:35.182306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:35.182306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:35.182306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:35.182306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:35.182306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:35.182306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:35.182306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:35.182306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:35.183340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:35.184221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:35.184221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:35.184221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:35.184221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:35.184221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 319/632] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:35.185155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73068242-fa08-4201-9ea1-f6277504d539 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:35.185483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73068242-fa08-4201-9ea1-f6277504d539 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:35.185716 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73068242-fa08-4201-9ea1-f6277504d539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:35.203774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-73068242-fa08-4201-9ea1-f6277504d539 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:35.204947 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-73068242-fa08-4201-9ea1-f6277504d539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:35.205143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afb806-9176-44b4-9aa2-e5be13235520 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:35.207330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:35.243536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:35.245367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc88ae0-c75c-412f-b7e7-64ba5ba1a1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:35.246551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc88ae0-c75c-412f-b7e7-64ba5ba1a1cb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:35.247056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc88ae0-c75c-412f-b7e7-64ba5ba1a1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:35.247617 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc88ae0-c75c-412f-b7e7-64ba5ba1a1cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:35.259616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc88ae0-c75c-412f-b7e7-64ba5ba1a1cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:35.260935 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc88ae0-c75c-412f-b7e7-64ba5ba1a1cb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:35.276176 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 320/633] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:35.279354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-0dc88ae0-c75c-412f-b7e7-64ba5ba1a1cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:35.279354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:35.279354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:35.279354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:35.279354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:35.279354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:35.279354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:35.279354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:35.279354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:35.279354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:35.279354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:35.279354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:35.279354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:35.279354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:35.279354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:35.280572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:35.281477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:35.281477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:35.281477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:35.281477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:35.285898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 314/634] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:35.286885 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc88ae0-c75c-412f-b7e7-64ba5ba1a1cb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:35.295631 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73068242-fa08-4201-9ea1-f6277504d539 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:35.403322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc88ae0-c75c-412f-b7e7-64ba5ba1a1cb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:35.407824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73068242-fa08-4201-9ea1-f6277504d539 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:35.441873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472da4c-6cee-42ac-be44-61150459169b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:35.442486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472da4c-6cee-42ac-be44-61150459169b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:35.442790 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472da4c-6cee-42ac-be44-61150459169b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:35.443140 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472da4c-6cee-42ac-be44-61150459169b None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:35.444697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472da4c-6cee-42ac-be44-61150459169b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:35.444697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472da4c-6cee-42ac-be44-61150459169b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:35.444907 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6df446-93d4-4129-a12b-0823dd29d4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:35.445890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6df446-93d4-4129-a12b-0823dd29d4af None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:35.445890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6df446-93d4-4129-a12b-0823dd29d4af None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:35.446523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472da4c-6cee-42ac-be44-61150459169b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:35.446612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6df446-93d4-4129-a12b-0823dd29d4af None admin] PATH_INFO: `/v3/users/glance` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:35.459231 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 315/635] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:35.460252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6df446-93d4-4129-a12b-0823dd29d4af None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:35.460443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472da4c-6cee-42ac-be44-61150459169b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:35.461718 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6df446-93d4-4129-a12b-0823dd29d4af None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:35.476492 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-5d6df446-93d4-4129-a12b-0823dd29d4af None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:35.477950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:35.478964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:35.479910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:35.479910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:35.479910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:35.479910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:35.479910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:35.479910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:35.479910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:35.479910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:35.479910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:15:35.479910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:35.479910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 321/636] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:35.480497 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6df446-93d4-4129-a12b-0823dd29d4af None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:35.511066 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:35.567571 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472da4c-6cee-42ac-be44-61150459169b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:35.583110 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6df446-93d4-4129-a12b-0823dd29d4af None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:35.601505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8b1bb-18de-4d7e-9f81-cdba3a7cdc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:35.602175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8b1bb-18de-4d7e-9f81-cdba3a7cdc67 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:35.602450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8b1bb-18de-4d7e-9f81-cdba3a7cdc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:35.602747 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8b1bb-18de-4d7e-9f81-cdba3a7cdc67 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:35.603470 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8b1bb-18de-4d7e-9f81-cdba3a7cdc67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:35.603780 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8b1bb-18de-4d7e-9f81-cdba3a7cdc67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:35.605157 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8b1bb-18de-4d7e-9f81-cdba3a7cdc67 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:35.617517 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 316/637] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:35.618429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486725cf-7022-4bf8-9185-85ee5d8cc943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:35.618807 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d72d1e-7dea-4e07-ba2a-940d8f086f2d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:35.619092 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d72d1e-7dea-4e07-ba2a-940d8f086f2d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:35.619266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486725cf-7022-4bf8-9185-85ee5d8cc943 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:35.619363 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d72d1e-7dea-4e07-ba2a-940d8f086f2d None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:35.619534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486725cf-7022-4bf8-9185-85ee5d8cc943 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:35.619762 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486725cf-7022-4bf8-9185-85ee5d8cc943 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:35.622795 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 317/638] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:35.622795 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d72d1e-7dea-4e07-ba2a-940d8f086f2d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:35.631493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486725cf-7022-4bf8-9185-85ee5d8cc943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-486725cf-7022-4bf8-9185-85ee5d8cc943 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:35.639270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:35.640233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:35.641091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:35.641091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:35.641091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:35.641091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:35.641091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:35.641091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:35.641091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:35.641091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:35.641091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:35.641091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:35.641091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:35.641091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:35.641091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 322/639] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:35.641797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486725cf-7022-4bf8-9185-85ee5d8cc943 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:35.702062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:35.728425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d72d1e-7dea-4e07-ba2a-940d8f086f2d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:35.737270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:35.747698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486725cf-7022-4bf8-9185-85ee5d8cc943 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:35.776717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538217c-eda9-4e04-8550-369ef4fb622b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:35.777718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538217c-eda9-4e04-8550-369ef4fb622b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:35.778000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538217c-eda9-4e04-8550-369ef4fb622b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:35.778400 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538217c-eda9-4e04-8550-369ef4fb622b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:35.783790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb7a3a-0e6c-4b00-835a-a680fc46d112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:35.784455 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7a3a-0e6c-4b00-835a-a680fc46d112 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:35.785261 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7a3a-0e6c-4b00-835a-a680fc46d112 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:35.785530 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7a3a-0e6c-4b00-835a-a680fc46d112 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:35.786367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb7a3a-0e6c-4b00-835a-a680fc46d112 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:35.786666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb7a3a-0e6c-4b00-835a-a680fc46d112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:35.787020 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538217c-eda9-4e04-8550-369ef4fb622b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:35.788135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb7a3a-0e6c-4b00-835a-a680fc46d112 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:35.788452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538217c-eda9-4e04-8550-369ef4fb622b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:35.803730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4538217c-eda9-4e04-8550-369ef4fb622b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:35.803730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:35.803730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:35.803730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:35.803730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:35.803730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:35.803730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:35.803730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:35.803730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:35.803730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:35.803730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:35.803730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:35.803730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:35.803730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:35.803730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:35.804750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:35.805654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:35.805654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:35.805654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:35.805654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:35.805654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:35.805654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:35.805654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:35.805654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:35.805654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 318/640] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:35.810036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538217c-eda9-4e04-8550-369ef4fb622b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:35.810122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 323/641] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 20 19:15:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:35.810122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc352f-c2ad-4dfc-b62a-0b71fe3e5167 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:35.810122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc352f-c2ad-4dfc-b62a-0b71fe3e5167 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:35.810122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc352f-c2ad-4dfc-b62a-0b71fe3e5167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:35.825400 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a4bc352f-c2ad-4dfc-b62a-0b71fe3e5167 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:35.826572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a4bc352f-c2ad-4dfc-b62a-0b71fe3e5167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:35.892046 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 324/642] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:35.892885 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc352f-c2ad-4dfc-b62a-0b71fe3e5167 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:35.908865 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538217c-eda9-4e04-8550-369ef4fb622b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:35.948511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ca369-5985-4451-b98f-0e0336e974be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:35.949337 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ca369-5985-4451-b98f-0e0336e974be None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:35.949616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ca369-5985-4451-b98f-0e0336e974be None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:35.949893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ca369-5985-4451-b98f-0e0336e974be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:35.952274 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:35.958384 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ca369-5985-4451-b98f-0e0336e974be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:35.959907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ca369-5985-4451-b98f-0e0336e974be None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:35.975377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-977ca369-5985-4451-b98f-0e0336e974be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:35.975377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:35.975377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:35.975377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:35.975377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:35.975377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:35.975377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:35.975377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:35.975377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:35.975377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:35.975377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:35.975377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:35.975377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:35.975377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:35.975377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:36.004781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:36.005750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:36.005750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:36.005750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:36.005750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:36.005750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:36.005750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:36.005750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:36.005750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:36.005750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 319/643] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:36.005750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ca369-5985-4451-b98f-0e0336e974be None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:36.006385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:36.025784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc352f-c2ad-4dfc-b62a-0b71fe3e5167 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:36.063269 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1e7a7-07eb-4466-aef5-acf02ecedd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:36.063945 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1e7a7-07eb-4466-aef5-acf02ecedd90 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:36.084157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1e7a7-07eb-4466-aef5-acf02ecedd90 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:36.084157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1e7a7-07eb-4466-aef5-acf02ecedd90 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:36.084157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1e7a7-07eb-4466-aef5-acf02ecedd90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:36.084157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1e7a7-07eb-4466-aef5-acf02ecedd90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:36.084157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1e7a7-07eb-4466-aef5-acf02ecedd90 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:36.084157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 325/644] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:36.084601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1e7a7-07eb-4466-aef5-acf02ecedd90 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:36.108692 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ca369-5985-4451-b98f-0e0336e974be None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:36.143103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3a0cc-0d24-42cd-93e7-a569946fffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:36.143775 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3a0cc-0d24-42cd-93e7-a569946fffdb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:36.144572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3a0cc-0d24-42cd-93e7-a569946fffdb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:36.144846 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3a0cc-0d24-42cd-93e7-a569946fffdb None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:36.145798 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3a0cc-0d24-42cd-93e7-a569946fffdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:36.146107 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3a0cc-0d24-42cd-93e7-a569946fffdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:36.147585 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3a0cc-0d24-42cd-93e7-a569946fffdb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:36.160828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 320/645] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:36.161894 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3a0cc-0d24-42cd-93e7-a569946fffdb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:36.182634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1e7a7-07eb-4466-aef5-acf02ecedd90 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:36.217147 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec21dc-4535-4ce8-a8f3-512a79b3c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:36.217355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:36.217711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec21dc-4535-4ce8-a8f3-512a79b3c4ce None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:36.217978 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec21dc-4535-4ce8-a8f3-512a79b3c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:36.218243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec21dc-4535-4ce8-a8f3-512a79b3c4ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:36.230359 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:36.261729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3a0cc-0d24-42cd-93e7-a569946fffdb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:36.287898 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec21dc-4535-4ce8-a8f3-512a79b3c4ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:36.289357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec21dc-4535-4ce8-a8f3-512a79b3c4ce None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:36.300954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd7742-64ea-4c30-89de-eb2417e27863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:36.301761 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd7742-64ea-4c30-89de-eb2417e27863 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:36.302040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd7742-64ea-4c30-89de-eb2417e27863 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:36.302311 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd7742-64ea-4c30-89de-eb2417e27863 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:36.312851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd7742-64ea-4c30-89de-eb2417e27863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-dbbd7742-64ea-4c30-89de-eb2417e27863 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:36.321373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:36.322350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:36.328114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:36.328114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:36.328114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:36.328114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:36.328114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:36.328114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:36.328114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:36.328114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:36.328114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:36.328114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:36.328114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:36.328114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:36.328114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 321/646] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:36.328114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd7742-64ea-4c30-89de-eb2417e27863 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:36.394001 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 326/647] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:36.395014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec21dc-4535-4ce8-a8f3-512a79b3c4ce None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:36.425778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd7742-64ea-4c30-89de-eb2417e27863 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:36.438154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:36.439886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:36.461654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6c295-4018-44c6-a8ab-50cf2e01272a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:36.462326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6c295-4018-44c6-a8ab-50cf2e01272a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:36.462604 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6c295-4018-44c6-a8ab-50cf2e01272a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:36.462906 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6c295-4018-44c6-a8ab-50cf2e01272a None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:36.463698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6c295-4018-44c6-a8ab-50cf2e01272a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:36.464003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6c295-4018-44c6-a8ab-50cf2e01272a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:36.465502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6c295-4018-44c6-a8ab-50cf2e01272a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:36.478099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 322/648] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:36.478873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6c295-4018-44c6-a8ab-50cf2e01272a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:36.502826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec21dc-4535-4ce8-a8f3-512a79b3c4ce None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:36.538521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd1e41-8170-4712-9f4d-85909e9053e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:36.539343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd1e41-8170-4712-9f4d-85909e9053e0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:36.539624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd1e41-8170-4712-9f4d-85909e9053e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:36.539894 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd1e41-8170-4712-9f4d-85909e9053e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:36.549931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd1e41-8170-4712-9f4d-85909e9053e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:36.551447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd1e41-8170-4712-9f4d-85909e9053e0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:36.570048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a7bd1e41-8170-4712-9f4d-85909e9053e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:36.570048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:36.570048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:36.570048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:36.570048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:36.570048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:36.570048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:36.570048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:36.570048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:36.570048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:36.570048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:36.570048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:36.570048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:36.570048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:36.570048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:36.573521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:36.574416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:36.574416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:36.574416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:36.574416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:36.574416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 327/649] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:36.574416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd1e41-8170-4712-9f4d-85909e9053e0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:36.589520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6c295-4018-44c6-a8ab-50cf2e01272a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:36.623216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03c9ff-9128-4226-812f-4e41bbc34e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:36.623864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03c9ff-9128-4226-812f-4e41bbc34e16 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:36.624146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03c9ff-9128-4226-812f-4e41bbc34e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:36.624422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03c9ff-9128-4226-812f-4e41bbc34e16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:36.625246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03c9ff-9128-4226-812f-4e41bbc34e16 None admin] RBAC: Adding query filter params (role.id=33cbf420a4284279a9010e820bcece79, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=e3fd38ebb5514af686204d0b02a91edd) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:36.625554 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03c9ff-9128-4226-812f-4e41bbc34e16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:36.627011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03c9ff-9128-4226-812f-4e41bbc34e16 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:36.638703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 323/650] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:15:36 2022] GET /identity/v3/role_assignments?user.id=e3fd38ebb5514af686204d0b02a91edd&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=33cbf420a4284279a9010e820bcece79 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:36.638872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03c9ff-9128-4226-812f-4e41bbc34e16 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:36.673993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:36.683988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd1e41-8170-4712-9f4d-85909e9053e0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:36.691773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:36.721665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d5fda-e896-4e20-9740-7e93137d2acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:36.722455 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d5fda-e896-4e20-9740-7e93137d2acf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:36.722778 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d5fda-e896-4e20-9740-7e93137d2acf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:36.723048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d5fda-e896-4e20-9740-7e93137d2acf None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:36.723849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d5fda-e896-4e20-9740-7e93137d2acf None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:36.724139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d5fda-e896-4e20-9740-7e93137d2acf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:36.725590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d5fda-e896-4e20-9740-7e93137d2acf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:36.745072 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 328/651] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:36.745072 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d5fda-e896-4e20-9740-7e93137d2acf None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:36.765928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03c9ff-9128-4226-812f-4e41bbc34e16 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:36.812001 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688d93a-9805-40a0-b701-1c934682a41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:36.812794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d93a-9805-40a0-b701-1c934682a41a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:36.813072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d93a-9805-40a0-b701-1c934682a41a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:36.813345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d93a-9805-40a0-b701-1c934682a41a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:36.825172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688d93a-9805-40a0-b701-1c934682a41a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:36.826627 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688d93a-9805-40a0-b701-1c934682a41a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:36.846463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c688d93a-9805-40a0-b701-1c934682a41a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:36.846463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:36.846463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:36.846463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:36.846463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:36.846463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:36.846463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:36.846463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:36.846463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:36.846463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:36.846463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:36.846463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:36.846463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:36.846463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:36.846463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:36.847480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:36.848380 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:36.848380 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:36.848380 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:36.848380 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:36.848380 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 324/652] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:36.849072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688d93a-9805-40a0-b701-1c934682a41a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:36.855358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d5fda-e896-4e20-9740-7e93137d2acf None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:36.895088 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e337a9e-3c2a-47a8-a7c0-6fadd925dd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:36.895958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e337a9e-3c2a-47a8-a7c0-6fadd925dd27 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:36.896239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e337a9e-3c2a-47a8-a7c0-6fadd925dd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:36.896501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e337a9e-3c2a-47a8-a7c0-6fadd925dd27 None admin] PATH_INFO: `/v3/projects/50abbf0c38634795be669ec69da1f06d/users/fde62f4ce7af42eca1fe5a7b6807d1ae/roles/33cbf420a4284279a9010e820bcece79` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:36.911751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e337a9e-3c2a-47a8-a7c0-6fadd925dd27 None admin] RBAC: Authorizing `identity:create_grant(project_id=50abbf0c38634795be669ec69da1f06d, user_id=fde62f4ce7af42eca1fe5a7b6807d1ae, role_id=33cbf420a4284279a9010e820bcece79)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:36.913220 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e337a9e-3c2a-47a8-a7c0-6fadd925dd27 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:36.956059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:36.965472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688d93a-9805-40a0-b701-1c934682a41a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:36.999372 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8711663-8224-44aa-8d5e-b654496f889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:36.999959 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8711663-8224-44aa-8d5e-b654496f889e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:37.000235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8711663-8224-44aa-8d5e-b654496f889e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:37.000524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8711663-8224-44aa-8d5e-b654496f889e None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:37.001232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8711663-8224-44aa-8d5e-b654496f889e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:37.001540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8711663-8224-44aa-8d5e-b654496f889e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:37.003059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8711663-8224-44aa-8d5e-b654496f889e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:37.016730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 325/653] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:37.017566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8711663-8224-44aa-8d5e-b654496f889e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:37.035026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 329/654] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:15:36 2022] PUT /identity/v3/projects/50abbf0c38634795be669ec69da1f06d/users/fde62f4ce7af42eca1fe5a7b6807d1ae/roles/33cbf420a4284279a9010e820bcece79 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:15:37.035026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e337a9e-3c2a-47a8-a7c0-6fadd925dd27 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:37.039617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:37.154165 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e337a9e-3c2a-47a8-a7c0-6fadd925dd27 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:37.164214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8711663-8224-44aa-8d5e-b654496f889e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:37.201960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192d06a-c616-4503-85b9-faf574baa3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:37.202686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192d06a-c616-4503-85b9-faf574baa3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:37.202994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192d06a-c616-4503-85b9-faf574baa3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:37.203269 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192d06a-c616-4503-85b9-faf574baa3e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:37.204138 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192d06a-c616-4503-85b9-faf574baa3e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:37.204447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192d06a-c616-4503-85b9-faf574baa3e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:37.206008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192d06a-c616-4503-85b9-faf574baa3e7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:37.214863 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7f1c0-de48-4966-87fd-31668fe01089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:37.215712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7f1c0-de48-4966-87fd-31668fe01089 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:37.215990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7f1c0-de48-4966-87fd-31668fe01089 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:37.216260 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7f1c0-de48-4966-87fd-31668fe01089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:37.229846 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 330/655] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:37.230847 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192d06a-c616-4503-85b9-faf574baa3e7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:37.236648 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7f1c0-de48-4966-87fd-31668fe01089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:37.238171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7f1c0-de48-4966-87fd-31668fe01089 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:37.259577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-8cf7f1c0-de48-4966-87fd-31668fe01089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:37.259577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:37.259577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:37.259577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:37.259577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:37.259577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:37.259577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:37.259577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:37.259577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:37.259577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:37.259577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:37.259577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:37.259577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:37.259577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:37.259577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:37.260493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:37.261618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:37.261618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:37.261618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:37.261618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:37.261618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 326/656] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:37.262046 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7f1c0-de48-4966-87fd-31668fe01089 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:37.265492 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:37.316304 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:37.372039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192d06a-c616-4503-85b9-faf574baa3e7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:37.390282 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7f1c0-de48-4966-87fd-31668fe01089 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:37.420753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0eb3d-9fac-49ac-8abf-178dbbdb3e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:37.421547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0eb3d-9fac-49ac-8abf-178dbbdb3e0c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:37.421821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0eb3d-9fac-49ac-8abf-178dbbdb3e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:37.422089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0eb3d-9fac-49ac-8abf-178dbbdb3e0c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:37.434092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0eb3d-9fac-49ac-8abf-178dbbdb3e0c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:37.435888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0eb3d-9fac-49ac-8abf-178dbbdb3e0c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:37.437834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016b521-a1f4-45b7-b0f5-ac7b092d8811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:37.439490 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016b521-a1f4-45b7-b0f5-ac7b092d8811 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:37.439994 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016b521-a1f4-45b7-b0f5-ac7b092d8811 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:37.440464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016b521-a1f4-45b7-b0f5-ac7b092d8811 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:37.449044 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016b521-a1f4-45b7-b0f5-ac7b092d8811 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:37.450801 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016b521-a1f4-45b7-b0f5-ac7b092d8811 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-37d0eb3d-9fac-49ac-8abf-178dbbdb3e0c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:37.451665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:37.452914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:37.454377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:37.454377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:37.454377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:37.454377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:37.454377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:37.454377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:37.454377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:37.454377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:37.454377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:15:37.454377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:37.454377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 331/657] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:37.454377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0eb3d-9fac-49ac-8abf-178dbbdb3e0c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:37.470195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-1016b521-a1f4-45b7-b0f5-ac7b092d8811 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:37.470195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:37.470195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:37.470195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:37.470195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:37.470195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:37.470195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:37.470195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:37.470195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:37.470195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:37.470195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:37.470195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:37.470195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:37.470195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:37.470195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:37.471221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:37.472598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:37.472598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:37.472598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:37.472598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:37.472598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:37.472598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:37.472598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:37.472598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:37.476937 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 327/658] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:37.477887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016b521-a1f4-45b7-b0f5-ac7b092d8811 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:37.547514 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:37.591087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016b521-a1f4-45b7-b0f5-ac7b092d8811 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:37.596502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0eb3d-9fac-49ac-8abf-178dbbdb3e0c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:37.624873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:37.636179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea8280-b84c-45f8-a8a0-7efa9ab93949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:37.636813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea8280-b84c-45f8-a8a0-7efa9ab93949 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:37.645536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea8280-b84c-45f8-a8a0-7efa9ab93949 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:37.645536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea8280-b84c-45f8-a8a0-7efa9ab93949 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:37.645536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea8280-b84c-45f8-a8a0-7efa9ab93949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:37.645536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea8280-b84c-45f8-a8a0-7efa9ab93949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:37.645536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea8280-b84c-45f8-a8a0-7efa9ab93949 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:37.645979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f1c3d-981c-4151-bc2a-45e5c077ee31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:37.645979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f1c3d-981c-4151-bc2a-45e5c077ee31 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:37.645979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f1c3d-981c-4151-bc2a-45e5c077ee31 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:37.646473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f1c3d-981c-4151-bc2a-45e5c077ee31 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:37.647963 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f1c3d-981c-4151-bc2a-45e5c077ee31 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:37.648372 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f1c3d-981c-4151-bc2a-45e5c077ee31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:37.650631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f1c3d-981c-4151-bc2a-45e5c077ee31 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:37.657001 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 332/659] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:37.657932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea8280-b84c-45f8-a8a0-7efa9ab93949 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:37.674655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 328/660] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jul 20 19:15:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:37.675771 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f1c3d-981c-4151-bc2a-45e5c077ee31 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:37.786372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea8280-b84c-45f8-a8a0-7efa9ab93949 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:37.794277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f1c3d-981c-4151-bc2a-45e5c077ee31 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:37.818561 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:37.833770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ff518-4781-4061-aaa1-aa9c46bbfabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:37.834845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ff518-4781-4061-aaa1-aa9c46bbfabe None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:37.835227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ff518-4781-4061-aaa1-aa9c46bbfabe None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:37.835599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ff518-4781-4061-aaa1-aa9c46bbfabe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:37.835726 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d9e8c-3949-47cf-b2e9-3ef5c4fecb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:37.836480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d9e8c-3949-47cf-b2e9-3ef5c4fecb01 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:37.836829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d9e8c-3949-47cf-b2e9-3ef5c4fecb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:37.837145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d9e8c-3949-47cf-b2e9-3ef5c4fecb01 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:37.837964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d9e8c-3949-47cf-b2e9-3ef5c4fecb01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:37.838522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d9e8c-3949-47cf-b2e9-3ef5c4fecb01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:37.840667 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d9e8c-3949-47cf-b2e9-3ef5c4fecb01 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:37.844579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ff518-4781-4061-aaa1-aa9c46bbfabe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:37.846207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ff518-4781-4061-aaa1-aa9c46bbfabe None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:37.856773 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 333/661] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:37.857844 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d9e8c-3949-47cf-b2e9-3ef5c4fecb01 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-531ff518-4781-4061-aaa1-aa9c46bbfabe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:37.865970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:37.868151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:37.869786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:37.869786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:37.869786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:37.869786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:37.869786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:37.869786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:37.869786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:37.869786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:37.869786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:15:37.869786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:37.869786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 329/662] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:37.873737 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ff518-4781-4061-aaa1-aa9c46bbfabe None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:37.926989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:37.991307 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d9e8c-3949-47cf-b2e9-3ef5c4fecb01 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:38.014339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ff518-4781-4061-aaa1-aa9c46bbfabe None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:38.035158 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb9d64-afa4-4fb6-81c6-4f02ab287b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:38.035973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb9d64-afa4-4fb6-81c6-4f02ab287b13 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:38.036557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb9d64-afa4-4fb6-81c6-4f02ab287b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:38.037066 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb9d64-afa4-4fb6-81c6-4f02ab287b13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:38.055955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0904ebc-e0eb-472b-906c-873730994042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:38.057032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0904ebc-e0eb-472b-906c-873730994042 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:38.057504 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0904ebc-e0eb-472b-906c-873730994042 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:38.058021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0904ebc-e0eb-472b-906c-873730994042 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:38.059148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0904ebc-e0eb-472b-906c-873730994042 None admin] RBAC: Adding query filter params (role.id=33cbf420a4284279a9010e820bcece79, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=dbc7e1bc2eb943eba57a0009635de70d) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:38.059662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0904ebc-e0eb-472b-906c-873730994042 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:38.061699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0904ebc-e0eb-472b-906c-873730994042 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:38.075447 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 330/663] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:15:37 2022] GET /identity/v3/role_assignments?user.id=dbc7e1bc2eb943eba57a0009635de70d&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=33cbf420a4284279a9010e820bcece79 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:38.076723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0904ebc-e0eb-472b-906c-873730994042 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:38.119834 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb9d64-afa4-4fb6-81c6-4f02ab287b13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:38.121571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb9d64-afa4-4fb6-81c6-4f02ab287b13 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:38.173490 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:38.192574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:38.275041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0904ebc-e0eb-472b-906c-873730994042 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:38.320143 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 334/664] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:38.325739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb9d64-afa4-4fb6-81c6-4f02ab287b13 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:38.335541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007624b-d3a2-49ae-a127-a21fc0847c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:38.336244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007624b-d3a2-49ae-a127-a21fc0847c01 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:38.336526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007624b-d3a2-49ae-a127-a21fc0847c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:38.336803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007624b-d3a2-49ae-a127-a21fc0847c01 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:38.337658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007624b-d3a2-49ae-a127-a21fc0847c01 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:38.337963 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007624b-d3a2-49ae-a127-a21fc0847c01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:38.339444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007624b-d3a2-49ae-a127-a21fc0847c01 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:38.358990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 331/665] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jul 20 19:15:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:38.366496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007624b-d3a2-49ae-a127-a21fc0847c01 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:38.448461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb9d64-afa4-4fb6-81c6-4f02ab287b13 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:38.490526 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39cb1d-ff67-412b-961b-cf11f5b58803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:38.491431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39cb1d-ff67-412b-961b-cf11f5b58803 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:38.491714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39cb1d-ff67-412b-961b-cf11f5b58803 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:38.491982 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39cb1d-ff67-412b-961b-cf11f5b58803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:38.501059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007624b-d3a2-49ae-a127-a21fc0847c01 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:38.505237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:38.507575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39cb1d-ff67-412b-961b-cf11f5b58803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:38.509111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39cb1d-ff67-412b-961b-cf11f5b58803 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:38.513733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:38.535461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-de39cb1d-ff67-412b-961b-cf11f5b58803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:38.535461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:38.535461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:38.535461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:38.535461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:38.535461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:38.535461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:38.535461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:38.535461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:38.535461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:38.535461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:38.535461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:38.535461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:38.535461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:38.535461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:38.536596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:38.537487 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:38.537487 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:38.537487 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:38.537487 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:38.537487 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 335/666] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:38.542934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39cb1d-ff67-412b-961b-cf11f5b58803 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:38.548765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d966b0-28bd-4f46-b24d-4dd71afb5c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:38.549673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d966b0-28bd-4f46-b24d-4dd71afb5c9f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:38.550342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d966b0-28bd-4f46-b24d-4dd71afb5c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:38.550943 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d966b0-28bd-4f46-b24d-4dd71afb5c9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:38.639040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d966b0-28bd-4f46-b24d-4dd71afb5c9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:38.641581 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d966b0-28bd-4f46-b24d-4dd71afb5c9f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:38.663071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39cb1d-ff67-412b-961b-cf11f5b58803 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:38.707947 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46f2c6-6650-48dd-b176-72250edac17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:38.708700 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46f2c6-6650-48dd-b176-72250edac17b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:38.708975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46f2c6-6650-48dd-b176-72250edac17b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:38.709250 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46f2c6-6650-48dd-b176-72250edac17b None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:38.710087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46f2c6-6650-48dd-b176-72250edac17b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:38.710389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46f2c6-6650-48dd-b176-72250edac17b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:38.711915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46f2c6-6650-48dd-b176-72250edac17b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:38.727772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 336/667] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:38.734623 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46f2c6-6650-48dd-b176-72250edac17b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:38.805594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:38.816714 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 332/668] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:15:38.836466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d966b0-28bd-4f46-b24d-4dd71afb5c9f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:38.841932 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:38.866843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46f2c6-6650-48dd-b176-72250edac17b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:38.905080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7a1f0-5453-4211-9dfd-cbd8a6eb57f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:38.905892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7a1f0-5453-4211-9dfd-cbd8a6eb57f4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:38.906173 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7a1f0-5453-4211-9dfd-cbd8a6eb57f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:38.906444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7a1f0-5453-4211-9dfd-cbd8a6eb57f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:38.914522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7a1f0-5453-4211-9dfd-cbd8a6eb57f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:38.916165 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7a1f0-5453-4211-9dfd-cbd8a6eb57f4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:38.932620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-78e7a1f0-5453-4211-9dfd-cbd8a6eb57f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:38.932620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:38.932620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:38.932620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:38.932620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:38.932620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:38.932620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:38.932620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:38.932620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:38.932620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:38.932620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:38.932620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:38.932620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:38.932620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:38.932620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:38.933574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:38.934456 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:38.934456 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:38.934456 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:38.934456 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:38.934456 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:38.934456 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:38.934456 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:38.934456 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:38.939026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 337/669] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:38.940399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c8cd8-3863-4e06-b2c2-a11166b2b528 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:38.941285 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c8cd8-3863-4e06-b2c2-a11166b2b528 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:38.941575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c8cd8-3863-4e06-b2c2-a11166b2b528 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:38.943487 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 338/670] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:38.944238 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c8cd8-3863-4e06-b2c2-a11166b2b528 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:38.983886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d966b0-28bd-4f46-b24d-4dd71afb5c9f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:39.032330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6027e99-4bb7-49a8-9dd2-c771d60f4393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:39.033536 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6027e99-4bb7-49a8-9dd2-c771d60f4393 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:39.034042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6027e99-4bb7-49a8-9dd2-c771d60f4393 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:39.035436 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6027e99-4bb7-49a8-9dd2-c771d60f4393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:39.051690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6027e99-4bb7-49a8-9dd2-c771d60f4393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:39.054319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6027e99-4bb7-49a8-9dd2-c771d60f4393 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:39.065094 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c8cd8-3863-4e06-b2c2-a11166b2b528 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:39.079650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a6027e99-4bb7-49a8-9dd2-c771d60f4393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:39.079650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:39.079650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:39.079650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:39.079650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:39.079650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:39.079650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:39.079650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:39.079650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:39.079650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:39.079650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:39.079650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:39.079650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:39.079650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:39.079650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:39.080598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:39.082334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:39.082334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:39.082334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:39.082334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:39.089874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 333/671] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:39.089874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6b4df-ff5e-42f9-9dae-2157e665a208 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:39.089874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6b4df-ff5e-42f9-9dae-2157e665a208 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:39.089874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6b4df-ff5e-42f9-9dae-2157e665a208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:39.092589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:39.112163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-71c6b4df-ff5e-42f9-9dae-2157e665a208 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:39.113520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-71c6b4df-ff5e-42f9-9dae-2157e665a208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:39.117655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc08be2-8c19-485e-ac42-d44b5d82be05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:39.118639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc08be2-8c19-485e-ac42-d44b5d82be05 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:39.119183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc08be2-8c19-485e-ac42-d44b5d82be05 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:39.119670 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc08be2-8c19-485e-ac42-d44b5d82be05 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:39.120817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc08be2-8c19-485e-ac42-d44b5d82be05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:39.121325 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc08be2-8c19-485e-ac42-d44b5d82be05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:39.124236 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc08be2-8c19-485e-ac42-d44b5d82be05 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:39.138890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 339/672] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:39.140166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc08be2-8c19-485e-ac42-d44b5d82be05 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:39.167448 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:39.186014 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 334/673] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:39.186698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6b4df-ff5e-42f9-9dae-2157e665a208 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:39.262543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc08be2-8c19-485e-ac42-d44b5d82be05 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:39.299817 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6b4df-ff5e-42f9-9dae-2157e665a208 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:39.303301 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5be760-fd2c-453f-b409-ed43cbb09985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:39.304261 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5be760-fd2c-453f-b409-ed43cbb09985 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:39.304872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5be760-fd2c-453f-b409-ed43cbb09985 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:39.305348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5be760-fd2c-453f-b409-ed43cbb09985 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:39.306326 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5be760-fd2c-453f-b409-ed43cbb09985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:39.306874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5be760-fd2c-453f-b409-ed43cbb09985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:39.308576 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5be760-fd2c-453f-b409-ed43cbb09985 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:39.323699 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 340/674] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:39.324849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5be760-fd2c-453f-b409-ed43cbb09985 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:39.339295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd980b65-a67c-4fa7-9fc3-f8410f4d91ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:39.339958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd980b65-a67c-4fa7-9fc3-f8410f4d91ee None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:39.340352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd980b65-a67c-4fa7-9fc3-f8410f4d91ee None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:39.340532 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd980b65-a67c-4fa7-9fc3-f8410f4d91ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:39.341355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd980b65-a67c-4fa7-9fc3-f8410f4d91ee None admin] RBAC: Adding query filter params (role.id=33cbf420a4284279a9010e820bcece79, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=454b9259519c4332a8a36131c8273786) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:39.341664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd980b65-a67c-4fa7-9fc3-f8410f4d91ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:39.343154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd980b65-a67c-4fa7-9fc3-f8410f4d91ee None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:39.349745 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 335/675] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:15:39 2022] GET /identity/v3/role_assignments?user.id=454b9259519c4332a8a36131c8273786&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=33cbf420a4284279a9010e820bcece79 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:39.351089 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb85da4-2b9d-4eb0-b063-fec808ec94f2 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:39.351369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb85da4-2b9d-4eb0-b063-fec808ec94f2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:39.351639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb85da4-2b9d-4eb0-b063-fec808ec94f2 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:39.353063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 336/676] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:39.353604 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb85da4-2b9d-4eb0-b063-fec808ec94f2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:39.374761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:39.428702 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:39.458278 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5be760-fd2c-453f-b409-ed43cbb09985 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:39.504881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe159f6a-69e8-463c-9619-a4b3162dd3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:39.505808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb85da4-2b9d-4eb0-b063-fec808ec94f2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:39.507030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe159f6a-69e8-463c-9619-a4b3162dd3af None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:39.507552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe159f6a-69e8-463c-9619-a4b3162dd3af None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:39.508021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe159f6a-69e8-463c-9619-a4b3162dd3af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:39.523453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe159f6a-69e8-463c-9619-a4b3162dd3af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-fe159f6a-69e8-463c-9619-a4b3162dd3af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:39.532337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:39.533299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:39.534132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:39.534132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:39.534132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:39.534132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:39.534132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:39.534132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:39.534132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:39.534132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:39.534132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:39.534132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:39.534132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:39.534132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:39.537376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 341/677] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:15:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:39.538967 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb6a50-49e8-4c2b-b21c-48214da98ac6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:39.539494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb6a50-49e8-4c2b-b21c-48214da98ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:39.539977 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb6a50-49e8-4c2b-b21c-48214da98ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:39.548912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae4f5c-37a5-46c8-9e51-d95955bf6ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:39.551555 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae4f5c-37a5-46c8-9e51-d95955bf6ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:39.551836 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae4f5c-37a5-46c8-9e51-d95955bf6ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:39.552113 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae4f5c-37a5-46c8-9e51-d95955bf6ae7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:39.560547 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae4f5c-37a5-46c8-9e51-d95955bf6ae7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:39.562010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1acb6a50-49e8-4c2b-b21c-48214da98ac6 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:39.562129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae4f5c-37a5-46c8-9e51-d95955bf6ae7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:39.563330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1acb6a50-49e8-4c2b-b21c-48214da98ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:39.577856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a3ae4f5c-37a5-46c8-9e51-d95955bf6ae7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:39.577856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:39.577856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:39.577856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:39.577856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:39.577856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:39.577856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:39.577856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:39.577856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:39.577856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:39.577856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:39.577856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:39.577856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:39.577856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:39.577856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:39.578888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:39.580330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:39.580330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:39.580330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:39.580330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:39.580330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:39.580330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:39.580330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:39.580330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:39.580330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 337/678] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:39.580330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae4f5c-37a5-46c8-9e51-d95955bf6ae7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:39.648660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 342/679] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:39.649509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb6a50-49e8-4c2b-b21c-48214da98ac6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:39.695930 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae4f5c-37a5-46c8-9e51-d95955bf6ae7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:39.700721 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:39.707415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:39.732675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fa112-5fc2-4877-9bdf-da12b14e8845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:39.733771 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fa112-5fc2-4877-9bdf-da12b14e8845 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:39.734294 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fa112-5fc2-4877-9bdf-da12b14e8845 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:39.734767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fa112-5fc2-4877-9bdf-da12b14e8845 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:39.735736 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fa112-5fc2-4877-9bdf-da12b14e8845 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:39.736257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fa112-5fc2-4877-9bdf-da12b14e8845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:39.738577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fa112-5fc2-4877-9bdf-da12b14e8845 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:39.748391 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 338/680] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:39.749529 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fa112-5fc2-4877-9bdf-da12b14e8845 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:39.780346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb6a50-49e8-4c2b-b21c-48214da98ac6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:39.829458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319992c-a78a-4ae2-b490-5d66e7aec0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:39.841618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319992c-a78a-4ae2-b490-5d66e7aec0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:39.841618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319992c-a78a-4ae2-b490-5d66e7aec0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:39.841618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319992c-a78a-4ae2-b490-5d66e7aec0a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:39.841618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319992c-a78a-4ae2-b490-5d66e7aec0a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:39.841618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319992c-a78a-4ae2-b490-5d66e7aec0a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:39.841618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319992c-a78a-4ae2-b490-5d66e7aec0a3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:39.852215 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 343/681] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:39.853154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319992c-a78a-4ae2-b490-5d66e7aec0a3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:39.873166 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fa112-5fc2-4877-9bdf-da12b14e8845 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:39.911780 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b92bc-1ae8-4344-bf2f-9e016a06233e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:39.912625 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b92bc-1ae8-4344-bf2f-9e016a06233e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:39.912903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b92bc-1ae8-4344-bf2f-9e016a06233e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:39.913172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b92bc-1ae8-4344-bf2f-9e016a06233e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:39.924522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b92bc-1ae8-4344-bf2f-9e016a06233e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-437b92bc-1ae8-4344-bf2f-9e016a06233e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:39.933216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:39.934198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:39.935158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:39.935158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:39.935158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:39.935158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:39.935158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:39.935158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:39.935158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:39.935158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:39.935158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:39.935158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:39.935158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:39.935158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:39.938937 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 339/682] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:39.939843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b92bc-1ae8-4344-bf2f-9e016a06233e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:39.968457 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:39.974354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:39.989693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319992c-a78a-4ae2-b490-5d66e7aec0a3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:40.029001 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b947f-5939-42a3-b3f5-652f471298cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:40.029846 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b947f-5939-42a3-b3f5-652f471298cb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:40.030125 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b947f-5939-42a3-b3f5-652f471298cb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:40.030393 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b947f-5939-42a3-b3f5-652f471298cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:40.042902 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b947f-5939-42a3-b3f5-652f471298cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:40.044585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b947f-5939-42a3-b3f5-652f471298cb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:40.063538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b92bc-1ae8-4344-bf2f-9e016a06233e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:40.063968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-693b947f-5939-42a3-b3f5-652f471298cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:40.063968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:40.063968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:40.063968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:40.063968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:40.063968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:40.063968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:40.063968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:40.063968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:40.063968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:40.063968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:40.063968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:40.063968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:40.063968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:40.063968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:40.064829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:40.065901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:40.065901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:40.065901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:40.065901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:40.065901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 344/683] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:40.070124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b947f-5939-42a3-b3f5-652f471298cb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:40.114567 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485b0b6-de99-47c3-843b-40d8903e416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:40.115730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485b0b6-de99-47c3-843b-40d8903e416a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:40.116019 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485b0b6-de99-47c3-843b-40d8903e416a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:40.116299 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485b0b6-de99-47c3-843b-40d8903e416a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:40.117842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485b0b6-de99-47c3-843b-40d8903e416a None admin] RBAC: Adding query filter params (role.id=33cbf420a4284279a9010e820bcece79, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=f2fcf925f9ec45b3b2cbea7e6acc0522) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:40.118155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485b0b6-de99-47c3-843b-40d8903e416a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:40.119925 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485b0b6-de99-47c3-843b-40d8903e416a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:40.128753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 340/684] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:15:39 2022] GET /identity/v3/role_assignments?user.id=f2fcf925f9ec45b3b2cbea7e6acc0522&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=33cbf420a4284279a9010e820bcece79 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:40.129569 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485b0b6-de99-47c3-843b-40d8903e416a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:40.241265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b947f-5939-42a3-b3f5-652f471298cb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:40.250712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:40.258757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485b0b6-de99-47c3-843b-40d8903e416a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:40.298172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166e094-d9da-48ad-b31e-78e46d7f9037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:40.298891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166e094-d9da-48ad-b31e-78e46d7f9037 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:40.299170 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166e094-d9da-48ad-b31e-78e46d7f9037 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:40.299443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166e094-d9da-48ad-b31e-78e46d7f9037 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:40.301305 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166e094-d9da-48ad-b31e-78e46d7f9037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:40.302068 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166e094-d9da-48ad-b31e-78e46d7f9037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:40.303877 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166e094-d9da-48ad-b31e-78e46d7f9037 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:40.324946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 341/685] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:40.326866 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166e094-d9da-48ad-b31e-78e46d7f9037 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:40.342194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea78cc-2e48-464b-8fe8-a2c5585982ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:40.342914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea78cc-2e48-464b-8fe8-a2c5585982ed None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:40.343194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea78cc-2e48-464b-8fe8-a2c5585982ed None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:40.343503 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea78cc-2e48-464b-8fe8-a2c5585982ed None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:40.344336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea78cc-2e48-464b-8fe8-a2c5585982ed None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:40.344645 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea78cc-2e48-464b-8fe8-a2c5585982ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:40.346159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea78cc-2e48-464b-8fe8-a2c5585982ed None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:40.360072 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:40.377177 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 345/686] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:40.383768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea78cc-2e48-464b-8fe8-a2c5585982ed None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:40.457291 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166e094-d9da-48ad-b31e-78e46d7f9037 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:40.502983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e957d-455b-47e7-87cf-adcc717ca42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:40.504391 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e957d-455b-47e7-87cf-adcc717ca42d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:40.504674 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e957d-455b-47e7-87cf-adcc717ca42d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:40.504945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e957d-455b-47e7-87cf-adcc717ca42d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:40.515039 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e957d-455b-47e7-87cf-adcc717ca42d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:40.517188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e957d-455b-47e7-87cf-adcc717ca42d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:40.520277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea78cc-2e48-464b-8fe8-a2c5585982ed None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e59e957d-455b-47e7-87cf-adcc717ca42d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:40.541558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:40.548848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:40.551129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:40.551129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:40.551129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:40.551129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:40.551129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:40.551129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:40.551129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:40.551129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:40.551129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:15:40.551129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:40.551129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 342/687] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jul 20 19:15:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:40.551129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e957d-455b-47e7-87cf-adcc717ca42d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:40.568638 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:40.569396 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db2f44-99c5-4a7d-81d7-d8eb30e8c32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:40.570257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db2f44-99c5-4a7d-81d7-d8eb30e8c32d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:40.570540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db2f44-99c5-4a7d-81d7-d8eb30e8c32d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:40.571044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db2f44-99c5-4a7d-81d7-d8eb30e8c32d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:40.584785 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db2f44-99c5-4a7d-81d7-d8eb30e8c32d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:40.586400 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db2f44-99c5-4a7d-81d7-d8eb30e8c32d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:40.605904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-53db2f44-99c5-4a7d-81d7-d8eb30e8c32d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:40.605904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:40.605904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:40.605904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:40.605904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:40.605904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:40.605904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:40.605904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:40.605904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:40.605904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:40.605904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:40.605904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:40.605904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:40.605904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:40.605904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:40.607990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:40.610023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:40.610023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:40.610023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:40.610023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:40.610023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 346/688] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:40.619700 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db2f44-99c5-4a7d-81d7-d8eb30e8c32d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:40.672531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e957d-455b-47e7-87cf-adcc717ca42d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:40.689769 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:40.745220 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476c3e3-b9d0-48bc-9efc-46df3a602c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:40.746070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476c3e3-b9d0-48bc-9efc-46df3a602c0e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:40.746446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476c3e3-b9d0-48bc-9efc-46df3a602c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:40.747256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476c3e3-b9d0-48bc-9efc-46df3a602c0e None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:40.749227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476c3e3-b9d0-48bc-9efc-46df3a602c0e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:40.749803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476c3e3-b9d0-48bc-9efc-46df3a602c0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:40.751588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476c3e3-b9d0-48bc-9efc-46df3a602c0e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:40.775812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 343/689] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 20 19:15:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:40.776741 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db2f44-99c5-4a7d-81d7-d8eb30e8c32d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:40.782705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476c3e3-b9d0-48bc-9efc-46df3a602c0e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:40.854944 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d691b0-b900-4d88-8fab-7e9c77764ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:40.855607 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d691b0-b900-4d88-8fab-7e9c77764ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:40.855937 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d691b0-b900-4d88-8fab-7e9c77764ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:40.856207 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d691b0-b900-4d88-8fab-7e9c77764ce1 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:40.857765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d691b0-b900-4d88-8fab-7e9c77764ce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:40.858124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d691b0-b900-4d88-8fab-7e9c77764ce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:40.859551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d691b0-b900-4d88-8fab-7e9c77764ce1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:40.878869 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 347/690] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:40.880288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91636d1c-96b0-4088-bf35-cba9200fbbbd None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:40.880573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91636d1c-96b0-4088-bf35-cba9200fbbbd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:40.880854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91636d1c-96b0-4088-bf35-cba9200fbbbd None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:40.886102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 348/691] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:40.886102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91636d1c-96b0-4088-bf35-cba9200fbbbd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:40.886643 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:40.921267 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476c3e3-b9d0-48bc-9efc-46df3a602c0e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:40.971372 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148f22c-c81c-4cd2-a476-a0505ff2a323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:40.972267 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148f22c-c81c-4cd2-a476-a0505ff2a323 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:40.972690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148f22c-c81c-4cd2-a476-a0505ff2a323 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:40.972964 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148f22c-c81c-4cd2-a476-a0505ff2a323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:41.003743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91636d1c-96b0-4088-bf35-cba9200fbbbd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:41.018255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:41.054601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e7de3-1033-42d0-ab08-62fe59ca237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:41.055355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e7de3-1033-42d0-ab08-62fe59ca237f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:41.055628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e7de3-1033-42d0-ab08-62fe59ca237f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:41.055900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e7de3-1033-42d0-ab08-62fe59ca237f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:41.065555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e7de3-1033-42d0-ab08-62fe59ca237f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:41.066777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148f22c-c81c-4cd2-a476-a0505ff2a323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:41.067271 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e7de3-1033-42d0-ab08-62fe59ca237f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:41.069259 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148f22c-c81c-4cd2-a476-a0505ff2a323 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-695e7de3-1033-42d0-ab08-62fe59ca237f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:41.083266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:41.084273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:41.085212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:41.085212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:41.085212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:41.085212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:41.085212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:41.085212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:41.085212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:41.085212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:41.085212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:15:41.085212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:41.089311 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 349/692] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:15:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:41.090710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73debb7-d61f-490a-88c4-0292c68649a8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:41.090985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73debb7-d61f-490a-88c4-0292c68649a8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:41.091257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73debb7-d61f-490a-88c4-0292c68649a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:41.109989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a73debb7-d61f-490a-88c4-0292c68649a8 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:41.111293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a73debb7-d61f-490a-88c4-0292c68649a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:41.166881 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:41.188175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 350/693] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:41.189435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73debb7-d61f-490a-88c4-0292c68649a8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:41.208450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 344/694] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:41.213462 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148f22c-c81c-4cd2-a476-a0505ff2a323 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:41.302369 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73debb7-d61f-490a-88c4-0292c68649a8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:41.304483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:41.340722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f77eee-7a7b-40aa-8361-dabe327b6d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:41.341454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f77eee-7a7b-40aa-8361-dabe327b6d5b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:41.341826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f77eee-7a7b-40aa-8361-dabe327b6d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:41.342244 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f77eee-7a7b-40aa-8361-dabe327b6d5b None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:41.343252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f77eee-7a7b-40aa-8361-dabe327b6d5b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:41.343652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f77eee-7a7b-40aa-8361-dabe327b6d5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:41.345245 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f77eee-7a7b-40aa-8361-dabe327b6d5b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:41.353492 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148f22c-c81c-4cd2-a476-a0505ff2a323 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:41.365952 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 351/695] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jul 20 19:15:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:41.371244 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f77eee-7a7b-40aa-8361-dabe327b6d5b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:41.399779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06885d5e-3fab-4c24-a25e-91490e152e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:41.401129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06885d5e-3fab-4c24-a25e-91490e152e7a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:41.401774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06885d5e-3fab-4c24-a25e-91490e152e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:41.402657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06885d5e-3fab-4c24-a25e-91490e152e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:41.417874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06885d5e-3fab-4c24-a25e-91490e152e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:41.420486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06885d5e-3fab-4c24-a25e-91490e152e7a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:41.448689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-06885d5e-3fab-4c24-a25e-91490e152e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:41.448689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:41.448689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:41.448689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:41.448689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:41.448689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:41.448689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:41.448689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:41.448689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:41.448689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:41.448689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:41.448689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:41.448689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:41.448689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:41.448689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:41.449655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:41.450522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:41.450522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:41.450522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:41.450522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:41.457729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 345/696] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:41.457729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06885d5e-3fab-4c24-a25e-91490e152e7a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:41.482190 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f77eee-7a7b-40aa-8361-dabe327b6d5b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:41.492646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:41.529194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b6b85-ae6e-480c-8c19-f15ea3fd2135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:41.530008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b6b85-ae6e-480c-8c19-f15ea3fd2135 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:41.530286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b6b85-ae6e-480c-8c19-f15ea3fd2135 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:41.530555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b6b85-ae6e-480c-8c19-f15ea3fd2135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:41.545358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b6b85-ae6e-480c-8c19-f15ea3fd2135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:41.553650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b6b85-ae6e-480c-8c19-f15ea3fd2135 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:41.577590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-fc3b6b85-ae6e-480c-8c19-f15ea3fd2135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:41.577590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:41.577590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:41.577590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:41.577590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:41.577590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:41.577590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:41.577590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:41.577590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:41.577590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:41.577590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:41.577590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:41.577590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:41.577590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:41.577590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:41.578539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:41.579816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:41.579816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:41.579816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:41.579816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:41.584460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 352/697] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:41.584460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b6b85-ae6e-480c-8c19-f15ea3fd2135 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:41.603284 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:41.606840 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06885d5e-3fab-4c24-a25e-91490e152e7a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:41.653112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157e2b7-fbb0-4c2d-a47d-302aac61a394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:41.654614 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157e2b7-fbb0-4c2d-a47d-302aac61a394 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:41.655122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157e2b7-fbb0-4c2d-a47d-302aac61a394 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:41.655594 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157e2b7-fbb0-4c2d-a47d-302aac61a394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:41.707858 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b6b85-ae6e-480c-8c19-f15ea3fd2135 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:41.747356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c11d8d-40cc-4d40-a696-f54e42087938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:41.748026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c11d8d-40cc-4d40-a696-f54e42087938 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:41.748306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c11d8d-40cc-4d40-a696-f54e42087938 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:41.748581 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c11d8d-40cc-4d40-a696-f54e42087938 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:41.749322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c11d8d-40cc-4d40-a696-f54e42087938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:41.749628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c11d8d-40cc-4d40-a696-f54e42087938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:41.751350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c11d8d-40cc-4d40-a696-f54e42087938 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:41.755228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157e2b7-fbb0-4c2d-a47d-302aac61a394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:41.757685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157e2b7-fbb0-4c2d-a47d-302aac61a394 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:41.770413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 353/698] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:41.770413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c11d8d-40cc-4d40-a696-f54e42087938 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:41.786188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:41.846114 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:41.872642 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 346/699] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:41.872642 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f07b21-1945-4d84-b86d-2b93ee4dea1f None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:41.872642 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f07b21-1945-4d84-b86d-2b93ee4dea1f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:41.872642 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f07b21-1945-4d84-b86d-2b93ee4dea1f None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:41.875403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 347/700] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:41.876226 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f07b21-1945-4d84-b86d-2b93ee4dea1f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:41.885263 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c11d8d-40cc-4d40-a696-f54e42087938 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:41.926305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f310d-dc39-403f-bec5-713e60279497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:41.927297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f310d-dc39-403f-bec5-713e60279497 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:41.927808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f310d-dc39-403f-bec5-713e60279497 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:41.928266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f310d-dc39-403f-bec5-713e60279497 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:41.929097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f310d-dc39-403f-bec5-713e60279497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:41.929409 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f310d-dc39-403f-bec5-713e60279497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:41.930762 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f310d-dc39-403f-bec5-713e60279497 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:41.945841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 354/701] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:41.946664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f310d-dc39-403f-bec5-713e60279497 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:41.993185 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f07b21-1945-4d84-b86d-2b93ee4dea1f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:42.020546 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:42.032045 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e19dc-ffb9-48de-bdc2-699d656e99d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:42.032914 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e19dc-ffb9-48de-bdc2-699d656e99d8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:42.033195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e19dc-ffb9-48de-bdc2-699d656e99d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:42.033464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e19dc-ffb9-48de-bdc2-699d656e99d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:42.044750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e19dc-ffb9-48de-bdc2-699d656e99d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:42.044750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e19dc-ffb9-48de-bdc2-699d656e99d8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:42.054921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f310d-dc39-403f-bec5-713e60279497 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:42.056903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-9d0e19dc-ffb9-48de-bdc2-699d656e99d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:42.056903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:42.056903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:42.056903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:42.056903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:42.056903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:42.056903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:42.056903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:42.056903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:42.056903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:42.056903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:42.056903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:42.056903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:42.056903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:42.056903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:42.057759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:42.058851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:42.058851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:42.058851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:42.058851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:42.058851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:42.058851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:42.058851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:42.058851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:42.058851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 348/702] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:42.059869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81a013-2498-4e98-b16e-283325734108 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:42.060297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81a013-2498-4e98-b16e-283325734108 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:42.061255 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81a013-2498-4e98-b16e-283325734108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:42.078479 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5b81a013-2498-4e98-b16e-283325734108 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:42.079828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5b81a013-2498-4e98-b16e-283325734108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:42.092933 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:42.098979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802534f-db41-4d1d-82e5-364466980e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:42.099808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802534f-db41-4d1d-82e5-364466980e0a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:42.100140 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802534f-db41-4d1d-82e5-364466980e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:42.100363 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802534f-db41-4d1d-82e5-364466980e0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:42.111409 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802534f-db41-4d1d-82e5-364466980e0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:42.113604 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802534f-db41-4d1d-82e5-364466980e0a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:42.132411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a802534f-db41-4d1d-82e5-364466980e0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:42.132411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:42.132411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:42.132411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:42.132411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:42.132411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:42.132411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:42.132411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:42.132411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:42.132411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:42.132411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:42.132411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:42.132411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:42.132411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:42.132411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:42.133410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:42.134339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:42.134339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:42.134339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:42.134339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:42.134339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 355/703] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:42.134339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802534f-db41-4d1d-82e5-364466980e0a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:42.158445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 349/704] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:42.163638 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81a013-2498-4e98-b16e-283325734108 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:42.270897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802534f-db41-4d1d-82e5-364466980e0a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:42.287119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81a013-2498-4e98-b16e-283325734108 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:42.305663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:42.316908 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec5e5e-9f36-461f-ba6c-ba18b0e6962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:42.317777 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec5e5e-9f36-461f-ba6c-ba18b0e6962a None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:42.318169 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec5e5e-9f36-461f-ba6c-ba18b0e6962a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:42.318169 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec5e5e-9f36-461f-ba6c-ba18b0e6962a None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:42.318888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec5e5e-9f36-461f-ba6c-ba18b0e6962a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:42.320341 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec5e5e-9f36-461f-ba6c-ba18b0e6962a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:42.327087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0059f-1c60-4d79-83fe-ebe731f5dc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:42.327661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0059f-1c60-4d79-83fe-ebe731f5dc59 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:42.330537 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0059f-1c60-4d79-83fe-ebe731f5dc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:42.330537 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0059f-1c60-4d79-83fe-ebe731f5dc59 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:42.330537 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0059f-1c60-4d79-83fe-ebe731f5dc59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:42.330537 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0059f-1c60-4d79-83fe-ebe731f5dc59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:42.331079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0059f-1c60-4d79-83fe-ebe731f5dc59 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:42.342756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 350/705] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:42.343582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0059f-1c60-4d79-83fe-ebe731f5dc59 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:42.414706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 356/706] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:15:42 2022] POST /identity/v3/users => generated 254 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:15:42.414706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec5e5e-9f36-461f-ba6c-ba18b0e6962a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:42.474847 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0059f-1c60-4d79-83fe-ebe731f5dc59 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:42.476627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:42.515711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af36610-0fea-473a-9ad2-a491eaee6f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:42.516805 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af36610-0fea-473a-9ad2-a491eaee6f84 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:42.517303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af36610-0fea-473a-9ad2-a491eaee6f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:42.517748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af36610-0fea-473a-9ad2-a491eaee6f84 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:42.518731 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af36610-0fea-473a-9ad2-a491eaee6f84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:42.519249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af36610-0fea-473a-9ad2-a491eaee6f84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:42.521056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af36610-0fea-473a-9ad2-a491eaee6f84 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:42.536421 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 351/707] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:42.537728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af36610-0fea-473a-9ad2-a491eaee6f84 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:42.571146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec5e5e-9f36-461f-ba6c-ba18b0e6962a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:42.582106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:42.614861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab8b0b-597e-4854-8b49-19c22942dd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:42.615675 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab8b0b-597e-4854-8b49-19c22942dd3f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:42.615958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab8b0b-597e-4854-8b49-19c22942dd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:42.616416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab8b0b-597e-4854-8b49-19c22942dd3f None admin] PATH_INFO: `/v3/services/network` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:42.617091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab8b0b-597e-4854-8b49-19c22942dd3f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:42.618481 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab8b0b-597e-4854-8b49-19c22942dd3f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7fab8b0b-597e-4854-8b49-19c22942dd3f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:42.632864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:42.633916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:42.634795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:42.634795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:42.634795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:42.634795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:42.634795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:42.634795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:42.634795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:42.634795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:42.634795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:42.634795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:42.634795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:15:42.634795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:42.634795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:15:42.634795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:42.634795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 357/708] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:42 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:42.635605 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab8b0b-597e-4854-8b49-19c22942dd3f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:42.715543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af36610-0fea-473a-9ad2-a491eaee6f84 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:42.752493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51c151-591c-48e4-85d6-e686e9352c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:42.753953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51c151-591c-48e4-85d6-e686e9352c58 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:42.754235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51c151-591c-48e4-85d6-e686e9352c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:42.754506 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51c151-591c-48e4-85d6-e686e9352c58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:42.755376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51c151-591c-48e4-85d6-e686e9352c58 None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=e3fd38ebb5514af686204d0b02a91edd) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:42.755691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51c151-591c-48e4-85d6-e686e9352c58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:42.757132 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51c151-591c-48e4-85d6-e686e9352c58 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:42.763885 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 352/709] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:15:42 2022] GET /identity/v3/role_assignments?user.id=e3fd38ebb5514af686204d0b02a91edd&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:42.764789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51c151-591c-48e4-85d6-e686e9352c58 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:42.795859 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab8b0b-597e-4854-8b49-19c22942dd3f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:42.801039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:42.848618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed889783-7d6a-4cba-a4a9-273f9c08ef9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:42.849449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed889783-7d6a-4cba-a4a9-273f9c08ef9c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:42.849733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed889783-7d6a-4cba-a4a9-273f9c08ef9c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:42.850012 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed889783-7d6a-4cba-a4a9-273f9c08ef9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:42.858410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed889783-7d6a-4cba-a4a9-273f9c08ef9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:42.860446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed889783-7d6a-4cba-a4a9-273f9c08ef9c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:42.877208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ed889783-7d6a-4cba-a4a9-273f9c08ef9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:42.877208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:42.877208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:42.877208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:42.877208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:42.877208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:42.877208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:42.877208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:42.877208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:42.877208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:42.877208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:42.877208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:42.877208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:42.877208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:42.877208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:42.878448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:42.879653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:42.879653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:42.879653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:42.879653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:42.879653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:42.879653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:42.879653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:42.879653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:42.881280 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 358/710] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:42.882953 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e679b-36d9-478f-bc84-8dd0299ec8b6 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:42.883365 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e679b-36d9-478f-bc84-8dd0299ec8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:42.883804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e679b-36d9-478f-bc84-8dd0299ec8b6 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:42.889662 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 359/711] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:42.890829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e679b-36d9-478f-bc84-8dd0299ec8b6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:42.908426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:42.915120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51c151-591c-48e4-85d6-e686e9352c58 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:42.965102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc79772-0d7f-4e4b-8c1a-bd3ea4d2aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:42.966103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc79772-0d7f-4e4b-8c1a-bd3ea4d2aeef None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:42.966542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc79772-0d7f-4e4b-8c1a-bd3ea4d2aeef None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:42.967698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc79772-0d7f-4e4b-8c1a-bd3ea4d2aeef None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:42.968651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc79772-0d7f-4e4b-8c1a-bd3ea4d2aeef None admin] RBAC: Adding query filter params (name=network) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:42.969748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc79772-0d7f-4e4b-8c1a-bd3ea4d2aeef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:42.973525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc79772-0d7f-4e4b-8c1a-bd3ea4d2aeef None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:42.979017 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 353/712] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 20 19:15:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:42.980418 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a78217-7b08-40bb-afdc-161c19933667 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:42.980850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a78217-7b08-40bb-afdc-161c19933667 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:42.981291 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a78217-7b08-40bb-afdc-161c19933667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:42.999264 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-27a78217-7b08-40bb-afdc-161c19933667 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:43.000754 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-27a78217-7b08-40bb-afdc-161c19933667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:43.022683 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e679b-36d9-478f-bc84-8dd0299ec8b6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:43.059016 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cf3ea-f054-4771-a345-7afff921951b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:43.059677 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cf3ea-f054-4771-a345-7afff921951b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:43.060199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cf3ea-f054-4771-a345-7afff921951b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:43.060477 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cf3ea-f054-4771-a345-7afff921951b None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:43.061331 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cf3ea-f054-4771-a345-7afff921951b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:43.061944 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cf3ea-f054-4771-a345-7afff921951b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:43.063209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cf3ea-f054-4771-a345-7afff921951b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:43.077324 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 354/713] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:43.078496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a78217-7b08-40bb-afdc-161c19933667 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:43.083372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 360/714] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:43.083874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cf3ea-f054-4771-a345-7afff921951b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:43.110221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:43.179433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:43.188032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cf3ea-f054-4771-a345-7afff921951b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:43.189928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a78217-7b08-40bb-afdc-161c19933667 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:43.225922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e5a4c-4830-4f62-ad64-fe6a06423e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:43.226572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e5a4c-4830-4f62-ad64-fe6a06423e78 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:43.226883 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e5a4c-4830-4f62-ad64-fe6a06423e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:43.227156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e5a4c-4830-4f62-ad64-fe6a06423e78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:43.228099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e5a4c-4830-4f62-ad64-fe6a06423e78 None admin] RBAC: Adding query filter params (role.id=33cbf420a4284279a9010e820bcece79, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=fde62f4ce7af42eca1fe5a7b6807d1ae) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:43.228297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08f99b-2ff4-4e71-88f2-6ef5e0e2b624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:43.228428 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e5a4c-4830-4f62-ad64-fe6a06423e78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:43.229273 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08f99b-2ff4-4e71-88f2-6ef5e0e2b624 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:43.229755 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08f99b-2ff4-4e71-88f2-6ef5e0e2b624 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:43.229870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e5a4c-4830-4f62-ad64-fe6a06423e78 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:43.230334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08f99b-2ff4-4e71-88f2-6ef5e0e2b624 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:43.231314 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08f99b-2ff4-4e71-88f2-6ef5e0e2b624 None admin] RBAC: Adding query filter params (type=network) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:43.231821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08f99b-2ff4-4e71-88f2-6ef5e0e2b624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:43.233396 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08f99b-2ff4-4e71-88f2-6ef5e0e2b624 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:43.246717 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 361/716] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:15:43 2022] GET /identity/v3/role_assignments?user.id=fde62f4ce7af42eca1fe5a7b6807d1ae&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=33cbf420a4284279a9010e820bcece79 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:43.246717 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e5a4c-4830-4f62-ad64-fe6a06423e78 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:43.247242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 355/716] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 20 19:15:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:43.394800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:43.408832 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e5a4c-4830-4f62-ad64-fe6a06423e78 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:43.455293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01cf4e-127c-4e4d-a324-2e96eda3ff85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:43.456272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01cf4e-127c-4e4d-a324-2e96eda3ff85 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:43.456557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01cf4e-127c-4e4d-a324-2e96eda3ff85 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:43.457059 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01cf4e-127c-4e4d-a324-2e96eda3ff85 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:43.457749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01cf4e-127c-4e4d-a324-2e96eda3ff85 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:43.459227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01cf4e-127c-4e4d-a324-2e96eda3ff85 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2a01cf4e-127c-4e4d-a324-2e96eda3ff85 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:43.472821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:43.473830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:43.474696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 362/717] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jul 20 19:15:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:43.480420 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08f99b-2ff4-4e71-88f2-6ef5e0e2b624 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:43.612587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08f99b-2ff4-4e71-88f2-6ef5e0e2b624 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:43.652533 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa850634-205a-4ef8-84a0-0d9edb73ce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:43.653197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa850634-205a-4ef8-84a0-0d9edb73ce12 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:43.653471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa850634-205a-4ef8-84a0-0d9edb73ce12 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:43.653851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa850634-205a-4ef8-84a0-0d9edb73ce12 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:43.654554 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa850634-205a-4ef8-84a0-0d9edb73ce12 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:43.654872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa850634-205a-4ef8-84a0-0d9edb73ce12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:43.656229 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa850634-205a-4ef8-84a0-0d9edb73ce12 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:43.661366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 356/718] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 20 19:15:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:43.666729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01cf4e-127c-4e4d-a324-2e96eda3ff85 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:43.776285 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01cf4e-127c-4e4d-a324-2e96eda3ff85 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:43.813732 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4becc96-8587-4583-9911-634486f40882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:43.814398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4becc96-8587-4583-9911-634486f40882 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:43.814688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4becc96-8587-4583-9911-634486f40882 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:43.814985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4becc96-8587-4583-9911-634486f40882 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:43.815698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4becc96-8587-4583-9911-634486f40882 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:43.815993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4becc96-8587-4583-9911-634486f40882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:43.817371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4becc96-8587-4583-9911-634486f40882 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:43.824026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 363/719] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 20 19:15:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:44.835877 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ae88a-9716-4682-83c2-d7cc0a6341cd None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:44.836402 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ae88a-9716-4682-83c2-d7cc0a6341cd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:44.836402 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ae88a-9716-4682-83c2-d7cc0a6341cd None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:44.838043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 357/720] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:44.856120 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0703-57e8-4161-8b2f-4995cd74f267 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:44.856601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0703-57e8-4161-8b2f-4995cd74f267 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:44.856681 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0703-57e8-4161-8b2f-4995cd74f267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:44.879658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-06ad0703-57e8-4161-8b2f-4995cd74f267 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:44.880869 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-06ad0703-57e8-4161-8b2f-4995cd74f267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:44.892166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:44.920007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b4ea1-7a0f-4390-b2ad-5d192c3d6359 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:44.920321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b4ea1-7a0f-4390-b2ad-5d192c3d6359 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:44.920559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b4ea1-7a0f-4390-b2ad-5d192c3d6359 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:44.922168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 358/721] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:44.928484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139e4a1-e047-4f93-bbc3-133ce63118de None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:44.928958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139e4a1-e047-4f93-bbc3-133ce63118de None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:44.929237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139e4a1-e047-4f93-bbc3-133ce63118de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:44.958041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c139e4a1-e047-4f93-bbc3-133ce63118de None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:44.959268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c139e4a1-e047-4f93-bbc3-133ce63118de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:44.991149 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:45.003330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 364/722] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:45.027609 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0703-57e8-4161-8b2f-4995cd74f267 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:45.108432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 359/723] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:45.130528 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0703-57e8-4161-8b2f-4995cd74f267 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:45.142898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139e4a1-e047-4f93-bbc3-133ce63118de None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:45.166387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133e21a-84f9-4e5f-bf47-d621a4981f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:45.167212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133e21a-84f9-4e5f-bf47-d621a4981f64 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:45.167489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133e21a-84f9-4e5f-bf47-d621a4981f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:45.167756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133e21a-84f9-4e5f-bf47-d621a4981f64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:45.178563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133e21a-84f9-4e5f-bf47-d621a4981f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1133e21a-84f9-4e5f-bf47-d621a4981f64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:45.186797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:45.187750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:45.188617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:45.188617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:45.188617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:45.188617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:45.188617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:45.188617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:45.188617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:45.188617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:45.188617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:45.188617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:45.188617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:45.188617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:45.188617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 365/724] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:45.194156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133e21a-84f9-4e5f-bf47-d621a4981f64 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:45.207047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:45.305085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133e21a-84f9-4e5f-bf47-d621a4981f64 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:45.345284 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198573df-4807-4215-8732-c08bd5263a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:45.346026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198573df-4807-4215-8732-c08bd5263a7d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:45.346339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198573df-4807-4215-8732-c08bd5263a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:45.346617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198573df-4807-4215-8732-c08bd5263a7d None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:45.348407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198573df-4807-4215-8732-c08bd5263a7d None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:45.348710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198573df-4807-4215-8732-c08bd5263a7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:45.350093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198573df-4807-4215-8732-c08bd5263a7d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:45.366249 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 366/725] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:45.378436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198573df-4807-4215-8732-c08bd5263a7d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:45.419478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139e4a1-e047-4f93-bbc3-133ce63118de None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:45.451676 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:45.491337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198573df-4807-4215-8732-c08bd5263a7d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:45.494566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4fd27-c61f-433c-8570-bb845b7af411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:45.495643 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4fd27-c61f-433c-8570-bb845b7af411 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:45.496068 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4fd27-c61f-433c-8570-bb845b7af411 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:45.496498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4fd27-c61f-433c-8570-bb845b7af411 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:45.523698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4fd27-c61f-433c-8570-bb845b7af411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:45.530180 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424b98c-0a89-480f-b42e-26ed7f46a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:45.531137 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424b98c-0a89-480f-b42e-26ed7f46a140 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:45.531513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424b98c-0a89-480f-b42e-26ed7f46a140 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:45.537915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424b98c-0a89-480f-b42e-26ed7f46a140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-ddb4fd27-c61f-433c-8570-bb845b7af411 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:45.538912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:45.539991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:45.541056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:45.541056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:45.541056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:45.541056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:45.541056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:45.541056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:45.541056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:45.541056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:45.541056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:45.541056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:45.541056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:45.541056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:45.543761 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 360/726] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:15:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:45.547377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424b98c-0a89-480f-b42e-26ed7f46a140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:45.549203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4fd27-c61f-433c-8570-bb845b7af411 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:45.549888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424b98c-0a89-480f-b42e-26ed7f46a140 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:45.580661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:45.587006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-5424b98c-0a89-480f-b42e-26ed7f46a140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:45.587006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:45.587006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:45.587006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:45.587006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:45.587006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:45.587006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:45.587006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:45.587006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:45.587006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:45.587006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:45.587006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:45.587006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:45.587006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:45.587006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:45.587914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:45.588817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:45.588817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:45.588817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:45.588817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:45.588817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 367/727] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:45.598849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424b98c-0a89-480f-b42e-26ed7f46a140 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:45.700558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4fd27-c61f-433c-8570-bb845b7af411 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:45.748980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7860e-201a-4d0e-b047-71f54ee162de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:45.749658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7860e-201a-4d0e-b047-71f54ee162de None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:45.749946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7860e-201a-4d0e-b047-71f54ee162de None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:45.750222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7860e-201a-4d0e-b047-71f54ee162de None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:45.750999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7860e-201a-4d0e-b047-71f54ee162de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:45.751306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7860e-201a-4d0e-b047-71f54ee162de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:45.752765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7860e-201a-4d0e-b047-71f54ee162de None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:45.771251 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 361/728] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:45.776457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7860e-201a-4d0e-b047-71f54ee162de None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:45.800351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424b98c-0a89-480f-b42e-26ed7f46a140 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:45.823066 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:45.843468 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0afa0-c857-4541-a8b2-6df3cdc8e684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:45.844156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0afa0-c857-4541-a8b2-6df3cdc8e684 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:45.844437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0afa0-c857-4541-a8b2-6df3cdc8e684 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:45.844711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0afa0-c857-4541-a8b2-6df3cdc8e684 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:45.845443 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0afa0-c857-4541-a8b2-6df3cdc8e684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:45.845805 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0afa0-c857-4541-a8b2-6df3cdc8e684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:45.847950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0afa0-c857-4541-a8b2-6df3cdc8e684 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:45.865145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 368/729] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:45.866586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0168cb-3f42-4ffe-b1ad-8318e3c51d2f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:45.866916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0168cb-3f42-4ffe-b1ad-8318e3c51d2f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:45.867195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0168cb-3f42-4ffe-b1ad-8318e3c51d2f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:45.868094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:45.873244 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 369/730] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:45.873244 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0168cb-3f42-4ffe-b1ad-8318e3c51d2f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:45.909344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7860e-201a-4d0e-b047-71f54ee162de None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:45.960452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895f903-87c1-4d83-8f7e-8ee754c1029b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:45.961173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895f903-87c1-4d83-8f7e-8ee754c1029b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:45.961452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895f903-87c1-4d83-8f7e-8ee754c1029b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:45.961726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895f903-87c1-4d83-8f7e-8ee754c1029b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:45.977531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895f903-87c1-4d83-8f7e-8ee754c1029b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:45.979589 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895f903-87c1-4d83-8f7e-8ee754c1029b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:45.993172 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0168cb-3f42-4ffe-b1ad-8318e3c51d2f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:46.003446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-8895f903-87c1-4d83-8f7e-8ee754c1029b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:46.003446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:46.003446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:46.003446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:46.003446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:46.003446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:46.003446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:46.003446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:46.003446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:46.003446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:46.003446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:46.003446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:46.003446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:46.003446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:46.003446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:46.004394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:46.005310 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:46.005310 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:46.005310 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:46.005310 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:46.005310 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 362/731] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:46.006441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dda55d-8e23-4bce-99bf-359d7e3c3928 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:46.007064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dda55d-8e23-4bce-99bf-359d7e3c3928 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:46.007339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dda55d-8e23-4bce-99bf-359d7e3c3928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:46.029711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-31dda55d-8e23-4bce-99bf-359d7e3c3928 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:46.030923 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-31dda55d-8e23-4bce-99bf-359d7e3c3928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:46.049489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d5ed6-6ed6-4fd0-94c8-635ec9317202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:46.050961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d5ed6-6ed6-4fd0-94c8-635ec9317202 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:46.051864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d5ed6-6ed6-4fd0-94c8-635ec9317202 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:46.052371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d5ed6-6ed6-4fd0-94c8-635ec9317202 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:46.063545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d5ed6-6ed6-4fd0-94c8-635ec9317202 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:46.066791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d5ed6-6ed6-4fd0-94c8-635ec9317202 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3f8d5ed6-6ed6-4fd0-94c8-635ec9317202 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:46.088725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:46.089719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:46.090664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:46.090664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:46.090664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:46.090664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:46.090664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:46.090664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:46.090664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:46.090664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:46.090664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:15:46.090664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:46.098816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 370/732] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jul 20 19:15:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:46.098816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d5ed6-6ed6-4fd0-94c8-635ec9317202 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:46.114448 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 363/733] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:46.115904 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dda55d-8e23-4bce-99bf-359d7e3c3928 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:46.165890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:46.188322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:46.228906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d5ed6-6ed6-4fd0-94c8-635ec9317202 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:46.247556 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dda55d-8e23-4bce-99bf-359d7e3c3928 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:46.268643 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848829ce-ee7b-46e0-99c8-d9706f3cb950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:46.269370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848829ce-ee7b-46e0-99c8-d9706f3cb950 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:46.269746 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848829ce-ee7b-46e0-99c8-d9706f3cb950 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:46.270152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848829ce-ee7b-46e0-99c8-d9706f3cb950 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:46.271199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848829ce-ee7b-46e0-99c8-d9706f3cb950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:46.271604 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848829ce-ee7b-46e0-99c8-d9706f3cb950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:46.273179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848829ce-ee7b-46e0-99c8-d9706f3cb950 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:46.285837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 371/734] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:46.286812 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848829ce-ee7b-46e0-99c8-d9706f3cb950 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:46.295524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527ae0e-c6b1-41ed-b629-bce28f39c1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:46.296396 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527ae0e-c6b1-41ed-b629-bce28f39c1ef None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:46.297272 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527ae0e-c6b1-41ed-b629-bce28f39c1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:46.297702 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527ae0e-c6b1-41ed-b629-bce28f39c1ef None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:46.298720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527ae0e-c6b1-41ed-b629-bce28f39c1ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:46.299816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527ae0e-c6b1-41ed-b629-bce28f39c1ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:46.302066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527ae0e-c6b1-41ed-b629-bce28f39c1ef None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:46.332675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 364/735] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jul 20 19:15:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:46.333877 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527ae0e-c6b1-41ed-b629-bce28f39c1ef None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:46.395896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:46.398616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848829ce-ee7b-46e0-99c8-d9706f3cb950 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:46.435617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464db64e-01ec-4455-963c-ff8eb8a43018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:46.436280 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464db64e-01ec-4455-963c-ff8eb8a43018 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:46.436557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464db64e-01ec-4455-963c-ff8eb8a43018 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:46.436833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464db64e-01ec-4455-963c-ff8eb8a43018 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:46.437550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464db64e-01ec-4455-963c-ff8eb8a43018 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:46.438981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464db64e-01ec-4455-963c-ff8eb8a43018 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:46.444031 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527ae0e-c6b1-41ed-b629-bce28f39c1ef None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:46.458318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:46.478793 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c420e5-2f4e-4bb1-8d08-19e03c41bd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:46.479640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c420e5-2f4e-4bb1-8d08-19e03c41bd43 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:46.479916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c420e5-2f4e-4bb1-8d08-19e03c41bd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:46.480197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c420e5-2f4e-4bb1-8d08-19e03c41bd43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:46.488245 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c420e5-2f4e-4bb1-8d08-19e03c41bd43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:46.489684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c420e5-2f4e-4bb1-8d08-19e03c41bd43 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f6c420e5-2f4e-4bb1-8d08-19e03c41bd43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:46.505056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:46.506058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:46.507035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:46.507035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:46.507035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:46.507035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:46.507035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:46.507035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:46.507035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:46.507035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:46.507035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:15:46.507035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:46.507035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 365/736] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jul 20 19:15:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:46.507035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c420e5-2f4e-4bb1-8d08-19e03c41bd43 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:46.569560 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 372/737] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 20 19:15:46 2022] POST /identity/v3/services => generated 240 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:15:46.571031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c1089-6ed6-4434-831f-bb213dd168a7 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:46.571386 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c1089-6ed6-4434-831f-bb213dd168a7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:46.571774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c1089-6ed6-4434-831f-bb213dd168a7 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:46.573314 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 373/738] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:46.573817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c1089-6ed6-4434-831f-bb213dd168a7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:46.617074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c420e5-2f4e-4bb1-8d08-19e03c41bd43 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:46.733742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fb437-3564-43e1-93c4-0fc73d0881d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:46.734438 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fb437-3564-43e1-93c4-0fc73d0881d5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:46.735137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fb437-3564-43e1-93c4-0fc73d0881d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:46.735411 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fb437-3564-43e1-93c4-0fc73d0881d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:46.755966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c1089-6ed6-4434-831f-bb213dd168a7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:46.780946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:46.798258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffc0b8-649d-4655-b083-4183cec1e795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:46.798966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffc0b8-649d-4655-b083-4183cec1e795 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:46.799815 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffc0b8-649d-4655-b083-4183cec1e795 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:46.800178 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffc0b8-649d-4655-b083-4183cec1e795 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:46.800935 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffc0b8-649d-4655-b083-4183cec1e795 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:46.801242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffc0b8-649d-4655-b083-4183cec1e795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:46.802729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffc0b8-649d-4655-b083-4183cec1e795 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:46.818607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fb437-3564-43e1-93c4-0fc73d0881d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:46.821376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fb437-3564-43e1-93c4-0fc73d0881d5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:46.827804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 374/739] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 20 19:15:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:46.827804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d21449-6895-465a-b24f-e4e608b10b6b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:46.827804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d21449-6895-465a-b24f-e4e608b10b6b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:46.827804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d21449-6895-465a-b24f-e4e608b10b6b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:46.830605 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 375/740] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:46.832092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190bdfc-eb3f-453b-8da8-1556cc6935b6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:46.832378 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190bdfc-eb3f-453b-8da8-1556cc6935b6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:46.832650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190bdfc-eb3f-453b-8da8-1556cc6935b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:46.849869 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8190bdfc-eb3f-453b-8da8-1556cc6935b6 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:46.851133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8190bdfc-eb3f-453b-8da8-1556cc6935b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:46.866136 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:46.924759 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 376/741] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:46 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:46.926100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190bdfc-eb3f-453b-8da8-1556cc6935b6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:46.942837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 366/742] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:46 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:15:46.944910 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eabadd-b7d8-4554-9de0-468a48126e4b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:46.945756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eabadd-b7d8-4554-9de0-468a48126e4b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:46.947025 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eabadd-b7d8-4554-9de0-468a48126e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:46.965530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d1eabadd-b7d8-4554-9de0-468a48126e4b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:46.966933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d1eabadd-b7d8-4554-9de0-468a48126e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:47.032797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:47.037467 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190bdfc-eb3f-453b-8da8-1556cc6935b6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:47.039904 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 367/743] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:46 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:15:47.040744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eabadd-b7d8-4554-9de0-468a48126e4b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:47.091157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b3369-9f5c-4fb2-a374-fc446165ab41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:47.091888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b3369-9f5c-4fb2-a374-fc446165ab41 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:47.092230 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b3369-9f5c-4fb2-a374-fc446165ab41 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:47.092446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b3369-9f5c-4fb2-a374-fc446165ab41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:47.104053 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b3369-9f5c-4fb2-a374-fc446165ab41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:47.105526 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b3369-9f5c-4fb2-a374-fc446165ab41 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:47.114864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:47.124472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e68b3369-9f5c-4fb2-a374-fc446165ab41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:47.124472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:47.124472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:47.124472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:47.124472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:47.124472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:47.124472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:47.124472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:47.124472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:47.124472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:47.124472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:47.124472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:47.124472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:47.124472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:47.124472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:47.129835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:47.130768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:47.130768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:47.130768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:47.130768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:47.130768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 377/744] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:47.130768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b3369-9f5c-4fb2-a374-fc446165ab41 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:47.158094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eabadd-b7d8-4554-9de0-468a48126e4b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:47.195326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a58cc-1896-476f-956e-3bd11b1e07d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:47.196120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a58cc-1896-476f-956e-3bd11b1e07d3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:47.196394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a58cc-1896-476f-956e-3bd11b1e07d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:47.196721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a58cc-1896-476f-956e-3bd11b1e07d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:47.207609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a58cc-1896-476f-956e-3bd11b1e07d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:47.209082 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a58cc-1896-476f-956e-3bd11b1e07d3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:47.226983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e31a58cc-1896-476f-956e-3bd11b1e07d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:47.226983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:47.226983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:47.226983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:47.226983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:47.226983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:47.226983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:47.226983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:47.226983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:47.226983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:47.226983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:47.226983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:47.226983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:47.226983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:47.226983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:47.227941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:47.228835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:47.228835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:47.228835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:47.228835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:47.228835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 368/745] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:47.229109 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a58cc-1896-476f-956e-3bd11b1e07d3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:47.247291 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b3369-9f5c-4fb2-a374-fc446165ab41 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:47.288807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbda018-d218-4728-b808-c405cd33226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:47.289936 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbda018-d218-4728-b808-c405cd33226f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:47.290400 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbda018-d218-4728-b808-c405cd33226f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:47.291010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbda018-d218-4728-b808-c405cd33226f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:47.291973 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:47.303913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbda018-d218-4728-b808-c405cd33226f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7bbda018-d218-4728-b808-c405cd33226f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:47.312488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:47.313535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:47.315358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:47.315358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:47.315358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:47.315358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:47.315358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:47.315358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:47.315358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:47.315358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:47.315358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:47.315358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:47.315358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:47.315358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:47.317578 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 378/746] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:15:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:47.318540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbda018-d218-4728-b808-c405cd33226f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:47.353209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a58cc-1896-476f-956e-3bd11b1e07d3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:47.388185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:47.389906 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f22ed-25a0-41a0-9b6a-d93d7b283d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:47.390579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f22ed-25a0-41a0-9b6a-d93d7b283d66 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:47.390887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f22ed-25a0-41a0-9b6a-d93d7b283d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:47.391164 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f22ed-25a0-41a0-9b6a-d93d7b283d66 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:47.391886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f22ed-25a0-41a0-9b6a-d93d7b283d66 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:47.393270 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f22ed-25a0-41a0-9b6a-d93d7b283d66 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:47.429850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbda018-d218-4728-b808-c405cd33226f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:47.464170 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf7d0b-adf9-487e-a67c-4c7431ba43fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:47.464827 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf7d0b-adf9-487e-a67c-4c7431ba43fc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:47.465104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf7d0b-adf9-487e-a67c-4c7431ba43fc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:47.465372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf7d0b-adf9-487e-a67c-4c7431ba43fc None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:47.466089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf7d0b-adf9-487e-a67c-4c7431ba43fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:47.466394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf7d0b-adf9-487e-a67c-4c7431ba43fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:47.467821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf7d0b-adf9-487e-a67c-4c7431ba43fc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:47.480509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 379/747] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:47.481330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf7d0b-adf9-487e-a67c-4c7431ba43fc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:47.497896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 369/748] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 20 19:15:47 2022] POST /identity/v3/services => generated 251 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:15:47.497896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f22ed-25a0-41a0-9b6a-d93d7b283d66 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:47.622049 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf7d0b-adf9-487e-a67c-4c7431ba43fc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:47.647124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:47.667788 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f22ed-25a0-41a0-9b6a-d93d7b283d66 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:47.670077 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b525e-b437-4ba2-921e-189803307d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:47.670912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b525e-b437-4ba2-921e-189803307d10 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:47.671265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b525e-b437-4ba2-921e-189803307d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:47.671543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b525e-b437-4ba2-921e-189803307d10 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:47.672357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b525e-b437-4ba2-921e-189803307d10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:47.672567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b525e-b437-4ba2-921e-189803307d10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:47.675014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b525e-b437-4ba2-921e-189803307d10 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:47.678355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:47.688082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 380/749] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:47.689040 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b525e-b437-4ba2-921e-189803307d10 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:47.712568 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f9a94-c3b7-42ad-a313-28d139f4878e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:47.713514 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f9a94-c3b7-42ad-a313-28d139f4878e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:47.713793 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f9a94-c3b7-42ad-a313-28d139f4878e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:47.714068 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f9a94-c3b7-42ad-a313-28d139f4878e None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:47.715027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f9a94-c3b7-42ad-a313-28d139f4878e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:47.715223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f9a94-c3b7-42ad-a313-28d139f4878e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:47.717312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f9a94-c3b7-42ad-a313-28d139f4878e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:47.726965 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 370/750] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:47.730962 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f9a94-c3b7-42ad-a313-28d139f4878e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:47.820398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b525e-b437-4ba2-921e-189803307d10 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:47.852838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f9a94-c3b7-42ad-a313-28d139f4878e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:47.868559 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025e830-3a10-43a7-8e77-0f7893b720f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:47.869494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025e830-3a10-43a7-8e77-0f7893b720f5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:47.869776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025e830-3a10-43a7-8e77-0f7893b720f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:47.870049 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025e830-3a10-43a7-8e77-0f7893b720f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:47.879185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025e830-3a10-43a7-8e77-0f7893b720f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:47.881144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025e830-3a10-43a7-8e77-0f7893b720f5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:47.894893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cb88d-492f-4294-b0d1-fbf4b9bc11c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:47.895934 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cb88d-492f-4294-b0d1-fbf4b9bc11c6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:47.896309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cb88d-492f-4294-b0d1-fbf4b9bc11c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:47.896674 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cb88d-492f-4294-b0d1-fbf4b9bc11c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:47.900848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d025e830-3a10-43a7-8e77-0f7893b720f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:47.900848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:47.900848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:47.900848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:47.900848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:47.900848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:47.900848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:47.900848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:47.900848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:47.900848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:47.900848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:47.900848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:47.900848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:47.900848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:47.900848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:47.902115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:47.903738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:47.903738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:47.903738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:47.903738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:47.903738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:47.903738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:47.903738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:47.903738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:47.903738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 381/751] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:47.903738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025e830-3a10-43a7-8e77-0f7893b720f5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:47.910309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cb88d-492f-4294-b0d1-fbf4b9bc11c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:47.912227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cb88d-492f-4294-b0d1-fbf4b9bc11c6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:47.930362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-650cb88d-492f-4294-b0d1-fbf4b9bc11c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:47.930362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:47.930362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:47.930362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:47.930362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:47.930362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:47.930362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:47.930362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:47.930362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:47.930362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:47.930362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:47.930362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:47.930362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:47.930362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:47.930362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:47.931543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:47.932815 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:47.932815 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:47.932815 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:47.932815 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:47.932815 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:47.932815 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:47.932815 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:47.932815 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:47.933789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 371/752] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:47.938591 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cb88d-492f-4294-b0d1-fbf4b9bc11c6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:47.957112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:47.966319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:48.043058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cb88d-492f-4294-b0d1-fbf4b9bc11c6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:48.045506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025e830-3a10-43a7-8e77-0f7893b720f5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:48.081763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b138d6-f71e-4714-8075-5979fabf8243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:48.082579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b138d6-f71e-4714-8075-5979fabf8243 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:48.082996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b138d6-f71e-4714-8075-5979fabf8243 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:48.083366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b138d6-f71e-4714-8075-5979fabf8243 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:48.084258 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b138d6-f71e-4714-8075-5979fabf8243 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:48.084567 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b138d6-f71e-4714-8075-5979fabf8243 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:48.086016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b138d6-f71e-4714-8075-5979fabf8243 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:48.098730 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9946c3b-f155-4c8e-87e4-d3df0853ad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:48.098730 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9946c3b-f155-4c8e-87e4-d3df0853ad1b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:48.098730 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9946c3b-f155-4c8e-87e4-d3df0853ad1b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:48.098730 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9946c3b-f155-4c8e-87e4-d3df0853ad1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:48.105481 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 372/753] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:48.106469 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b138d6-f71e-4714-8075-5979fabf8243 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:48.110020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9946c3b-f155-4c8e-87e4-d3df0853ad1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:48.112298 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9946c3b-f155-4c8e-87e4-d3df0853ad1b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:48.131226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c9946c3b-f155-4c8e-87e4-d3df0853ad1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:48.131226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:48.131226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:48.131226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:48.131226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:48.131226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:48.131226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:48.131226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:48.131226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:48.131226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:48.131226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:48.131226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:48.131226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:48.131226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:48.131226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:48.132338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:48.133765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:48.133765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:48.133765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:48.133765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:48.138880 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 382/754] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:48.138880 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9946c3b-f155-4c8e-87e4-d3df0853ad1b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:48.222321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:48.230876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:48.243144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b138d6-f71e-4714-8075-5979fabf8243 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:48.249734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9946c3b-f155-4c8e-87e4-d3df0853ad1b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:48.282419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c52a3a-a9a7-442e-bcbe-31a521741ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:48.287631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c52a3a-a9a7-442e-bcbe-31a521741ffa None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:48.287631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c52a3a-a9a7-442e-bcbe-31a521741ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:48.287631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c52a3a-a9a7-442e-bcbe-31a521741ffa None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:48.287631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c52a3a-a9a7-442e-bcbe-31a521741ffa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:48.287631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c52a3a-a9a7-442e-bcbe-31a521741ffa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:48.287631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c52a3a-a9a7-442e-bcbe-31a521741ffa None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:48.299717 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fead51d-680b-447b-8d96-4941d0afea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:48.300878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 373/755] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:48.301140 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fead51d-680b-447b-8d96-4941d0afea64 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:48.301615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fead51d-680b-447b-8d96-4941d0afea64 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:48.301811 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c52a3a-a9a7-442e-bcbe-31a521741ffa None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:48.302381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fead51d-680b-447b-8d96-4941d0afea64 None admin] PATH_INFO: `/v3/projects/50abbf0c38634795be669ec69da1f06d/users/e3fd38ebb5514af686204d0b02a91edd/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:48.304897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fead51d-680b-447b-8d96-4941d0afea64 None admin] RBAC: Authorizing `identity:create_grant(project_id=50abbf0c38634795be669ec69da1f06d, user_id=e3fd38ebb5514af686204d0b02a91edd, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:48.307507 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fead51d-680b-447b-8d96-4941d0afea64 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:48.398699 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 383/756] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:15:48 2022] PUT /identity/v3/projects/50abbf0c38634795be669ec69da1f06d/users/e3fd38ebb5514af686204d0b02a91edd/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:15:48.400044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fead51d-680b-447b-8d96-4941d0afea64 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:48.452476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c52a3a-a9a7-442e-bcbe-31a521741ffa None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:48.521668 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d439a47-24cd-42d0-b4f8-10e30e09c4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:48.522602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d439a47-24cd-42d0-b4f8-10e30e09c4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:48.523140 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d439a47-24cd-42d0-b4f8-10e30e09c4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:48.523562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d439a47-24cd-42d0-b4f8-10e30e09c4a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:48.526777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d439a47-24cd-42d0-b4f8-10e30e09c4a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:48.526777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d439a47-24cd-42d0-b4f8-10e30e09c4a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:48.526777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d439a47-24cd-42d0-b4f8-10e30e09c4a7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:48.540942 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 374/757] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:48.547175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d439a47-24cd-42d0-b4f8-10e30e09c4a7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:48.572695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:48.621565 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fead51d-680b-447b-8d96-4941d0afea64 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:48.665197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1c71d-5429-461d-9061-2fa6760c0209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:48.665945 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1c71d-5429-461d-9061-2fa6760c0209 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:48.666322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1c71d-5429-461d-9061-2fa6760c0209 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:48.666707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1c71d-5429-461d-9061-2fa6760c0209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:48.667778 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1c71d-5429-461d-9061-2fa6760c0209 None admin] RBAC: Adding query filter params (role.id=33cbf420a4284279a9010e820bcece79, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=391d83697b944e42b169e54535b7752f) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:48.668230 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1c71d-5429-461d-9061-2fa6760c0209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:48.669869 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1c71d-5429-461d-9061-2fa6760c0209 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:48.678501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 384/758] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:15:48 2022] GET /identity/v3/role_assignments?user.id=391d83697b944e42b169e54535b7752f&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=33cbf420a4284279a9010e820bcece79 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:48.686909 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d439a47-24cd-42d0-b4f8-10e30e09c4a7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:48.728008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601351a2-5802-4452-a2bb-74daaf395e0d None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:48.728297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601351a2-5802-4452-a2bb-74daaf395e0d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:48.728633 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601351a2-5802-4452-a2bb-74daaf395e0d None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:48.730302 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 385/759] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:15:48.731634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8e47e-39d7-4dc0-9f09-6787de13c5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:48.732313 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8e47e-39d7-4dc0-9f09-6787de13c5ed None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:48.732591 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8e47e-39d7-4dc0-9f09-6787de13c5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:48.732863 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8e47e-39d7-4dc0-9f09-6787de13c5ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:48.737628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49297c81-aae9-475b-aed1-944675df79ef None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:48.737947 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49297c81-aae9-475b-aed1-944675df79ef None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:48.738182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49297c81-aae9-475b-aed1-944675df79ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:48.741503 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8e47e-39d7-4dc0-9f09-6787de13c5ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:48.743120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8e47e-39d7-4dc0-9f09-6787de13c5ed None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:48.759630 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-49297c81-aae9-475b-aed1-944675df79ef None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-efb8e47e-39d7-4dc0-9f09-6787de13c5ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:48.760493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:48.761412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:48.762366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:48.762366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:48.762366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:48.762366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:48.762366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:48.762366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:48.762366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:48.762366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:48.762366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:15:48.762366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:48.762366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 375/760] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:15:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:48.764335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-49297c81-aae9-475b-aed1-944675df79ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:48.770755 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8e47e-39d7-4dc0-9f09-6787de13c5ed None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:48.779087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:48.857667 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 386/761] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:15:48.888670 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49297c81-aae9-475b-aed1-944675df79ef None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:48.911635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:48.957968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8e47e-39d7-4dc0-9f09-6787de13c5ed None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:49.008922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72226e53-b32a-41cc-911a-13d911bab1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:49.009703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72226e53-b32a-41cc-911a-13d911bab1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:49.009908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72226e53-b32a-41cc-911a-13d911bab1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:49.010183 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72226e53-b32a-41cc-911a-13d911bab1d8 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:49.011055 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72226e53-b32a-41cc-911a-13d911bab1d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:49.011360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72226e53-b32a-41cc-911a-13d911bab1d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:49.013095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72226e53-b32a-41cc-911a-13d911bab1d8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:49.038685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49297c81-aae9-475b-aed1-944675df79ef None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:49.053486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 376/762] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jul 20 19:15:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:49.054426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72226e53-b32a-41cc-911a-13d911bab1d8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:49.103472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b08628-470d-4e16-8578-1a11da9a9f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:49.104342 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b08628-470d-4e16-8578-1a11da9a9f1e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:49.104627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b08628-470d-4e16-8578-1a11da9a9f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:49.104901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b08628-470d-4e16-8578-1a11da9a9f1e None admin] PATH_INFO: `/v3/services/network` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:49.105573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b08628-470d-4e16-8578-1a11da9a9f1e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:49.107065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b08628-470d-4e16-8578-1a11da9a9f1e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-82b08628-470d-4e16-8578-1a11da9a9f1e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:49.124171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:49.125226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:49.126080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:49.126080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:49.126080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:49.126080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:49.126080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:49.126080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:49.126080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:49.126080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:49.126080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:49.126080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:49.126080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:15:49.126080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:49.126080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:15:49.126080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:49.130826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 387/763] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:48 2022] GET /identity/v3/services/network => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:49.139680 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b08628-470d-4e16-8578-1a11da9a9f1e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:49.163381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:49.175332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72226e53-b32a-41cc-911a-13d911bab1d8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:49.208425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:49.235708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e416da-ce33-4b3d-b483-e02d95126dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:49.236525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e416da-ce33-4b3d-b483-e02d95126dfb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:49.236970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e416da-ce33-4b3d-b483-e02d95126dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:49.237525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e416da-ce33-4b3d-b483-e02d95126dfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:49.323138 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e416da-ce33-4b3d-b483-e02d95126dfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:49.324743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e416da-ce33-4b3d-b483-e02d95126dfb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:49.385814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b08628-470d-4e16-8578-1a11da9a9f1e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:49.500531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 377/764] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:15:49.504103 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363afb28-d38f-46a3-b725-a6d79aaa4ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:49.505328 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363afb28-d38f-46a3-b725-a6d79aaa4ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:49.505980 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363afb28-d38f-46a3-b725-a6d79aaa4ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:49.507771 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e416da-ce33-4b3d-b483-e02d95126dfb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:49.512081 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363afb28-d38f-46a3-b725-a6d79aaa4ec1 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:49.513417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363afb28-d38f-46a3-b725-a6d79aaa4ec1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:49.513956 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363afb28-d38f-46a3-b725-a6d79aaa4ec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:49.522499 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363afb28-d38f-46a3-b725-a6d79aaa4ec1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:49.542211 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 388/765] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 20 19:15:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:49.548592 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363afb28-d38f-46a3-b725-a6d79aaa4ec1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:49.592883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:49.672700 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e416da-ce33-4b3d-b483-e02d95126dfb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:49.708612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90084-0f46-4d6d-b7c4-46b14d110749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:49.709466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90084-0f46-4d6d-b7c4-46b14d110749 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:49.709742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90084-0f46-4d6d-b7c4-46b14d110749 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:49.710006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90084-0f46-4d6d-b7c4-46b14d110749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:49.720364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b90084-0f46-4d6d-b7c4-46b14d110749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:49.721874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b90084-0f46-4d6d-b7c4-46b14d110749 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:49.741098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-25b90084-0f46-4d6d-b7c4-46b14d110749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:49.741098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:49.741098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:49.741098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:49.741098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:49.741098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:49.741098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:49.741098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:49.741098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:49.741098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:49.741098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:49.741098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:49.741098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:49.741098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:49.741098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:49.742036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:49.743016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:49.743016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:49.743016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:49.743016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:49.743016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 378/766] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:49.745562 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:49.748597 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90084-0f46-4d6d-b7c4-46b14d110749 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:49.832321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:49.840839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363afb28-d38f-46a3-b725-a6d79aaa4ec1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:49.858708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90084-0f46-4d6d-b7c4-46b14d110749 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:49.890870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf78e4a-18bf-452e-b9c7-8e03e3d74307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:49.891895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf78e4a-18bf-452e-b9c7-8e03e3d74307 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:49.892374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf78e4a-18bf-452e-b9c7-8e03e3d74307 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:49.892907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf78e4a-18bf-452e-b9c7-8e03e3d74307 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:49.893992 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf78e4a-18bf-452e-b9c7-8e03e3d74307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:49.894538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf78e4a-18bf-452e-b9c7-8e03e3d74307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:49.896209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf78e4a-18bf-452e-b9c7-8e03e3d74307 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:49.910294 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 379/767] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:49.916662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf78e4a-18bf-452e-b9c7-8e03e3d74307 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:49.930153 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba14fb-3abd-49fc-b07c-8e1a6cb6d48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:49.932263 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba14fb-3abd-49fc-b07c-8e1a6cb6d48b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:49.932561 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba14fb-3abd-49fc-b07c-8e1a6cb6d48b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:49.932836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba14fb-3abd-49fc-b07c-8e1a6cb6d48b None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:49.936910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba14fb-3abd-49fc-b07c-8e1a6cb6d48b None admin] RBAC: Adding query filter params (type=network) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:49.937259 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba14fb-3abd-49fc-b07c-8e1a6cb6d48b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:49.939203 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba14fb-3abd-49fc-b07c-8e1a6cb6d48b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:49.951675 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 389/768] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 20 19:15:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:49.957847 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba14fb-3abd-49fc-b07c-8e1a6cb6d48b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:50.110923 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf78e4a-18bf-452e-b9c7-8e03e3d74307 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:50.130951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba14fb-3abd-49fc-b07c-8e1a6cb6d48b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:50.147056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db410e0-f44b-409b-ae07-d80cbd9d3cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:50.147892 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db410e0-f44b-409b-ae07-d80cbd9d3cbf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:50.148201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db410e0-f44b-409b-ae07-d80cbd9d3cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:50.148482 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db410e0-f44b-409b-ae07-d80cbd9d3cbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:50.157273 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db410e0-f44b-409b-ae07-d80cbd9d3cbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:50.159636 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db410e0-f44b-409b-ae07-d80cbd9d3cbf None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:50.162230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:50.166196 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e56e5-3bd9-4168-8e53-40b54ddeb0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:50.167082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e56e5-3bd9-4168-8e53-40b54ddeb0ce None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:50.167533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e56e5-3bd9-4168-8e53-40b54ddeb0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:50.167949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e56e5-3bd9-4168-8e53-40b54ddeb0ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:50.168953 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e56e5-3bd9-4168-8e53-40b54ddeb0ce None admin] RBAC: Adding query filter params (interface=public, service_id=95cde93b05f744038450d819256ec3a3, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:50.169410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e56e5-3bd9-4168-8e53-40b54ddeb0ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:50.170945 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e56e5-3bd9-4168-8e53-40b54ddeb0ce None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:50.186970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:50.187095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7db410e0-f44b-409b-ae07-d80cbd9d3cbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:50.187095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:50.187095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:50.187095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:50.187095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:50.187095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:50.187095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:50.187095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:50.187095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:50.187095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:50.187095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:50.187095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:50.187095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:50.187095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:50.187095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:50.187922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:50.188819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:50.188819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:50.188819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:50.188819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:50.188819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:50.188819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:50.188819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:50.188819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:50.188819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 380/769] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:50.188819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06f8ca-b484-4a03-9948-8fc98b52950b None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:50.188819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06f8ca-b484-4a03-9948-8fc98b52950b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:50.189990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06f8ca-b484-4a03-9948-8fc98b52950b None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:50.189990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 381/771] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:50.189990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06f8ca-b484-4a03-9948-8fc98b52950b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:50.190556 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 390/771] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jul 20 19:15:49 2022] GET /identity/v3/endpoints?service_id=95cde93b05f744038450d819256ec3a3&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:50.191896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e56e5-3bd9-4168-8e53-40b54ddeb0ce None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:50.316145 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06f8ca-b484-4a03-9948-8fc98b52950b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:50.316955 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e56e5-3bd9-4168-8e53-40b54ddeb0ce None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:50.358948 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7e56f-e13f-4a04-b77e-6125774c5af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:50.360034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7e56f-e13f-4a04-b77e-6125774c5af6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:50.360531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7e56f-e13f-4a04-b77e-6125774c5af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:50.361661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7e56f-e13f-4a04-b77e-6125774c5af6 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:50.362811 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7e56f-e13f-4a04-b77e-6125774c5af6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:50.363263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7e56f-e13f-4a04-b77e-6125774c5af6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:50.364104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e13f8-5812-4170-9a9d-8dcdf637786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:50.365008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e13f8-5812-4170-9a9d-8dcdf637786f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:50.365310 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7e56f-e13f-4a04-b77e-6125774c5af6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:50.365436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e13f8-5812-4170-9a9d-8dcdf637786f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:50.365817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e13f8-5812-4170-9a9d-8dcdf637786f None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:50.366606 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e13f8-5812-4170-9a9d-8dcdf637786f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:50.368111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e13f8-5812-4170-9a9d-8dcdf637786f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:50.378983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 391/772] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 20 19:15:50 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:50.380620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed476f-9b0e-4e00-99bf-d423ccc8097c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:50.381009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed476f-9b0e-4e00-99bf-d423ccc8097c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:50.381397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed476f-9b0e-4e00-99bf-d423ccc8097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:50.381954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 382/773] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:50.388566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7e56f-e13f-4a04-b77e-6125774c5af6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:50.424534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-52ed476f-9b0e-4e00-99bf-d423ccc8097c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:50.425983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-52ed476f-9b0e-4e00-99bf-d423ccc8097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:50.459005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:50.510450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7e56f-e13f-4a04-b77e-6125774c5af6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:50.564130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:50.566570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0401e5-66cb-4658-bca6-0eb1994e6c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:50.567514 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0401e5-66cb-4658-bca6-0eb1994e6c1a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:50.567951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0401e5-66cb-4658-bca6-0eb1994e6c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:50.568383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0401e5-66cb-4658-bca6-0eb1994e6c1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:50.569385 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0401e5-66cb-4658-bca6-0eb1994e6c1a None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=fde62f4ce7af42eca1fe5a7b6807d1ae) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:50.569859 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0401e5-66cb-4658-bca6-0eb1994e6c1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:50.571766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0401e5-66cb-4658-bca6-0eb1994e6c1a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:50.582812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 383/774] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:15:50 2022] GET /identity/v3/role_assignments?user.id=fde62f4ce7af42eca1fe5a7b6807d1ae&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:50.591912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 392/775] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:15:50.618738 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0401e5-66cb-4658-bca6-0eb1994e6c1a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:50.737191 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0401e5-66cb-4658-bca6-0eb1994e6c1a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:50.767097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:50.776815 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba98f4c-f50b-479f-b4c9-d3ddc705d0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:50.778082 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98f4c-f50b-479f-b4c9-d3ddc705d0da None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:50.778082 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98f4c-f50b-479f-b4c9-d3ddc705d0da None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:50.778247 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98f4c-f50b-479f-b4c9-d3ddc705d0da None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:50.782351 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba98f4c-f50b-479f-b4c9-d3ddc705d0da None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:50.782351 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba98f4c-f50b-479f-b4c9-d3ddc705d0da None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-9ba98f4c-f50b-479f-b4c9-d3ddc705d0da None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:50.796227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:50.797233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:50.798080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 384/776] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jul 20 19:15:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:50.807794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed476f-9b0e-4e00-99bf-d423ccc8097c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:50.940954 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed476f-9b0e-4e00-99bf-d423ccc8097c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:50.996522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6c2b8-0ba8-4399-ad64-e52dbffc0420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:50.997140 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6c2b8-0ba8-4399-ad64-e52dbffc0420 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:50.997408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6c2b8-0ba8-4399-ad64-e52dbffc0420 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:50.997681 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6c2b8-0ba8-4399-ad64-e52dbffc0420 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:50.998401 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6c2b8-0ba8-4399-ad64-e52dbffc0420 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:50.998728 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6c2b8-0ba8-4399-ad64-e52dbffc0420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:51.000935 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6c2b8-0ba8-4399-ad64-e52dbffc0420 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:51.011095 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 393/777] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 20 19:15:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:51.015794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba98f4c-f50b-479f-b4c9-d3ddc705d0da None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:51.172969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc14a2-a44e-4c62-857c-ffc46423ce36 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:51.173451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc14a2-a44e-4c62-857c-ffc46423ce36 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:51.173961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc14a2-a44e-4c62-857c-ffc46423ce36 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:51.182699 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 394/778] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:15:51.185243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dd7cb-2332-45d7-a5bd-cf77cb94836c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:51.185726 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dd7cb-2332-45d7-a5bd-cf77cb94836c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:51.186196 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dd7cb-2332-45d7-a5bd-cf77cb94836c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:51.209831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-fd1dd7cb-2332-45d7-a5bd-cf77cb94836c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:51.211227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fd1dd7cb-2332-45d7-a5bd-cf77cb94836c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:51.272496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba98f4c-f50b-479f-b4c9-d3ddc705d0da None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:51.297832 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 395/779] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:15:51.300203 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5180aa-e542-48d6-9902-b7e93f3b8fd9 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:51.300492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5180aa-e542-48d6-9902-b7e93f3b8fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:51.300768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5180aa-e542-48d6-9902-b7e93f3b8fd9 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:51.307332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 396/780] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:51.307947 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:51.312390 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefd988-388c-4ae0-998b-85a6788322a2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:51.312692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefd988-388c-4ae0-998b-85a6788322a2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:51.312970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefd988-388c-4ae0-998b-85a6788322a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:51.341381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2eefd988-388c-4ae0-998b-85a6788322a2 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:51.343390 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2eefd988-388c-4ae0-998b-85a6788322a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:51.354165 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dc8fe-8f7b-43fd-b9bc-d88c8ec14e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:51.354911 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dc8fe-8f7b-43fd-b9bc-d88c8ec14e90 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:51.355187 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dc8fe-8f7b-43fd-b9bc-d88c8ec14e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:51.355458 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dc8fe-8f7b-43fd-b9bc-d88c8ec14e90 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:51.356163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dc8fe-8f7b-43fd-b9bc-d88c8ec14e90 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:51.356461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dc8fe-8f7b-43fd-b9bc-d88c8ec14e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:51.358051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dc8fe-8f7b-43fd-b9bc-d88c8ec14e90 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:51.365338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 385/781] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 20 19:15:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:51.366303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dc8fe-8f7b-43fd-b9bc-d88c8ec14e90 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:51.426309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:51.442360 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 397/782] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:15:51.450697 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefd988-388c-4ae0-998b-85a6788322a2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:51.494295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dc8fe-8f7b-43fd-b9bc-d88c8ec14e90 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:51.542644 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf826e2e-c35b-448f-b5da-fd24a69909b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:51.543846 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf826e2e-c35b-448f-b5da-fd24a69909b9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:51.544546 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf826e2e-c35b-448f-b5da-fd24a69909b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:51.544970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf826e2e-c35b-448f-b5da-fd24a69909b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:51.560592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf826e2e-c35b-448f-b5da-fd24a69909b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-cf826e2e-c35b-448f-b5da-fd24a69909b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:51.573235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:51.574437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:51.575513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:51.575513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:51.575513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:51.575513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:51.575513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:51.575513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:51.575513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:51.575513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:51.575513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:51.575513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:51.575513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:51.575513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:51.578172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 386/783] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:15:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:51.578527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefd988-388c-4ae0-998b-85a6788322a2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:51.579439 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf826e2e-c35b-448f-b5da-fd24a69909b9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:51.598208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:51.617989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245b717-94e4-4d9e-9310-2cc470ec2d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:51.618781 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245b717-94e4-4d9e-9310-2cc470ec2d1e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:51.619062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245b717-94e4-4d9e-9310-2cc470ec2d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:51.619374 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245b717-94e4-4d9e-9310-2cc470ec2d1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:51.620226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245b717-94e4-4d9e-9310-2cc470ec2d1e None admin] RBAC: Adding query filter params (interface=public, service_id=079a6a763f4f4be69d9ac07a10c21427, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:51.620470 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245b717-94e4-4d9e-9310-2cc470ec2d1e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:51.621873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245b717-94e4-4d9e-9310-2cc470ec2d1e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:51.627883 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 398/784] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jul 20 19:15:51 2022] GET /identity/v3/endpoints?service_id=079a6a763f4f4be69d9ac07a10c21427&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:51.628726 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245b717-94e4-4d9e-9310-2cc470ec2d1e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:51.707421 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf826e2e-c35b-448f-b5da-fd24a69909b9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:51.721276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:51.744561 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245b717-94e4-4d9e-9310-2cc470ec2d1e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:51.750484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b03d7-73bf-432a-a815-c66ec91865b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:51.751802 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b03d7-73bf-432a-a815-c66ec91865b1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:51.752508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b03d7-73bf-432a-a815-c66ec91865b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:51.752986 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b03d7-73bf-432a-a815-c66ec91865b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:51.764255 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b03d7-73bf-432a-a815-c66ec91865b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d64b03d7-73bf-432a-a815-c66ec91865b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:51.773445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:51.774445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:51.775325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:51.775325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:51.775325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:51.775325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:51.775325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:51.775325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:51.775325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:51.775325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:51.775325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:51.775325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:51.775325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:51.775325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:51.782601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 387/785] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:51.784661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b03d7-73bf-432a-a815-c66ec91865b1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:51.787436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad89fb9-5a06-43c4-9e4f-793a15558cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:51.788206 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad89fb9-5a06-43c4-9e4f-793a15558cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:51.788484 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad89fb9-5a06-43c4-9e4f-793a15558cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:51.788751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad89fb9-5a06-43c4-9e4f-793a15558cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:51.789618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad89fb9-5a06-43c4-9e4f-793a15558cb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:51.789921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad89fb9-5a06-43c4-9e4f-793a15558cb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:51.791722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad89fb9-5a06-43c4-9e4f-793a15558cb0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:51.801579 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 399/786] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:51.802551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad89fb9-5a06-43c4-9e4f-793a15558cb0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:51.853600 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:51.895738 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b03d7-73bf-432a-a815-c66ec91865b1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:51.918230 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad89fb9-5a06-43c4-9e4f-793a15558cb0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:51.932245 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68047bd3-e28a-4383-895d-09c31919b1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:51.933274 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68047bd3-e28a-4383-895d-09c31919b1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:51.933774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68047bd3-e28a-4383-895d-09c31919b1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:51.934521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68047bd3-e28a-4383-895d-09c31919b1b1 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:51.935436 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68047bd3-e28a-4383-895d-09c31919b1b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:51.937010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68047bd3-e28a-4383-895d-09c31919b1b1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:51.943059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 388/787] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 20 19:15:51 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:51.944191 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68047bd3-e28a-4383-895d-09c31919b1b1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:51.957380 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598acf87-8d4f-4a68-8126-dd200fddaf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:51.958064 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598acf87-8d4f-4a68-8126-dd200fddaf54 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:51.958301 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598acf87-8d4f-4a68-8126-dd200fddaf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:51.958577 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598acf87-8d4f-4a68-8126-dd200fddaf54 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:51.959399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598acf87-8d4f-4a68-8126-dd200fddaf54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:51.959700 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598acf87-8d4f-4a68-8126-dd200fddaf54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:51.961214 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598acf87-8d4f-4a68-8126-dd200fddaf54 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:51.971988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 400/788] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:51.977912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598acf87-8d4f-4a68-8126-dd200fddaf54 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:51.986002 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:52.098872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68047bd3-e28a-4383-895d-09c31919b1b1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:52.110454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598acf87-8d4f-4a68-8126-dd200fddaf54 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:52.113919 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:52.146921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b8210-76c1-4042-8050-4e981d0e8bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:52.148118 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b8210-76c1-4042-8050-4e981d0e8bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:52.148708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b8210-76c1-4042-8050-4e981d0e8bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:52.149254 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b8210-76c1-4042-8050-4e981d0e8bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:52.152686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2230-0205-4c2e-a43c-f92ce12d269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:52.153424 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2230-0205-4c2e-a43c-f92ce12d269c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:52.153766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2230-0205-4c2e-a43c-f92ce12d269c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:52.154105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2230-0205-4c2e-a43c-f92ce12d269c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:52.162254 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b8210-76c1-4042-8050-4e981d0e8bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:52.163993 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b8210-76c1-4042-8050-4e981d0e8bb1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:52.167734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b2230-0205-4c2e-a43c-f92ce12d269c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:52.169282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b2230-0205-4c2e-a43c-f92ce12d269c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:52.183024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e96b8210-76c1-4042-8050-4e981d0e8bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:52.183024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:52.183024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:52.183024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:52.183024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:52.183024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:52.183024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:52.183024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:52.183024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:52.183024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:52.183024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:52.183024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:52.183024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:52.183024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:52.183024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:52.184215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:52.185252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:52.185252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:52.185252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:52.185252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:52.187636 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 389/789] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:52.191195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-888b2230-0205-4c2e-a43c-f92ce12d269c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:52.191195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:52.191195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:52.191195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:52.191195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:52.191195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:52.191195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:52.191195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:52.191195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:52.191195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:52.191195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:52.191195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:52.191195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:52.191195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:52.191195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:52.192353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:52.193518 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:52.193518 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:52.193518 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:52.193518 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:52.193518 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 401/790] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:52.195016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b8210-76c1-4042-8050-4e981d0e8bb1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:52.198777 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2230-0205-4c2e-a43c-f92ce12d269c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:52.304384 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:52.325185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2230-0205-4c2e-a43c-f92ce12d269c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:52.325960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b8210-76c1-4042-8050-4e981d0e8bb1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:52.365583 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474888c9-c6e6-49b9-83c7-dfe6ccdf14f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:52.366711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474888c9-c6e6-49b9-83c7-dfe6ccdf14f4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:52.367199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474888c9-c6e6-49b9-83c7-dfe6ccdf14f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:52.367657 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474888c9-c6e6-49b9-83c7-dfe6ccdf14f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:52.368759 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474888c9-c6e6-49b9-83c7-dfe6ccdf14f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:52.369189 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474888c9-c6e6-49b9-83c7-dfe6ccdf14f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:52.369720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f019e0c-d598-487c-84a0-26f6a407f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:52.370535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f019e0c-d598-487c-84a0-26f6a407f953 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:52.371053 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f019e0c-d598-487c-84a0-26f6a407f953 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:52.371183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474888c9-c6e6-49b9-83c7-dfe6ccdf14f4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:52.371589 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f019e0c-d598-487c-84a0-26f6a407f953 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:52.372453 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f019e0c-d598-487c-84a0-26f6a407f953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:52.372907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f019e0c-d598-487c-84a0-26f6a407f953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:52.374771 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f019e0c-d598-487c-84a0-26f6a407f953 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:52.388936 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 402/791] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:52.397263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 390/792] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:52.398293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474888c9-c6e6-49b9-83c7-dfe6ccdf14f4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:52.402152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f019e0c-d598-487c-84a0-26f6a407f953 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:52.449735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:52.532584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f019e0c-d598-487c-84a0-26f6a407f953 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:52.576388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfa43b-cf3b-4556-a6fe-f3fb916504bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:52.577588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfa43b-cf3b-4556-a6fe-f3fb916504bd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:52.578123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfa43b-cf3b-4556-a6fe-f3fb916504bd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:52.578630 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfa43b-cf3b-4556-a6fe-f3fb916504bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:52.587859 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfa43b-cf3b-4556-a6fe-f3fb916504bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:52.589896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfa43b-cf3b-4556-a6fe-f3fb916504bd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4bbfa43b-cf3b-4556-a6fe-f3fb916504bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:52.608522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:52.609509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:52.610520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:52.610520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:52.610520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:52.610520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:52.610520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:52.610520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:52.610520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:52.610520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:52.610520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:15:52.610520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:52.614424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 391/793] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jul 20 19:15:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:52.623360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfa43b-cf3b-4556-a6fe-f3fb916504bd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:52.636865 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:52.640458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474888c9-c6e6-49b9-83c7-dfe6ccdf14f4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:52.680054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddbf9f-12f8-45af-9a72-19f6fa46a87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:52.680881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddbf9f-12f8-45af-9a72-19f6fa46a87c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:52.681163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddbf9f-12f8-45af-9a72-19f6fa46a87c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:52.681440 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddbf9f-12f8-45af-9a72-19f6fa46a87c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:52.690276 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddbf9f-12f8-45af-9a72-19f6fa46a87c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:52.691849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddbf9f-12f8-45af-9a72-19f6fa46a87c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-5eddbf9f-12f8-45af-9a72-19f6fa46a87c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:52.708811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:52.709807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:52.710761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:52.710761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:52.710761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:52.710761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:52.710761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:52.710761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:52.710761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:52.710761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:52.710761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:15:52.710761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:52.710761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 403/794] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jul 20 19:15:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:52.717567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddbf9f-12f8-45af-9a72-19f6fa46a87c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:52.801402 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfa43b-cf3b-4556-a6fe-f3fb916504bd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:52.859408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:52.867659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dd5bd-c9fb-4b0a-b460-ece09c4e42ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:52.868342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dd5bd-c9fb-4b0a-b460-ece09c4e42ee None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:52.868623 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dd5bd-c9fb-4b0a-b460-ece09c4e42ee None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:52.868897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dd5bd-c9fb-4b0a-b460-ece09c4e42ee None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:52.869741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dd5bd-c9fb-4b0a-b460-ece09c4e42ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:52.870047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dd5bd-c9fb-4b0a-b460-ece09c4e42ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:52.871548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dd5bd-c9fb-4b0a-b460-ece09c4e42ee None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:52.890745 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddbf9f-12f8-45af-9a72-19f6fa46a87c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:52.896974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 392/795] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 20 19:15:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:52.898321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33988417-b0ad-404b-b956-d09d5f4a7e39 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:52.903018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33988417-b0ad-404b-b956-d09d5f4a7e39 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:52.903336 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33988417-b0ad-404b-b956-d09d5f4a7e39 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:52.905173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 393/796] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:52.905988 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33988417-b0ad-404b-b956-d09d5f4a7e39 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:52.930194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959706e-d9d7-4167-bfb0-280bfdc9613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:52.930927 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959706e-d9d7-4167-bfb0-280bfdc9613d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:52.931211 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959706e-d9d7-4167-bfb0-280bfdc9613d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:52.931588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959706e-d9d7-4167-bfb0-280bfdc9613d None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:52.932543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959706e-d9d7-4167-bfb0-280bfdc9613d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:52.932857 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959706e-d9d7-4167-bfb0-280bfdc9613d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:52.934752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959706e-d9d7-4167-bfb0-280bfdc9613d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:52.956731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 404/797] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jul 20 19:15:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:52.958204 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6b70-e7c1-469c-bdab-502f7235f0f8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:52.958757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6b70-e7c1-469c-bdab-502f7235f0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:52.958833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6b70-e7c1-469c-bdab-502f7235f0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:52.973023 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:52.978322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ab3f6b70-e7c1-469c-bdab-502f7235f0f8 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:52.979740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ab3f6b70-e7c1-469c-bdab-502f7235f0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:53.014052 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33988417-b0ad-404b-b956-d09d5f4a7e39 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:53.056505 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 405/798] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:15:53.057703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6b70-e7c1-469c-bdab-502f7235f0f8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:53.058080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87995d8b-cb37-4d2b-a64a-70cd6c982b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:53.058762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87995d8b-cb37-4d2b-a64a-70cd6c982b1e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:53.059305 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87995d8b-cb37-4d2b-a64a-70cd6c982b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:53.059579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87995d8b-cb37-4d2b-a64a-70cd6c982b1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:53.133622 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:53.156079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87995d8b-cb37-4d2b-a64a-70cd6c982b1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:53.158496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87995d8b-cb37-4d2b-a64a-70cd6c982b1e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:53.179052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6b70-e7c1-469c-bdab-502f7235f0f8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:53.219828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f629673-65d5-4ac1-af4a-617182618210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:53.221408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f629673-65d5-4ac1-af4a-617182618210 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:53.222001 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f629673-65d5-4ac1-af4a-617182618210 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:53.222560 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f629673-65d5-4ac1-af4a-617182618210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:53.233882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f629673-65d5-4ac1-af4a-617182618210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:53.235573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f629673-65d5-4ac1-af4a-617182618210 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:53.240963 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:53.258743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2f629673-65d5-4ac1-af4a-617182618210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:53.258743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:53.258743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:53.258743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:53.258743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:53.258743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:53.258743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:53.258743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:53.258743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:53.258743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:53.258743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:53.258743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:53.258743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:53.258743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:53.258743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:53.260444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:53.261358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:53.261358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:53.261358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:53.261358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:53.261358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 406/799] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:53.261358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f629673-65d5-4ac1-af4a-617182618210 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:53.294288 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 394/800] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:15:53.295619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87995d8b-cb37-4d2b-a64a-70cd6c982b1e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:53.390362 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f629673-65d5-4ac1-af4a-617182618210 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:53.409312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87995d8b-cb37-4d2b-a64a-70cd6c982b1e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:53.410186 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:53.429977 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c303887-556d-4b49-9049-1c62d8fb40f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:53.430819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c303887-556d-4b49-9049-1c62d8fb40f5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:53.431104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c303887-556d-4b49-9049-1c62d8fb40f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:53.431375 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c303887-556d-4b49-9049-1c62d8fb40f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:53.443610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c303887-556d-4b49-9049-1c62d8fb40f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:53.450845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664fdbf-2e9d-4135-9c65-6791e5a4b37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:53.451508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664fdbf-2e9d-4135-9c65-6791e5a4b37c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:53.451806 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664fdbf-2e9d-4135-9c65-6791e5a4b37c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:53.452050 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664fdbf-2e9d-4135-9c65-6791e5a4b37c None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1c303887-556d-4b49-9049-1c62d8fb40f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:53.452399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:53.453545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:53.454611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:53.454611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:53.454611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:53.454611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:53.454611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:53.454611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:53.454611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:53.454611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:53.454611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:53.454611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:53.454611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:53.454611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:53.455440 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664fdbf-2e9d-4135-9c65-6791e5a4b37c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:53.455440 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664fdbf-2e9d-4135-9c65-6791e5a4b37c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:53.455440 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664fdbf-2e9d-4135-9c65-6791e5a4b37c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:53.463212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 407/801] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:15:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:53.464638 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e08fff-c732-4e04-8ee5-8f86469c2602 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:53.464920 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e08fff-c732-4e04-8ee5-8f86469c2602 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:53.465657 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e08fff-c732-4e04-8ee5-8f86469c2602 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:53.466654 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 408/802] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:53.467362 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e08fff-c732-4e04-8ee5-8f86469c2602 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:53.473702 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 395/803] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:53.474900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664fdbf-2e9d-4135-9c65-6791e5a4b37c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:53.503875 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:53.580177 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664fdbf-2e9d-4135-9c65-6791e5a4b37c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:53.584258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e08fff-c732-4e04-8ee5-8f86469c2602 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:53.616980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8cdbe-6791-45a7-8d3b-5cd3ef95202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:53.617819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8cdbe-6791-45a7-8d3b-5cd3ef95202e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:53.618209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8cdbe-6791-45a7-8d3b-5cd3ef95202e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:53.618586 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8cdbe-6791-45a7-8d3b-5cd3ef95202e None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:53.619463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8cdbe-6791-45a7-8d3b-5cd3ef95202e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:53.619974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8cdbe-6791-45a7-8d3b-5cd3ef95202e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:53.621439 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8cdbe-6791-45a7-8d3b-5cd3ef95202e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:53.623080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c29e8-ed9b-4eeb-bc2c-af6f43069b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:53.623872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c29e8-ed9b-4eeb-bc2c-af6f43069b35 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:53.624156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c29e8-ed9b-4eeb-bc2c-af6f43069b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:53.624425 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c29e8-ed9b-4eeb-bc2c-af6f43069b35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:53.635392 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 396/804] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:53.635392 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8434511-ad3b-4150-b8b1-5a6a8c3eb128 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:53.635392 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8434511-ad3b-4150-b8b1-5a6a8c3eb128 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:53.635392 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8434511-ad3b-4150-b8b1-5a6a8c3eb128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:53.641094 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c29e8-ed9b-4eeb-bc2c-af6f43069b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:53.643556 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c29e8-ed9b-4eeb-bc2c-af6f43069b35 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:53.651494 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f8434511-ad3b-4150-b8b1-5a6a8c3eb128 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:53.653340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f8434511-ad3b-4150-b8b1-5a6a8c3eb128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:53.670210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c48c29e8-ed9b-4eeb-bc2c-af6f43069b35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:53.670210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:53.670210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:53.670210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:53.670210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:53.670210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:53.670210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:53.670210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:53.670210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:53.670210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:53.670210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:53.670210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:53.670210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:53.670210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:53.670210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:53.671267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:53.672178 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:53.672178 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:53.672178 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:53.672178 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:53.672178 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 409/805] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:53.673303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c29e8-ed9b-4eeb-bc2c-af6f43069b35 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:53.746698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 397/806] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:15:53.746698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8434511-ad3b-4150-b8b1-5a6a8c3eb128 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:53.768668 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:53.821104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:53.857962 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8434511-ad3b-4150-b8b1-5a6a8c3eb128 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:53.897832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26cdf2-81cb-4a74-a49d-d43ab807d0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:53.898643 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26cdf2-81cb-4a74-a49d-d43ab807d0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:53.898828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c29e8-ed9b-4eeb-bc2c-af6f43069b35 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:53.898941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26cdf2-81cb-4a74-a49d-d43ab807d0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:53.899206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26cdf2-81cb-4a74-a49d-d43ab807d0f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:53.910929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26cdf2-81cb-4a74-a49d-d43ab807d0f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:53.912379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26cdf2-81cb-4a74-a49d-d43ab807d0f8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:53.930912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7a26cdf2-81cb-4a74-a49d-d43ab807d0f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:53.930912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:53.930912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:53.930912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:53.930912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:53.930912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:53.930912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:53.930912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:53.930912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:53.930912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:53.930912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:53.930912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:53.930912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:53.930912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:53.930912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:53.931856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:53.932756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:53.932756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:53.932756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:53.932756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:53.936926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 398/807] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:53.937801 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef65fd-04f0-4162-8745-daec86475cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:53.938104 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26cdf2-81cb-4a74-a49d-d43ab807d0f8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:53.938595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef65fd-04f0-4162-8745-daec86475cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:53.938959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef65fd-04f0-4162-8745-daec86475cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:53.939280 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef65fd-04f0-4162-8745-daec86475cf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:53.946584 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef65fd-04f0-4162-8745-daec86475cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:53.948080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef65fd-04f0-4162-8745-daec86475cf8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:53.962882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-6cef65fd-04f0-4162-8745-daec86475cf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:53.962882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:53.962882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:53.962882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:53.962882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:53.962882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:53.962882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:53.962882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:53.962882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:53.962882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:53.962882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:53.962882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:53.962882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:53.962882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:53.962882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:53.964770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:53.965814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:53.965814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:53.965814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:53.965814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:53.965814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:53.965814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:53.965814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:53.965814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:53.965814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 410/808] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:53.965814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef65fd-04f0-4162-8745-daec86475cf8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:54.015071 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:54.051109 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26cdf2-81cb-4a74-a49d-d43ab807d0f8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:54.066690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:54.079349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef65fd-04f0-4162-8745-daec86475cf8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:54.091262 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54bbea-9abd-4889-a892-2cfb06afcb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:54.091926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54bbea-9abd-4889-a892-2cfb06afcb0f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:54.092222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54bbea-9abd-4889-a892-2cfb06afcb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:54.092476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54bbea-9abd-4889-a892-2cfb06afcb0f None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:54.093253 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54bbea-9abd-4889-a892-2cfb06afcb0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:54.093558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54bbea-9abd-4889-a892-2cfb06afcb0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:54.094961 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54bbea-9abd-4889-a892-2cfb06afcb0f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:54.112029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 399/809] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:54.112029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54bbea-9abd-4889-a892-2cfb06afcb0f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:54.122059 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213beaa-450d-40f9-b245-707586cb1477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:54.122873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213beaa-450d-40f9-b245-707586cb1477 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:54.123306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213beaa-450d-40f9-b245-707586cb1477 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:54.123532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213beaa-450d-40f9-b245-707586cb1477 None admin] PATH_INFO: `/v3/services/network` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:54.124173 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213beaa-450d-40f9-b245-707586cb1477 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:54.125572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213beaa-450d-40f9-b245-707586cb1477 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4213beaa-450d-40f9-b245-707586cb1477 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:54.139370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:54.140482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:54.141339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:54.141339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:54.141339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:54.141339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:54.141339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:54.141339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:54.141339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:54.141339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:54.141339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:54.141339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:54.141339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:15:54.141339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:54.141339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:15:54.141339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:54.141339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 411/810] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:53 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:54.142790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213beaa-450d-40f9-b245-707586cb1477 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:54.230155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54bbea-9abd-4889-a892-2cfb06afcb0f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:54.256911 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213beaa-450d-40f9-b245-707586cb1477 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:54.258416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:54.266909 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b73de-1a7c-4a97-bcb2-d688893e07fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:54.268693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b73de-1a7c-4a97-bcb2-d688893e07fd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:54.268969 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b73de-1a7c-4a97-bcb2-d688893e07fd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:54.272123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b73de-1a7c-4a97-bcb2-d688893e07fd None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:54.272123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b73de-1a7c-4a97-bcb2-d688893e07fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:54.272123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b73de-1a7c-4a97-bcb2-d688893e07fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:54.272123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b73de-1a7c-4a97-bcb2-d688893e07fd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:54.285695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 400/811] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:54.285695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b73de-1a7c-4a97-bcb2-d688893e07fd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:54.303598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aee259-57ed-494e-a868-b46695bafa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:54.304264 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aee259-57ed-494e-a868-b46695bafa12 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:54.304542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aee259-57ed-494e-a868-b46695bafa12 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:54.304814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aee259-57ed-494e-a868-b46695bafa12 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:54.305617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aee259-57ed-494e-a868-b46695bafa12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:54.305924 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aee259-57ed-494e-a868-b46695bafa12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:54.307408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aee259-57ed-494e-a868-b46695bafa12 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:54.322022 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 412/812] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:54.323269 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aee259-57ed-494e-a868-b46695bafa12 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:54.339854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:54.402821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b73de-1a7c-4a97-bcb2-d688893e07fd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:54.428301 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aee259-57ed-494e-a868-b46695bafa12 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:54.437474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884e366-cf9b-4d8c-87ff-9ecb2ed5dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:54.438269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e366-cf9b-4d8c-87ff-9ecb2ed5dffb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:54.438546 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e366-cf9b-4d8c-87ff-9ecb2ed5dffb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:54.439482 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e366-cf9b-4d8c-87ff-9ecb2ed5dffb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:54.446180 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884e366-cf9b-4d8c-87ff-9ecb2ed5dffb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:54.447650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884e366-cf9b-4d8c-87ff-9ecb2ed5dffb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:54.462159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5884e366-cf9b-4d8c-87ff-9ecb2ed5dffb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:54.462159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:54.462159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:54.462159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:54.462159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:54.462159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:54.462159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:54.462159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:54.462159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:54.462159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:54.462159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:54.462159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:54.462159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:54.462159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:54.462159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:54.463112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:54.464016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:54.464016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:54.464016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:54.464016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:54.464016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:54.464016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:54.464016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:54.464016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:54.464016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 401/813] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:54.464503 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884e366-cf9b-4d8c-87ff-9ecb2ed5dffb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:54.468750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737123d-5898-4cf7-987f-7069ea8128f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:54.469428 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737123d-5898-4cf7-987f-7069ea8128f3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:54.469719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737123d-5898-4cf7-987f-7069ea8128f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:54.470023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737123d-5898-4cf7-987f-7069ea8128f3 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:54.470988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737123d-5898-4cf7-987f-7069ea8128f3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:54.471275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737123d-5898-4cf7-987f-7069ea8128f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:54.472672 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737123d-5898-4cf7-987f-7069ea8128f3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:54.477387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 413/814] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 20 19:15:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:54.478142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737123d-5898-4cf7-987f-7069ea8128f3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:54.530075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:54.556370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:54.574072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884e366-cf9b-4d8c-87ff-9ecb2ed5dffb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:54.578457 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737123d-5898-4cf7-987f-7069ea8128f3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:54.608513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eba7b0-ab41-428a-9cbf-c33acbcbb180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:54.609309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eba7b0-ab41-428a-9cbf-c33acbcbb180 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:54.609592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eba7b0-ab41-428a-9cbf-c33acbcbb180 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:54.609866 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eba7b0-ab41-428a-9cbf-c33acbcbb180 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:54.612967 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782360f-accb-4803-95d8-5d0892dba49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:54.613853 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782360f-accb-4803-95d8-5d0892dba49a None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:54.614128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782360f-accb-4803-95d8-5d0892dba49a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:54.614394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782360f-accb-4803-95d8-5d0892dba49a None admin] PATH_INFO: `/v3/projects/50abbf0c38634795be669ec69da1f06d/users/391d83697b944e42b169e54535b7752f/roles/33cbf420a4284279a9010e820bcece79` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:54.618909 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eba7b0-ab41-428a-9cbf-c33acbcbb180 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:54.620355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eba7b0-ab41-428a-9cbf-c33acbcbb180 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:54.629813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782360f-accb-4803-95d8-5d0892dba49a None admin] RBAC: Authorizing `identity:create_grant(project_id=50abbf0c38634795be669ec69da1f06d, user_id=391d83697b944e42b169e54535b7752f, role_id=33cbf420a4284279a9010e820bcece79)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:54.631300 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782360f-accb-4803-95d8-5d0892dba49a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-63eba7b0-ab41-428a-9cbf-c33acbcbb180 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:54.634983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:54.636056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:54.637194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:54.637194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:54.637194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:54.637194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:54.637194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:54.637194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:54.637194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:54.637194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:54.637194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:15:54.637194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:54.637194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 402/815] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:15:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:54.638011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51201f0-704b-43ab-8a2e-23a2d13877c1 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:54.638011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51201f0-704b-43ab-8a2e-23a2d13877c1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:54.638011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51201f0-704b-43ab-8a2e-23a2d13877c1 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:54.639296 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 403/816] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:54.640311 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51201f0-704b-43ab-8a2e-23a2d13877c1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:54.692836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 414/817] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:15:54 2022] PUT /identity/v3/projects/50abbf0c38634795be669ec69da1f06d/users/391d83697b944e42b169e54535b7752f/roles/33cbf420a4284279a9010e820bcece79 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:15:54.693667 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782360f-accb-4803-95d8-5d0892dba49a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:54.766817 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51201f0-704b-43ab-8a2e-23a2d13877c1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:54.781960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:54.814101 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0dbcc-8974-42d9-a9ec-ffdfd4cb04c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:54.815086 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0dbcc-8974-42d9-a9ec-ffdfd4cb04c6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:54.815518 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0dbcc-8974-42d9-a9ec-ffdfd4cb04c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:54.815978 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0dbcc-8974-42d9-a9ec-ffdfd4cb04c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:54.816800 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0dbcc-8974-42d9-a9ec-ffdfd4cb04c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:54.817103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0dbcc-8974-42d9-a9ec-ffdfd4cb04c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:54.818695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0dbcc-8974-42d9-a9ec-ffdfd4cb04c6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:54.819045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782360f-accb-4803-95d8-5d0892dba49a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:54.836849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 404/818] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:54.837897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0dbcc-8974-42d9-a9ec-ffdfd4cb04c6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:54.855976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:54.866639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860d6ef-b8e7-48a1-80cc-be80b834f9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:54.867466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860d6ef-b8e7-48a1-80cc-be80b834f9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:54.867809 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860d6ef-b8e7-48a1-80cc-be80b834f9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:54.868147 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860d6ef-b8e7-48a1-80cc-be80b834f9d4 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:54.869452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860d6ef-b8e7-48a1-80cc-be80b834f9d4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:54.869855 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860d6ef-b8e7-48a1-80cc-be80b834f9d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:54.871586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860d6ef-b8e7-48a1-80cc-be80b834f9d4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:54.883052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 415/819] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 20 19:15:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:54.884532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345667-d9c5-4cb1-a81f-55452eadc740 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:54.884957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345667-d9c5-4cb1-a81f-55452eadc740 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:54.885550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345667-d9c5-4cb1-a81f-55452eadc740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:54.905640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d3345667-d9c5-4cb1-a81f-55452eadc740 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:54.911335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d3345667-d9c5-4cb1-a81f-55452eadc740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:54.972473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0dbcc-8974-42d9-a9ec-ffdfd4cb04c6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:54.981306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 416/820] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:15:54.982156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3345667-d9c5-4cb1-a81f-55452eadc740 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:55.019683 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e83b09-3e67-41ae-9ef3-374b00466bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:55.020359 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e83b09-3e67-41ae-9ef3-374b00466bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:55.020635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e83b09-3e67-41ae-9ef3-374b00466bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:55.020905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e83b09-3e67-41ae-9ef3-374b00466bd5 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:55.021745 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e83b09-3e67-41ae-9ef3-374b00466bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:55.022129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e83b09-3e67-41ae-9ef3-374b00466bd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:55.023616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e83b09-3e67-41ae-9ef3-374b00466bd5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:55.047197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 405/821] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jul 20 19:15:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:55.047197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e83b09-3e67-41ae-9ef3-374b00466bd5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:55.073695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:55.096608 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3345667-d9c5-4cb1-a81f-55452eadc740 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:55.117561 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:55.132251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340010e3-85d7-49df-a52e-4e5ac7a3e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:55.132897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340010e3-85d7-49df-a52e-4e5ac7a3e18e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:55.133168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340010e3-85d7-49df-a52e-4e5ac7a3e18e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:55.133433 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340010e3-85d7-49df-a52e-4e5ac7a3e18e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:55.134250 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340010e3-85d7-49df-a52e-4e5ac7a3e18e None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=e3fd38ebb5514af686204d0b02a91edd) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:55.134561 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340010e3-85d7-49df-a52e-4e5ac7a3e18e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:55.136042 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340010e3-85d7-49df-a52e-4e5ac7a3e18e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:55.146996 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 417/822] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:15:54 2022] GET /identity/v3/role_assignments?user.id=e3fd38ebb5514af686204d0b02a91edd&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:55.147769 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340010e3-85d7-49df-a52e-4e5ac7a3e18e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:55.151803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e83b09-3e67-41ae-9ef3-374b00466bd5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:55.198266 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7f378-9683-41c6-a7ce-91d45ae6d12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:55.199270 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7f378-9683-41c6-a7ce-91d45ae6d12b None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:55.200509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7f378-9683-41c6-a7ce-91d45ae6d12b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:55.200509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7f378-9683-41c6-a7ce-91d45ae6d12b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:55.201047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7f378-9683-41c6-a7ce-91d45ae6d12b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:55.202588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7f378-9683-41c6-a7ce-91d45ae6d12b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:55.280633 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340010e3-85d7-49df-a52e-4e5ac7a3e18e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:55.302881 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 406/823] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 20 19:15:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:15:55.304887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7f378-9683-41c6-a7ce-91d45ae6d12b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:55.339708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604db145-43fd-475f-b85f-241fc35d47a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:55.340528 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604db145-43fd-475f-b85f-241fc35d47a0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:55.340806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604db145-43fd-475f-b85f-241fc35d47a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:55.341073 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604db145-43fd-475f-b85f-241fc35d47a0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:55.341728 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604db145-43fd-475f-b85f-241fc35d47a0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:55.343695 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604db145-43fd-475f-b85f-241fc35d47a0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-604db145-43fd-475f-b85f-241fc35d47a0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:55.357808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:55.358917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:55.359804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:55.359804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:55.359804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:55.359804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:55.359804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:55.359804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:55.359804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:55.359804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:55.359804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:55.359804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:55.359804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:55.359804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:15:55.359804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:55.359804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:15:55.359804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:55.360725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 418/824] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jul 20 19:15:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:55.367398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604db145-43fd-475f-b85f-241fc35d47a0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:55.427665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:55.437600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:55.464442 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7f378-9683-41c6-a7ce-91d45ae6d12b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:55.497219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604db145-43fd-475f-b85f-241fc35d47a0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:55.515238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645336b6-0c3e-4631-a9e7-0c9c48b50cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:55.516466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645336b6-0c3e-4631-a9e7-0c9c48b50cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:55.516966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645336b6-0c3e-4631-a9e7-0c9c48b50cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:55.517442 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645336b6-0c3e-4631-a9e7-0c9c48b50cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:55.531633 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645336b6-0c3e-4631-a9e7-0c9c48b50cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:55.533688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645336b6-0c3e-4631-a9e7-0c9c48b50cd5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:55.545921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753687b-2141-4152-a62e-97d506397d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:55.546601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753687b-2141-4152-a62e-97d506397d9e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:55.546913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753687b-2141-4152-a62e-97d506397d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:55.554361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753687b-2141-4152-a62e-97d506397d9e None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:55.554361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753687b-2141-4152-a62e-97d506397d9e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:55.554361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753687b-2141-4152-a62e-97d506397d9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:55.554361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753687b-2141-4152-a62e-97d506397d9e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:55.555651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 419/825] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 20 19:15:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:55.559991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-645336b6-0c3e-4631-a9e7-0c9c48b50cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:55.559991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:55.559991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:55.559991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:55.559991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:55.559991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:55.559991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:55.559991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:55.559991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:55.559991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:55.559991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:55.559991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:55.559991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:55.559991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:55.559991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:55.561201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:55.562319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:55.562319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:55.562319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:55.562319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:55.562319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 407/826] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:55.562658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753687b-2141-4152-a62e-97d506397d9e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:55.568234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645336b6-0c3e-4631-a9e7-0c9c48b50cd5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:55.690167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645336b6-0c3e-4631-a9e7-0c9c48b50cd5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:55.697616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753687b-2141-4152-a62e-97d506397d9e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:55.709439 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:55.733306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3236a39-2e96-458d-85b0-8fb733e5da5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:55.733976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3236a39-2e96-458d-85b0-8fb733e5da5f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:55.734257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3236a39-2e96-458d-85b0-8fb733e5da5f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:55.734536 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3236a39-2e96-458d-85b0-8fb733e5da5f None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:55.735287 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3236a39-2e96-458d-85b0-8fb733e5da5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:55.736130 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3236a39-2e96-458d-85b0-8fb733e5da5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:55.737578 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3236a39-2e96-458d-85b0-8fb733e5da5f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:55.743011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045b3a-66cb-4a1c-9524-4f9902340810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:55.743931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045b3a-66cb-4a1c-9524-4f9902340810 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:55.744404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045b3a-66cb-4a1c-9524-4f9902340810 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:55.745324 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045b3a-66cb-4a1c-9524-4f9902340810 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:55.746259 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25045b3a-66cb-4a1c-9524-4f9902340810 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:55.747012 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:55.747362 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25045b3a-66cb-4a1c-9524-4f9902340810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:55.749194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25045b3a-66cb-4a1c-9524-4f9902340810 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:55.750772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 408/827] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:55.758798 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 420/828] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jul 20 19:15:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:55.760922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3236a39-2e96-458d-85b0-8fb733e5da5f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:55.763132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045b3a-66cb-4a1c-9524-4f9902340810 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:55.870075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045b3a-66cb-4a1c-9524-4f9902340810 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:55.875216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3236a39-2e96-458d-85b0-8fb733e5da5f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:55.913866 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504af1f2-05e2-41c7-ae75-8e7a6fe061b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:55.914751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504af1f2-05e2-41c7-ae75-8e7a6fe061b0 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:55.915041 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504af1f2-05e2-41c7-ae75-8e7a6fe061b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:55.915410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504af1f2-05e2-41c7-ae75-8e7a6fe061b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:55.916200 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504af1f2-05e2-41c7-ae75-8e7a6fe061b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:55.917925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504af1f2-05e2-41c7-ae75-8e7a6fe061b0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:55.918931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23f2f8-151b-4588-9367-27dba06124b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:55.919800 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23f2f8-151b-4588-9367-27dba06124b4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:55.920088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23f2f8-151b-4588-9367-27dba06124b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:55.920360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23f2f8-151b-4588-9367-27dba06124b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:55.928791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23f2f8-151b-4588-9367-27dba06124b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:55.931162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23f2f8-151b-4588-9367-27dba06124b4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:55.947238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-cf23f2f8-151b-4588-9367-27dba06124b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:55.947238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:55.947238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:55.947238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:55.947238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:55.947238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:55.947238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:55.947238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:55.947238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:55.947238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:55.947238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:55.947238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:55.947238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:55.947238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:55.947238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:55.950076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:55.951028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:55.951028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:55.951028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:55.951028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:55.951028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:55.951028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:55.951028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:55.951028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:55.951028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 409/829] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:55.955485 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23f2f8-151b-4588-9367-27dba06124b4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:56.015020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 421/830] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 20 19:15:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:15:56.022235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:56.078951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23f2f8-151b-4588-9367-27dba06124b4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:56.137293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a34ed-7d31-45b9-89cf-b2dcdbcfa09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:56.138331 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a34ed-7d31-45b9-89cf-b2dcdbcfa09f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:56.138903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a34ed-7d31-45b9-89cf-b2dcdbcfa09f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:56.139388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a34ed-7d31-45b9-89cf-b2dcdbcfa09f None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:56.140482 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a34ed-7d31-45b9-89cf-b2dcdbcfa09f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:56.141012 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a34ed-7d31-45b9-89cf-b2dcdbcfa09f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:56.143427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a34ed-7d31-45b9-89cf-b2dcdbcfa09f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:56.159239 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 410/831] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:56.167829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504af1f2-05e2-41c7-ae75-8e7a6fe061b0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:56.203335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:56.275338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504af1f2-05e2-41c7-ae75-8e7a6fe061b0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:56.316286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5679d14-6b23-4cb9-9a2e-5593a59aa271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:56.317464 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5679d14-6b23-4cb9-9a2e-5593a59aa271 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:56.317943 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5679d14-6b23-4cb9-9a2e-5593a59aa271 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:56.318369 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5679d14-6b23-4cb9-9a2e-5593a59aa271 None admin] PATH_INFO: `/v3/projects/50abbf0c38634795be669ec69da1f06d/users/fde62f4ce7af42eca1fe5a7b6807d1ae/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:56.320569 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5679d14-6b23-4cb9-9a2e-5593a59aa271 None admin] RBAC: Authorizing `identity:create_grant(project_id=50abbf0c38634795be669ec69da1f06d, user_id=fde62f4ce7af42eca1fe5a7b6807d1ae, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:56.322159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5679d14-6b23-4cb9-9a2e-5593a59aa271 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:56.391918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 422/832] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:15:56 2022] PUT /identity/v3/projects/50abbf0c38634795be669ec69da1f06d/users/fde62f4ce7af42eca1fe5a7b6807d1ae/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:15:56.910552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749e538-484c-4b4a-bd80-0fd1c387f672 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:56.911155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749e538-484c-4b4a-bd80-0fd1c387f672 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:56.911155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749e538-484c-4b4a-bd80-0fd1c387f672 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:56.912743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 411/833] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:56.918359 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0c538-43d0-482f-8742-13a8f753d770 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:56.918653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0c538-43d0-482f-8742-13a8f753d770 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:56.918962 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0c538-43d0-482f-8742-13a8f753d770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:56.937076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-86f0c538-43d0-482f-8742-13a8f753d770 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:56.938262 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-86f0c538-43d0-482f-8742-13a8f753d770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:57.014785 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 423/834] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:15:57.031700 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749e538-484c-4b4a-bd80-0fd1c387f672 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:57.140918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749e538-484c-4b4a-bd80-0fd1c387f672 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:57.153322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:57.179402 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2db8b2-a185-417b-b0c3-24fbde2d45b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:57.180116 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2db8b2-a185-417b-b0c3-24fbde2d45b6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:57.180446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2db8b2-a185-417b-b0c3-24fbde2d45b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:57.180715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2db8b2-a185-417b-b0c3-24fbde2d45b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:57.192786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2db8b2-a185-417b-b0c3-24fbde2d45b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7f2db8b2-a185-417b-b0c3-24fbde2d45b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:57.200887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:57.201919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:57.202797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:57.202797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:57.202797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:57.202797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:57.202797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:57.202797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:57.202797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:57.202797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:57.202797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:57.202797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:57.202797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:15:57.202797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:57.206047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 412/835] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:15:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:57.209561 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0c538-43d0-482f-8742-13a8f753d770 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:57.229805 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:57.321043 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0c538-43d0-482f-8742-13a8f753d770 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:57.357424 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a78521-8931-4791-a198-cfb744083893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:57.358098 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a78521-8931-4791-a198-cfb744083893 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:57.358377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a78521-8931-4791-a198-cfb744083893 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:57.358647 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a78521-8931-4791-a198-cfb744083893 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:57.359434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a78521-8931-4791-a198-cfb744083893 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:57.359736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a78521-8931-4791-a198-cfb744083893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:57.361745 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a78521-8931-4791-a198-cfb744083893 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:57.371148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 424/836] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:15:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:57.376693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2db8b2-a185-417b-b0c3-24fbde2d45b6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:57.491743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2db8b2-a185-417b-b0c3-24fbde2d45b6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:57.522149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb08d2-8ada-4c87-b29d-7651686f89d7 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:57.522149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb08d2-8ada-4c87-b29d-7651686f89d7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:57.522149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb08d2-8ada-4c87-b29d-7651686f89d7 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:57.523650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 425/837] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:15:57.528727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99beb14e-bc01-463c-a485-17143269e5b2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:57.529011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99beb14e-bc01-463c-a485-17143269e5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:57.529268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b90055-cecc-4942-b1a3-73d6fed0a273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:57.529412 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99beb14e-bc01-463c-a485-17143269e5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:57.530413 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b90055-cecc-4942-b1a3-73d6fed0a273 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:57.531032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b90055-cecc-4942-b1a3-73d6fed0a273 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:57.531589 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b90055-cecc-4942-b1a3-73d6fed0a273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:57.544408 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b90055-cecc-4942-b1a3-73d6fed0a273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:57.546411 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b90055-cecc-4942-b1a3-73d6fed0a273 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:57.546633 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-99beb14e-bc01-463c-a485-17143269e5b2 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:57.548816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-99beb14e-bc01-463c-a485-17143269e5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:57.566572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-68b90055-cecc-4942-b1a3-73d6fed0a273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:57.566572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:57.566572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:57.566572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:57.566572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:57.566572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:57.566572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:57.566572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:57.566572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:57.566572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:57.566572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:57.566572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:57.566572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:57.566572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:57.566572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:57.567583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:57.568552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:57.568552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:57.568552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:57.568552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:57.570607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 413/838] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:57.578739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b90055-cecc-4942-b1a3-73d6fed0a273 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:57.615361 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:57.634391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 426/839] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:15:57.660069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99beb14e-bc01-463c-a485-17143269e5b2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:57.674929 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:57.721540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b90055-cecc-4942-b1a3-73d6fed0a273 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:57.777920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c408bf9-d95d-4e3e-a348-51dc7196702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:57.778967 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c408bf9-d95d-4e3e-a348-51dc7196702e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:57.780040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c408bf9-d95d-4e3e-a348-51dc7196702e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:57.780677 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c408bf9-d95d-4e3e-a348-51dc7196702e None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:57.781693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c408bf9-d95d-4e3e-a348-51dc7196702e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:57.783347 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c408bf9-d95d-4e3e-a348-51dc7196702e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:57.785430 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c408bf9-d95d-4e3e-a348-51dc7196702e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:57.803601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 414/840] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:57.809116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99beb14e-bc01-463c-a485-17143269e5b2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:57.812421 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c408bf9-d95d-4e3e-a348-51dc7196702e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:57.857542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9130019-2272-4e95-a2a5-c2a4d89b21d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:57.858762 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9130019-2272-4e95-a2a5-c2a4d89b21d3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:57.859270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9130019-2272-4e95-a2a5-c2a4d89b21d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:57.859762 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9130019-2272-4e95-a2a5-c2a4d89b21d3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:57.860850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9130019-2272-4e95-a2a5-c2a4d89b21d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:57.863145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9130019-2272-4e95-a2a5-c2a4d89b21d3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a9130019-2272-4e95-a2a5-c2a4d89b21d3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:57.884294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:57.885476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:57.886714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:57.886714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:57.886714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:57.886714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:57.886714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:57.886714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:57.886714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:57.886714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:57.886714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:57.886714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:57.886714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:57.886714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:15:57.886714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:57.886714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:15:57.886714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:57.891010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 427/841] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jul 20 19:15:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:57.896170 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9130019-2272-4e95-a2a5-c2a4d89b21d3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:57.927475 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:57.949258 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c408bf9-d95d-4e3e-a348-51dc7196702e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:57.987491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f445e1-fde4-466c-8ae9-376c1a7daebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:57.988563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f445e1-fde4-466c-8ae9-376c1a7daebf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:57.988989 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f445e1-fde4-466c-8ae9-376c1a7daebf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:57.989401 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f445e1-fde4-466c-8ae9-376c1a7daebf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:57.997324 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:57.997599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f445e1-fde4-466c-8ae9-376c1a7daebf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:57.999669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f445e1-fde4-466c-8ae9-376c1a7daebf None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:58.027806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9130019-2272-4e95-a2a5-c2a4d89b21d3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:58.068926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946b50a-beff-4fe1-93ad-d424f05fe130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:58.069679 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946b50a-beff-4fe1-93ad-d424f05fe130 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:58.070061 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946b50a-beff-4fe1-93ad-d424f05fe130 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:58.070436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946b50a-beff-4fe1-93ad-d424f05fe130 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:58.071449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946b50a-beff-4fe1-93ad-d424f05fe130 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:58.071872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946b50a-beff-4fe1-93ad-d424f05fe130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:58.073654 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946b50a-beff-4fe1-93ad-d424f05fe130 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:58.082713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 428/842] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 20 19:15:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:58.085792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946b50a-beff-4fe1-93ad-d424f05fe130 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a6f445e1-fde4-466c-8ae9-376c1a7daebf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:58.145824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:58.146941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:58.147900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:58.147900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:58.147900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:58.147900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:58.147900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:58.147900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:58.147900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:58.147900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:58.147900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:15:58.147900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:58.151298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 415/843] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jul 20 19:15:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:58.153362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f445e1-fde4-466c-8ae9-376c1a7daebf None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:58.215015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946b50a-beff-4fe1-93ad-d424f05fe130 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:58.253052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8796a44-6487-46e9-bf3e-f14436943aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:58.253717 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8796a44-6487-46e9-bf3e-f14436943aaa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:58.253995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8796a44-6487-46e9-bf3e-f14436943aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:58.254267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8796a44-6487-46e9-bf3e-f14436943aaa None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:58.255162 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8796a44-6487-46e9-bf3e-f14436943aaa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:58.255512 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8796a44-6487-46e9-bf3e-f14436943aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:58.256876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8796a44-6487-46e9-bf3e-f14436943aaa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:58.261921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 429/844] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 20 19:15:58 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:58.263311 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a4c69-0bdb-4dcb-a3b1-29ea555d0541 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:58.263593 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a4c69-0bdb-4dcb-a3b1-29ea555d0541 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:58.263861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a4c69-0bdb-4dcb-a3b1-29ea555d0541 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:58.265415 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 430/845] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:58.270422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f445e1-fde4-466c-8ae9-376c1a7daebf None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:58.285102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27486a-2ced-41b9-a853-43351c57adce None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:58.285428 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27486a-2ced-41b9-a853-43351c57adce None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:58.285885 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27486a-2ced-41b9-a853-43351c57adce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:58.303225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:58.306529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7e27486a-2ced-41b9-a853-43351c57adce None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:58.307766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7e27486a-2ced-41b9-a853-43351c57adce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:58.325351 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03c4c7-1acb-4c91-ae4c-5a7fe451b195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:58.326471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c4c7-1acb-4c91-ae4c-5a7fe451b195 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:58.326880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c4c7-1acb-4c91-ae4c-5a7fe451b195 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:58.327254 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c4c7-1acb-4c91-ae4c-5a7fe451b195 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:58.328765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03c4c7-1acb-4c91-ae4c-5a7fe451b195 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:58.329263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03c4c7-1acb-4c91-ae4c-5a7fe451b195 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:58.330958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03c4c7-1acb-4c91-ae4c-5a7fe451b195 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:58.352517 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:58.361617 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 416/846] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jul 20 19:15:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:58.367569 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03c4c7-1acb-4c91-ae4c-5a7fe451b195 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:58.397829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 431/847] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:15:58.420555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27486a-2ced-41b9-a853-43351c57adce None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:58.484235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03c4c7-1acb-4c91-ae4c-5a7fe451b195 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:58.523570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f12f78-d53e-41ad-9287-b94746e4afc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:58.527113 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f12f78-d53e-41ad-9287-b94746e4afc7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:58.527113 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f12f78-d53e-41ad-9287-b94746e4afc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:58.527113 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f12f78-d53e-41ad-9287-b94746e4afc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:58.530063 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27486a-2ced-41b9-a853-43351c57adce None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:58.561620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:58.567579 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45249e6b-564b-47ff-98d7-250ee348d83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:58.568278 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45249e6b-564b-47ff-98d7-250ee348d83e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:58.568560 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45249e6b-564b-47ff-98d7-250ee348d83e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:58.568833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45249e6b-564b-47ff-98d7-250ee348d83e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:58.569495 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45249e6b-564b-47ff-98d7-250ee348d83e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:58.571105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45249e6b-564b-47ff-98d7-250ee348d83e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-45249e6b-564b-47ff-98d7-250ee348d83e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:58.590292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:58.591502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:58.592332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:58.592332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:58.592332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:58.592332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:58.592332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:58.592332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:58.592332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:58.592332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:58.592332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:58.592332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:58.592332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:15:58.592332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:15:58.592332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:15:58.592332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:58.592332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 432/848] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:15:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:58.593129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45249e6b-564b-47ff-98d7-250ee348d83e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:58.604998 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:58.608302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f12f78-d53e-41ad-9287-b94746e4afc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:58.609967 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f12f78-d53e-41ad-9287-b94746e4afc7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:58.697987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45249e6b-564b-47ff-98d7-250ee348d83e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:58.729706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 417/849] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:15:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:15:58.731164 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70763-2df3-4693-9770-8ae3edec3f94 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:58.731450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70763-2df3-4693-9770-8ae3edec3f94 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:58.731728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70763-2df3-4693-9770-8ae3edec3f94 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:58.732357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbbe05-132b-4d3a-9020-0ca2dfaa97aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:58.733025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbbe05-132b-4d3a-9020-0ca2dfaa97aa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:58.734984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 418/850] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:58.735065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbbe05-132b-4d3a-9020-0ca2dfaa97aa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:58.735065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbbe05-132b-4d3a-9020-0ca2dfaa97aa None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:58.735750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e70763-2df3-4693-9770-8ae3edec3f94 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:58.735824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbbe05-132b-4d3a-9020-0ca2dfaa97aa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:58.735824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbbe05-132b-4d3a-9020-0ca2dfaa97aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:58.736663 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbbe05-132b-4d3a-9020-0ca2dfaa97aa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:58.742202 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 433/851] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:15:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:58.743463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2c7db-86e2-4b0c-a4ec-3a1250e65db0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:58.743746 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2c7db-86e2-4b0c-a4ec-3a1250e65db0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:58.744018 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2c7db-86e2-4b0c-a4ec-3a1250e65db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:58.763677 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b3e2c7db-86e2-4b0c-a4ec-3a1250e65db0 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:58.764867 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b3e2c7db-86e2-4b0c-a4ec-3a1250e65db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:58.826110 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:58.836886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 434/852] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:15:58.842194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2c7db-86e2-4b0c-a4ec-3a1250e65db0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:58.858601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:58.864551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e70763-2df3-4693-9770-8ae3edec3f94 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:58.901688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8de3b9-177a-471e-8362-c9b3c6cddfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:58.902833 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8de3b9-177a-471e-8362-c9b3c6cddfbb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:58.903108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8de3b9-177a-471e-8362-c9b3c6cddfbb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:58.903375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8de3b9-177a-471e-8362-c9b3c6cddfbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:58.914562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8de3b9-177a-471e-8362-c9b3c6cddfbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:58.916014 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8de3b9-177a-471e-8362-c9b3c6cddfbb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:58.936038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-0e8de3b9-177a-471e-8362-c9b3c6cddfbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:58.936038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:58.936038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:58.936038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:58.936038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:58.936038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:58.936038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:58.936038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:58.936038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:58.936038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:58.936038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:58.936038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:58.936038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:58.936038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:58.936038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:58.937535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:58.938502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:58.938502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:58.938502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:58.938502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:58.938502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 419/853] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:58.938502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8de3b9-177a-471e-8362-c9b3c6cddfbb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:58.976305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2c7db-86e2-4b0c-a4ec-3a1250e65db0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:59.015475 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ec908-7cd5-403e-95e6-17f5e6102b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:59.016691 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ec908-7cd5-403e-95e6-17f5e6102b6c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:59.016691 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ec908-7cd5-403e-95e6-17f5e6102b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:59.016691 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ec908-7cd5-403e-95e6-17f5e6102b6c None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:59.017375 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ec908-7cd5-403e-95e6-17f5e6102b6c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:59.017671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ec908-7cd5-403e-95e6-17f5e6102b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:59.019088 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ec908-7cd5-403e-95e6-17f5e6102b6c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:59.024111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 435/854] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:15:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:59.024814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ec908-7cd5-403e-95e6-17f5e6102b6c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:59.063430 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8de3b9-177a-471e-8362-c9b3c6cddfbb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:59.105769 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:59.117526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeab03f-b6cc-457a-90df-23086b9abb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:59.118339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeab03f-b6cc-457a-90df-23086b9abb11 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:59.122357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeab03f-b6cc-457a-90df-23086b9abb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:59.122357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeab03f-b6cc-457a-90df-23086b9abb11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:59.139023 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeab03f-b6cc-457a-90df-23086b9abb11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-ddeab03f-b6cc-457a-90df-23086b9abb11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:15:59.150169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:59.151422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:59.152277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:59.152277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:59.152277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:59.152277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:59.152277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:15:59.152277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:15:59.152277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:15:59.152277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:15:59.152277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:15:59.152277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:15:59.152277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:15:59.152277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:59.152277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 420/855] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:59.158414 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeab03f-b6cc-457a-90df-23086b9abb11 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:59.161814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ec908-7cd5-403e-95e6-17f5e6102b6c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:59.176046 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:59.221166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2b582-496a-4e6d-9c9d-addbcf1e17ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:59.221866 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2b582-496a-4e6d-9c9d-addbcf1e17ca None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:59.222101 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2b582-496a-4e6d-9c9d-addbcf1e17ca None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:59.222369 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2b582-496a-4e6d-9c9d-addbcf1e17ca None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:59.223161 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2b582-496a-4e6d-9c9d-addbcf1e17ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:59.223464 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2b582-496a-4e6d-9c9d-addbcf1e17ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:59.224841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2b582-496a-4e6d-9c9d-addbcf1e17ca None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:59.242007 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 436/856] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:59.247897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2b582-496a-4e6d-9c9d-addbcf1e17ca None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:59.293668 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeab03f-b6cc-457a-90df-23086b9abb11 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:59.331266 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db7abe-c535-4d6d-9ca8-530c3d44146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:59.332159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db7abe-c535-4d6d-9ca8-530c3d44146f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:59.332530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db7abe-c535-4d6d-9ca8-530c3d44146f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:59.332899 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db7abe-c535-4d6d-9ca8-530c3d44146f None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:59.333757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db7abe-c535-4d6d-9ca8-530c3d44146f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:59.334161 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db7abe-c535-4d6d-9ca8-530c3d44146f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:59.335619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db7abe-c535-4d6d-9ca8-530c3d44146f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:59.345535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 421/857] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:15:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:59.355697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db7abe-c535-4d6d-9ca8-530c3d44146f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:59.381845 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2b582-496a-4e6d-9c9d-addbcf1e17ca None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:59.402055 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:59.428191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509048b-70e7-4896-8008-cd74e4f3f9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:59.429249 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509048b-70e7-4896-8008-cd74e4f3f9ab None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:59.429534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509048b-70e7-4896-8008-cd74e4f3f9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:59.429810 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509048b-70e7-4896-8008-cd74e4f3f9ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:59.439359 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509048b-70e7-4896-8008-cd74e4f3f9ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:59.441839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509048b-70e7-4896-8008-cd74e4f3f9ab None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:59.452027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:59.462786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c509048b-70e7-4896-8008-cd74e4f3f9ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:59.462786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:59.462786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:59.462786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:59.462786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:59.462786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:59.462786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:59.462786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:59.462786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:59.462786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:59.462786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:59.462786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:59.462786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:15:59.462786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:15:59.462786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:59.463959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:59.464912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:15:59.464912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:15:59.464912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:15:59.464912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:15:59.464912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:15:59.464912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:15:59.464912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:15:59.464912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:15:59.464912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 437/858] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:15:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:59.470933 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509048b-70e7-4896-8008-cd74e4f3f9ab None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:59.489939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db7abe-c535-4d6d-9ca8-530c3d44146f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:59.537901 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5f7fd-0f2c-475f-837a-f6192e061074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:59.538883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5f7fd-0f2c-475f-837a-f6192e061074 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:59.539296 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5f7fd-0f2c-475f-837a-f6192e061074 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:59.539558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5f7fd-0f2c-475f-837a-f6192e061074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:59.551686 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5f7fd-0f2c-475f-837a-f6192e061074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:59.553286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5f7fd-0f2c-475f-837a-f6192e061074 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:59.573346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7ce5f7fd-0f2c-475f-837a-f6192e061074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:59.573346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:59.573346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:59.573346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:59.573346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:59.573346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:59.573346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:59.573346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:59.573346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:59.573346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:59.573346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:59.573346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:59.573346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:15:59.573346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:15:59.573346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:59.574326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:59.575244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:15:59.575244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:15:59.575244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:15:59.575244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:59.579785 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 422/859] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:15:59.581488 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5f7fd-0f2c-475f-837a-f6192e061074 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:59.608449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509048b-70e7-4896-8008-cd74e4f3f9ab None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:59.657435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27585871-db39-4595-855d-6b4adc6d9fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:59.658657 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27585871-db39-4595-855d-6b4adc6d9fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:59.659548 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27585871-db39-4595-855d-6b4adc6d9fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:59.660275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27585871-db39-4595-855d-6b4adc6d9fe7 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:59.661482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27585871-db39-4595-855d-6b4adc6d9fe7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:59.662356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27585871-db39-4595-855d-6b4adc6d9fe7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:59.664280 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27585871-db39-4595-855d-6b4adc6d9fe7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:59.681585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 438/860] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:15:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:15:59.691712 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27585871-db39-4595-855d-6b4adc6d9fe7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:59.706232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5f7fd-0f2c-475f-837a-f6192e061074 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:59.739902 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:59.744678 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:59.754635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac0a05-f352-47ce-b5ba-7835f96fd589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:59.755016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac0a05-f352-47ce-b5ba-7835f96fd589 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:59.755308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac0a05-f352-47ce-b5ba-7835f96fd589 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:59.755586 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac0a05-f352-47ce-b5ba-7835f96fd589 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:59.756319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac0a05-f352-47ce-b5ba-7835f96fd589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:59.756621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac0a05-f352-47ce-b5ba-7835f96fd589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:59.758006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac0a05-f352-47ce-b5ba-7835f96fd589 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:59.773464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 423/861] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:59.779048 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac0a05-f352-47ce-b5ba-7835f96fd589 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:59.822833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27585871-db39-4595-855d-6b4adc6d9fe7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:59.859350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5449e1b-d7cd-4a75-be1e-86a8711c74e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:59.860038 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5449e1b-d7cd-4a75-be1e-86a8711c74e6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:59.860540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5449e1b-d7cd-4a75-be1e-86a8711c74e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:59.861032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5449e1b-d7cd-4a75-be1e-86a8711c74e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:59.862093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5449e1b-d7cd-4a75-be1e-86a8711c74e6 None admin] RBAC: Adding query filter params (role.id=33cbf420a4284279a9010e820bcece79, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=391d83697b944e42b169e54535b7752f) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:15:59.862356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5449e1b-d7cd-4a75-be1e-86a8711c74e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:59.863851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5449e1b-d7cd-4a75-be1e-86a8711c74e6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:59.874881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 439/862] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:15:59 2022] GET /identity/v3/role_assignments?user.id=391d83697b944e42b169e54535b7752f&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=33cbf420a4284279a9010e820bcece79 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:15:59.909419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac0a05-f352-47ce-b5ba-7835f96fd589 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:59.955332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4286c40-1177-4e9c-b827-a6ec5ca40cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:59.957046 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4286c40-1177-4e9c-b827-a6ec5ca40cce None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:59.957553 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4286c40-1177-4e9c-b827-a6ec5ca40cce None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:59.958038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4286c40-1177-4e9c-b827-a6ec5ca40cce None admin] PATH_INFO: `/v3/users/swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:59.967163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4286c40-1177-4e9c-b827-a6ec5ca40cce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:59.969021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4286c40-1177-4e9c-b827-a6ec5ca40cce None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e4286c40-1177-4e9c-b827-a6ec5ca40cce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:15:59.986119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:15:59.987158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:15:59.988105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:15:59.988105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:15:59.988105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:15:59.988105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:15:59.988105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:15:59.988105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:15:59.988105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:15:59.988105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:15:59.988105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:15:59.988105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:15:59.995018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 424/863] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:15:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:15:59.999827 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5449e1b-d7cd-4a75-be1e-86a8711c74e6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:00.108489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:00.113334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5449e1b-d7cd-4a75-be1e-86a8711c74e6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:00.151528 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fb9a0-abcb-4e70-8cca-733703781877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:00.152202 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fb9a0-abcb-4e70-8cca-733703781877 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:00.152479 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fb9a0-abcb-4e70-8cca-733703781877 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:00.152749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fb9a0-abcb-4e70-8cca-733703781877 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:00.153596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fb9a0-abcb-4e70-8cca-733703781877 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:00.153902 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fb9a0-abcb-4e70-8cca-733703781877 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:00.156322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fb9a0-abcb-4e70-8cca-733703781877 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:00.175657 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 440/864] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jul 20 19:15:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:00.181543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4286c40-1177-4e9c-b827-a6ec5ca40cce None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:00.236418 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:00.301207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4286c40-1177-4e9c-b827-a6ec5ca40cce None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:00.337753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7e916-2507-4737-8248-fbd4be2c6d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:00.338822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7e916-2507-4737-8248-fbd4be2c6d8f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:00.339330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7e916-2507-4737-8248-fbd4be2c6d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:00.339808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7e916-2507-4737-8248-fbd4be2c6d8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:00.416633 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7e916-2507-4737-8248-fbd4be2c6d8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:00.418649 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7e916-2507-4737-8248-fbd4be2c6d8f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:00.443661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f32d3-27bf-4142-b17c-d8eb9d3f2da0 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:00.444294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f32d3-27bf-4142-b17c-d8eb9d3f2da0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:00.444294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f32d3-27bf-4142-b17c-d8eb9d3f2da0 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:00.449496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 441/865] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:00.451280 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf3ce6-13e3-4d2b-a17b-a94ff63d7940 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:00.451560 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf3ce6-13e3-4d2b-a17b-a94ff63d7940 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:00.451831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf3ce6-13e3-4d2b-a17b-a94ff63d7940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:00.470063 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5bbf3ce6-13e3-4d2b-a17b-a94ff63d7940 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:00.471584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:00.472954 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5bbf3ce6-13e3-4d2b-a17b-a94ff63d7940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:00.539831 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 425/866] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:16:00 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:00.549510 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7e916-2507-4737-8248-fbd4be2c6d8f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:00.567810 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 442/867] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:00.590815 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf3ce6-13e3-4d2b-a17b-a94ff63d7940 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:00.674198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7e916-2507-4737-8248-fbd4be2c6d8f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:00.691626 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:00.714045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf3ce6-13e3-4d2b-a17b-a94ff63d7940 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:00.721695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe5637-7bc9-4a2d-b4ac-f32994798248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:00.722455 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe5637-7bc9-4a2d-b4ac-f32994798248 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:00.722771 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe5637-7bc9-4a2d-b4ac-f32994798248 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:00.723039 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe5637-7bc9-4a2d-b4ac-f32994798248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:00.734408 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe5637-7bc9-4a2d-b4ac-f32994798248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:00.736522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe5637-7bc9-4a2d-b4ac-f32994798248 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:00.744608 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:00.753392 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e0976-7845-4729-9382-e79cb36712aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:00.754280 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e0976-7845-4729-9382-e79cb36712aa None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:00.754721 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e0976-7845-4729-9382-e79cb36712aa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:00.762866 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e0976-7845-4729-9382-e79cb36712aa None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:00.762866 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e0976-7845-4729-9382-e79cb36712aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:00.763062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5ffe5637-7bc9-4a2d-b4ac-f32994798248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:00.763062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:00.763062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:00.763062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:00.763062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:00.763062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:00.763062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:00.763062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:00.763062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:00.763062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:00.763062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:00.763062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:00.763062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:16:00.763062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:16:00.763062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:00.763855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:00.764738 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:16:00.764738 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:16:00.764738 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:00.764738 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:00.764954 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e0976-7845-4729-9382-e79cb36712aa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:00.765022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 426/868] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:00.765022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe5637-7bc9-4a2d-b4ac-f32994798248 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:00.846710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 443/869] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 20 19:16:00 2022] POST /identity/v3/services => generated 269 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:16:00.904034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe5637-7bc9-4a2d-b4ac-f32994798248 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:00.951830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d2ec2-4e3c-48fd-935b-c1e8c81caa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:00.952499 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d2ec2-4e3c-48fd-935b-c1e8c81caa5b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:00.952772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d2ec2-4e3c-48fd-935b-c1e8c81caa5b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:00.953040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d2ec2-4e3c-48fd-935b-c1e8c81caa5b None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:00.954399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d2ec2-4e3c-48fd-935b-c1e8c81caa5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:00.954950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d2ec2-4e3c-48fd-935b-c1e8c81caa5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:00.956972 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d2ec2-4e3c-48fd-935b-c1e8c81caa5b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:00.971651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 427/870] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:00.977036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e0976-7845-4729-9382-e79cb36712aa None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:01.094155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e0976-7845-4729-9382-e79cb36712aa None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:01.132212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3816e74-9e64-48e0-801d-7ffe8e9e7046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:01.133030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3816e74-9e64-48e0-801d-7ffe8e9e7046 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:01.133308 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3816e74-9e64-48e0-801d-7ffe8e9e7046 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:01.133579 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3816e74-9e64-48e0-801d-7ffe8e9e7046 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:01.141886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3816e74-9e64-48e0-801d-7ffe8e9e7046 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:01.143439 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3816e74-9e64-48e0-801d-7ffe8e9e7046 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:01.158918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c3816e74-9e64-48e0-801d-7ffe8e9e7046 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:01.158918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:01.158918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:01.158918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:01.158918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:01.158918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:01.158918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:01.158918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:01.158918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:01.158918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:01.158918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:01.158918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:01.158918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:16:01.158918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:16:01.158918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:01.159876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:01.160772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:16:01.160772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:16:01.160772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:16:01.160772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:16:01.160772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:16:01.160772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:16:01.160772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:01.160772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:01.160772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 444/871] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:16:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:16:01.167870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d2ec2-4e3c-48fd-935b-c1e8c81caa5b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:01.232072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:01.232240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20928ef2-fe87-4aa5-bb3c-8c3a55735339 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:01.232460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20928ef2-fe87-4aa5-bb3c-8c3a55735339 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:01.232659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20928ef2-fe87-4aa5-bb3c-8c3a55735339 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:01.234297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 445/872] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:01.240749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ade0a-efa2-41a9-8e9f-e42d3a03829b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:01.241045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ade0a-efa2-41a9-8e9f-e42d3a03829b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:01.241302 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ade0a-efa2-41a9-8e9f-e42d3a03829b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:01.259499 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:01.266550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d22ade0a-efa2-41a9-8e9f-e42d3a03829b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:01.268558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d22ade0a-efa2-41a9-8e9f-e42d3a03829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:01.282637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d2ec2-4e3c-48fd-935b-c1e8c81caa5b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:01.320535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b391c9f-8328-4c7c-8aad-744261d25214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:01.321204 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b391c9f-8328-4c7c-8aad-744261d25214 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:01.321502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b391c9f-8328-4c7c-8aad-744261d25214 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:01.321899 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b391c9f-8328-4c7c-8aad-744261d25214 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:01.322724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b391c9f-8328-4c7c-8aad-744261d25214 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:01.323256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b391c9f-8328-4c7c-8aad-744261d25214 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:01.326520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b391c9f-8328-4c7c-8aad-744261d25214 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:01.338735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 428/873] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:16:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:01.344703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b391c9f-8328-4c7c-8aad-744261d25214 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:01.378492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 446/874] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:01 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:01.398958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ade0a-efa2-41a9-8e9f-e42d3a03829b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:01.465553 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b391c9f-8328-4c7c-8aad-744261d25214 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:01.495249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:01.502749 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cbf12-1c9a-4e53-a42b-79d0a741bc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:01.503505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cbf12-1c9a-4e53-a42b-79d0a741bc07 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:01.508883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cbf12-1c9a-4e53-a42b-79d0a741bc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:01.508883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cbf12-1c9a-4e53-a42b-79d0a741bc07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:01.508883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cbf12-1c9a-4e53-a42b-79d0a741bc07 None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=fde62f4ce7af42eca1fe5a7b6807d1ae) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:01.508883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cbf12-1c9a-4e53-a42b-79d0a741bc07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:01.508883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cbf12-1c9a-4e53-a42b-79d0a741bc07 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:01.519022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 429/875] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:16:01 2022] GET /identity/v3/role_assignments?user.id=fde62f4ce7af42eca1fe5a7b6807d1ae&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:01.523545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ade0a-efa2-41a9-8e9f-e42d3a03829b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:01.566831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceda775-495a-433d-9a5f-bfb549e514a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:01.567514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceda775-495a-433d-9a5f-bfb549e514a2 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:01.567788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceda775-495a-433d-9a5f-bfb549e514a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:01.568055 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceda775-495a-433d-9a5f-bfb549e514a2 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:01.568782 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceda775-495a-433d-9a5f-bfb549e514a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:01.570289 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceda775-495a-433d-9a5f-bfb549e514a2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:01.574383 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:01.700229 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 447/876] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 20 19:16:01 2022] POST /identity/v3/services => generated 251 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:16:02.141774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1da1a4-9b30-409a-8246-62a5b5d4a7d5 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:02.142323 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1da1a4-9b30-409a-8246-62a5b5d4a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:02.142323 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1da1a4-9b30-409a-8246-62a5b5d4a7d5 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:02.144021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 430/877] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:02.149379 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccaf08-18fc-4066-9fbf-d25b6e892681 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:02.149853 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccaf08-18fc-4066-9fbf-d25b6e892681 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:02.150282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccaf08-18fc-4066-9fbf-d25b6e892681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:02.168567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-53ccaf08-18fc-4066-9fbf-d25b6e892681 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:02.169995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-53ccaf08-18fc-4066-9fbf-d25b6e892681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:02.251061 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 448/878] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:02.275388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1da1a4-9b30-409a-8246-62a5b5d4a7d5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:02.390009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1da1a4-9b30-409a-8246-62a5b5d4a7d5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:02.425687 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571e000-33dd-458e-97fe-d9826199b8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:02.426489 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571e000-33dd-458e-97fe-d9826199b8ff None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:02.426786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571e000-33dd-458e-97fe-d9826199b8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:02.427050 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571e000-33dd-458e-97fe-d9826199b8ff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:02.437926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571e000-33dd-458e-97fe-d9826199b8ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f571e000-33dd-458e-97fe-d9826199b8ff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:16:02.446756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:02.447675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:02.448676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:02.448676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:02.448676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:02.448676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:02.448676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:16:02.448676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:16:02.448676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:16:02.448676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:16:02.448676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:16:02.448676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:16:02.448676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:16:02.448676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:02.448676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 431/879] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jul 20 19:16:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:02.456065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccaf08-18fc-4066-9fbf-d25b6e892681 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:02.571159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccaf08-18fc-4066-9fbf-d25b6e892681 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:02.596735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:02.609048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0e65c-4020-4bbb-aa52-fa688b1d902c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:02.610149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0e65c-4020-4bbb-aa52-fa688b1d902c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:02.610641 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0e65c-4020-4bbb-aa52-fa688b1d902c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:02.611196 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0e65c-4020-4bbb-aa52-fa688b1d902c None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:02.612164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0e65c-4020-4bbb-aa52-fa688b1d902c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:02.612720 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0e65c-4020-4bbb-aa52-fa688b1d902c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:02.614313 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0e65c-4020-4bbb-aa52-fa688b1d902c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:02.627180 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 449/880] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 20 19:16:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:02.630156 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571e000-33dd-458e-97fe-d9826199b8ff None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:02.673523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:02.738541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571e000-33dd-458e-97fe-d9826199b8ff None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:02.777910 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b742766-db78-4e27-bd3e-59a1f82a25e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:02.778735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b742766-db78-4e27-bd3e-59a1f82a25e9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:02.779021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b742766-db78-4e27-bd3e-59a1f82a25e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:02.779295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b742766-db78-4e27-bd3e-59a1f82a25e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:02.791532 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b742766-db78-4e27-bd3e-59a1f82a25e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:02.793001 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b742766-db78-4e27-bd3e-59a1f82a25e9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:02.811764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5b742766-db78-4e27-bd3e-59a1f82a25e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:02.811764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:02.811764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:02.811764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:02.811764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:02.811764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:02.811764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:02.811764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:02.811764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:02.811764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:02.811764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:02.811764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:02.811764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:16:02.811764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:16:02.811764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:02.812744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:02.815013 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:16:02.815013 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:16:02.815013 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:02.815013 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:02.815013 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 432/881] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:02.821324 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0e65c-4020-4bbb-aa52-fa688b1d902c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:02.938647 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0e65c-4020-4bbb-aa52-fa688b1d902c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:02.974644 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679605d1-158b-499c-8c46-5eaa1fc53abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:02.975719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679605d1-158b-499c-8c46-5eaa1fc53abb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:02.976226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679605d1-158b-499c-8c46-5eaa1fc53abb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:02.976703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679605d1-158b-499c-8c46-5eaa1fc53abb None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:02.977628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679605d1-158b-499c-8c46-5eaa1fc53abb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:02.978143 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679605d1-158b-499c-8c46-5eaa1fc53abb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:02.979788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679605d1-158b-499c-8c46-5eaa1fc53abb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:02.997890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 450/882] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:02.999521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b742766-db78-4e27-bd3e-59a1f82a25e9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:03.024856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8a477-a466-45fa-ab70-96cfd752cf95 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:03.025173 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8a477-a466-45fa-ab70-96cfd752cf95 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:03.025404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8a477-a466-45fa-ab70-96cfd752cf95 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:03.027046 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 451/883] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:16:03.031969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c96f6-1314-48e4-919b-78c928820abe None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:03.032257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c96f6-1314-48e4-919b-78c928820abe None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:03.032530 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c96f6-1314-48e4-919b-78c928820abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:03.049890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b07c96f6-1314-48e4-919b-78c928820abe None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:03.051112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b07c96f6-1314-48e4-919b-78c928820abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:03.097067 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:03.117339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:03.127357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b742766-db78-4e27-bd3e-59a1f82a25e9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:03.142482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 452/884] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:03.164745 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c81b8-f173-43b7-9a57-902721e840e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:03.165301 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c96f6-1314-48e4-919b-78c928820abe None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:03.166425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c81b8-f173-43b7-9a57-902721e840e4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:03.166987 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c81b8-f173-43b7-9a57-902721e840e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:03.167621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c81b8-f173-43b7-9a57-902721e840e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:03.180090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c81b8-f173-43b7-9a57-902721e840e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:03.182245 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c81b8-f173-43b7-9a57-902721e840e4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-397c81b8-f173-43b7-9a57-902721e840e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:16:03.204197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:03.205464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:03.206564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:03.206564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:03.206564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:16:03.206564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:16:03.206564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:16:03.206564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:16:03.206564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:16:03.206564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:16:03.206564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:16:03.206564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:03.214580 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 433/885] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jul 20 19:16:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:03.216042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c81b8-f173-43b7-9a57-902721e840e4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:03.281376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c96f6-1314-48e4-919b-78c928820abe None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:03.320537 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb58f2-a138-431d-93ea-e4172b5930d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:03.321857 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb58f2-a138-431d-93ea-e4172b5930d0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:03.322451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb58f2-a138-431d-93ea-e4172b5930d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:03.322994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb58f2-a138-431d-93ea-e4172b5930d0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:03.323921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb58f2-a138-431d-93ea-e4172b5930d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:03.325599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb58f2-a138-431d-93ea-e4172b5930d0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:03.329381 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c81b8-f173-43b7-9a57-902721e840e4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-69eb58f2-a138-431d-93ea-e4172b5930d0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:03.339719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:03.340711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:03.341554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:03.341554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:03.341554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:03.341554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:03.341554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:03.341554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:03.341554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:03.341554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:03.341554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:03.341554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:03.341554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:03.341554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:16:03.341554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:03.341554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:16:03.341554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:03.350011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 453/886] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jul 20 19:16:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:16:03.351217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb58f2-a138-431d-93ea-e4172b5930d0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:03.365189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e05c3-d6bc-4690-a677-5806bae8a32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:03.365861 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e05c3-d6bc-4690-a677-5806bae8a32f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:03.366135 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e05c3-d6bc-4690-a677-5806bae8a32f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:03.366403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e05c3-d6bc-4690-a677-5806bae8a32f None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:03.367413 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e05c3-d6bc-4690-a677-5806bae8a32f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:03.367702 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e05c3-d6bc-4690-a677-5806bae8a32f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:03.369115 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e05c3-d6bc-4690-a677-5806bae8a32f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:03.394137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 434/887] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jul 20 19:16:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:03.395613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e05c3-d6bc-4690-a677-5806bae8a32f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:03.398381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:03.408457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:03.482698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb58f2-a138-431d-93ea-e4172b5930d0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:03.515896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e05c3-d6bc-4690-a677-5806bae8a32f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:03.525930 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418c3c2-7011-42f6-b158-b4ba6464ee14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:03.526642 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418c3c2-7011-42f6-b158-b4ba6464ee14 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:03.526955 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418c3c2-7011-42f6-b158-b4ba6464ee14 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:03.527227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418c3c2-7011-42f6-b158-b4ba6464ee14 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:03.527942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418c3c2-7011-42f6-b158-b4ba6464ee14 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:03.528244 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418c3c2-7011-42f6-b158-b4ba6464ee14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:03.529620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418c3c2-7011-42f6-b158-b4ba6464ee14 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:03.539004 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 454/888] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 20 19:16:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:03.541364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418c3c2-7011-42f6-b158-b4ba6464ee14 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:03.554884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787781b-7c4e-4775-8856-c4c5a064cccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:03.555542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787781b-7c4e-4775-8856-c4c5a064cccd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:03.555818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787781b-7c4e-4775-8856-c4c5a064cccd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:03.556087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787781b-7c4e-4775-8856-c4c5a064cccd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:03.630705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787781b-7c4e-4775-8856-c4c5a064cccd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:03.632195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787781b-7c4e-4775-8856-c4c5a064cccd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:03.643139 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:03.649661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418c3c2-7011-42f6-b158-b4ba6464ee14 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:03.651335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:03.686889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff80a1-0367-480c-9ea3-1fd96cd60abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:03.687869 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff80a1-0367-480c-9ea3-1fd96cd60abb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:03.688298 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff80a1-0367-480c-9ea3-1fd96cd60abb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:03.688714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff80a1-0367-480c-9ea3-1fd96cd60abb None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:03.689568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff80a1-0367-480c-9ea3-1fd96cd60abb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:03.690015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff80a1-0367-480c-9ea3-1fd96cd60abb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:03.691992 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff80a1-0367-480c-9ea3-1fd96cd60abb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:03.702563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 455/889] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 20 19:16:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:03.704243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff80a1-0367-480c-9ea3-1fd96cd60abb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:03.741913 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 435/890] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:16:03 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:03.747720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787781b-7c4e-4775-8856-c4c5a064cccd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:03.829590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff80a1-0367-480c-9ea3-1fd96cd60abb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:03.860986 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787781b-7c4e-4775-8856-c4c5a064cccd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:03.869877 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332ff52-74e4-4641-9a11-9c70b7d01e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:03.870807 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:03.871661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332ff52-74e4-4641-9a11-9c70b7d01e12 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:03.872104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332ff52-74e4-4641-9a11-9c70b7d01e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:03.872532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332ff52-74e4-4641-9a11-9c70b7d01e12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:03.873332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332ff52-74e4-4641-9a11-9c70b7d01e12 None admin] RBAC: Adding query filter params (interface=public, service_id=fe9474e5008d4be6b992783bfe86af4c, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:03.873636 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332ff52-74e4-4641-9a11-9c70b7d01e12 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:03.875075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332ff52-74e4-4641-9a11-9c70b7d01e12 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:03.884995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 456/891] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jul 20 19:16:03 2022] GET /identity/v3/endpoints?service_id=fe9474e5008d4be6b992783bfe86af4c&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:03.884995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7521e-6e3f-491f-9793-2cb7b72542cf None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:03.884995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7521e-6e3f-491f-9793-2cb7b72542cf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:03.884995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7521e-6e3f-491f-9793-2cb7b72542cf None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:03.884995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 457/892] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:03.889195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7521e-6e3f-491f-9793-2cb7b72542cf None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:03.901412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96887d0-115e-422a-99bd-f12528139bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:03.902209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96887d0-115e-422a-99bd-f12528139bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:03.902489 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96887d0-115e-422a-99bd-f12528139bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:03.902821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96887d0-115e-422a-99bd-f12528139bb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:03.915355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96887d0-115e-422a-99bd-f12528139bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:03.916808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96887d0-115e-422a-99bd-f12528139bb6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:03.922087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:03.934830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f96887d0-115e-422a-99bd-f12528139bb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:03.934830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:03.934830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:03.934830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:03.934830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:03.934830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:03.934830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:03.934830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:03.934830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:03.934830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:03.934830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:03.934830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:03.934830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:16:03.934830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:16:03.934830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:03.935809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:03.936778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:16:03.936778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:16:03.936778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:03.936778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:03.936778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 436/893] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:03.937445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6af22-8e8b-4b2b-8fd4-7f9d9423ff83 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:03.937753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6af22-8e8b-4b2b-8fd4-7f9d9423ff83 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:03.938025 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6af22-8e8b-4b2b-8fd4-7f9d9423ff83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:03.955685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a1a6af22-8e8b-4b2b-8fd4-7f9d9423ff83 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:03.956939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a1a6af22-8e8b-4b2b-8fd4-7f9d9423ff83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:03.995584 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7521e-6e3f-491f-9793-2cb7b72542cf None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:04.023584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 437/894] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:04.024909 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfab5f-dece-4b31-9751-ede47d630a5a None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:04.025202 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfab5f-dece-4b31-9751-ede47d630a5a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:04.025476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfab5f-dece-4b31-9751-ede47d630a5a None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:04.026762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 438/895] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:04.027524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfab5f-dece-4b31-9751-ede47d630a5a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:04.035294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495df598-6dac-4066-b29c-118c074f2d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:04.036003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495df598-6dac-4066-b29c-118c074f2d14 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:04.036335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495df598-6dac-4066-b29c-118c074f2d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:04.036611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495df598-6dac-4066-b29c-118c074f2d14 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:04.037349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495df598-6dac-4066-b29c-118c074f2d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:04.038994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495df598-6dac-4066-b29c-118c074f2d14 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:04.052670 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 458/896] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 20 19:16:03 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:16:04.052670 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b820322-d31a-441e-af97-72253b25a7f3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:04.052670 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b820322-d31a-441e-af97-72253b25a7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:04.052670 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b820322-d31a-441e-af97-72253b25a7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:04.067779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5b820322-d31a-441e-af97-72253b25a7f3 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:04.069108 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5b820322-d31a-441e-af97-72253b25a7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:04.148723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 459/897] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:04.149636 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b820322-d31a-441e-af97-72253b25a7f3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:04.160083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:04.171827 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfab5f-dece-4b31-9751-ede47d630a5a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:04.190068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:04.213139 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5db09-a277-45c5-a3b3-58496c3ac9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:04.214097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5db09-a277-45c5-a3b3-58496c3ac9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:04.214381 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5db09-a277-45c5-a3b3-58496c3ac9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:04.214652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5db09-a277-45c5-a3b3-58496c3ac9b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:04.215433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5db09-a277-45c5-a3b3-58496c3ac9b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:04.215745 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5db09-a277-45c5-a3b3-58496c3ac9b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:04.217120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5db09-a277-45c5-a3b3-58496c3ac9b4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:04.230830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 439/898] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:04.231680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5db09-a277-45c5-a3b3-58496c3ac9b4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:04.275803 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b820322-d31a-441e-af97-72253b25a7f3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:04.318790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd30b7-c8a1-4644-8bed-a0f68d863b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:04.319595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd30b7-c8a1-4644-8bed-a0f68d863b09 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:04.319870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd30b7-c8a1-4644-8bed-a0f68d863b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:04.320140 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd30b7-c8a1-4644-8bed-a0f68d863b09 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:04.320809 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd30b7-c8a1-4644-8bed-a0f68d863b09 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:04.322199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd30b7-c8a1-4644-8bed-a0f68d863b09 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b1dd30b7-c8a1-4644-8bed-a0f68d863b09 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:04.335969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:04.337015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:04.337863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:04.337863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:04.337863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:04.337863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:04.337863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:04.337863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:04.337863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:04.337863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:04.337863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:04.337863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:04.337863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:16:04.337863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:04.337863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:16:04.337863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:04.337863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 460/899] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 20 19:16:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:04.339322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd30b7-c8a1-4644-8bed-a0f68d863b09 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:04.361699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5db09-a277-45c5-a3b3-58496c3ac9b4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:04.402934 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04073306-68db-45d7-9cdf-6dd50cbca558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:04.403820 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04073306-68db-45d7-9cdf-6dd50cbca558 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:04.404158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04073306-68db-45d7-9cdf-6dd50cbca558 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:04.404357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04073306-68db-45d7-9cdf-6dd50cbca558 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:04.405012 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04073306-68db-45d7-9cdf-6dd50cbca558 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:04.407030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04073306-68db-45d7-9cdf-6dd50cbca558 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-04073306-68db-45d7-9cdf-6dd50cbca558 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:04.429024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:04.431075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:04.433173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:04.433173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:04.433173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:04.433173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:04.433173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:04.433173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:04.433173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:04.433173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:04.433173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:04.433173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:04.433173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:16:04.433173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:04.433173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:16:04.433173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:04.433173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 440/900] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:16:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:04.434729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04073306-68db-45d7-9cdf-6dd50cbca558 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:04.450404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:04.453189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:04.464676 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd30b7-c8a1-4644-8bed-a0f68d863b09 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:04.505608 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc65f3f-ab99-42bd-85e9-34f9588174ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:04.506410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc65f3f-ab99-42bd-85e9-34f9588174ed None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:04.506737 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc65f3f-ab99-42bd-85e9-34f9588174ed None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:04.506995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc65f3f-ab99-42bd-85e9-34f9588174ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:04.516162 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc65f3f-ab99-42bd-85e9-34f9588174ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:04.518149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc65f3f-ab99-42bd-85e9-34f9588174ed None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:04.538949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-bcc65f3f-ab99-42bd-85e9-34f9588174ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:04.538949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:04.538949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:04.538949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:04.538949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:04.538949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:04.538949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:04.538949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:04.538949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:04.538949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:04.538949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:04.538949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:04.538949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:16:04.538949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:16:04.538949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:04.539889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:04.540788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:16:04.540788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:16:04.540788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:16:04.540788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:16:04.540788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:16:04.540788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:16:04.540788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:04.540788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:04.540788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 461/901] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:16:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:04.540788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc65f3f-ab99-42bd-85e9-34f9588174ed None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:04.548159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04073306-68db-45d7-9cdf-6dd50cbca558 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:04.585467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe4601-4ac4-4fdb-a719-e91d25a94c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:04.586141 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe4601-4ac4-4fdb-a719-e91d25a94c83 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:04.586477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe4601-4ac4-4fdb-a719-e91d25a94c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:04.586784 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe4601-4ac4-4fdb-a719-e91d25a94c83 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:04.587497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe4601-4ac4-4fdb-a719-e91d25a94c83 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:04.587801 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe4601-4ac4-4fdb-a719-e91d25a94c83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:04.589622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe4601-4ac4-4fdb-a719-e91d25a94c83 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:04.595618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 441/902] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jul 20 19:16:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:04.600759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe4601-4ac4-4fdb-a719-e91d25a94c83 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:04.655240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc65f3f-ab99-42bd-85e9-34f9588174ed None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:04.690251 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:04.692339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f4c1f-f5df-4e43-9abe-3590238eea8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:04.694167 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f4c1f-f5df-4e43-9abe-3590238eea8c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:04.694476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f4c1f-f5df-4e43-9abe-3590238eea8c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:04.694941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f4c1f-f5df-4e43-9abe-3590238eea8c None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:04.695750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f4c1f-f5df-4e43-9abe-3590238eea8c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:04.696086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f4c1f-f5df-4e43-9abe-3590238eea8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:04.697632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f4c1f-f5df-4e43-9abe-3590238eea8c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:04.702937 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 462/903] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:16:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:04.708658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f4c1f-f5df-4e43-9abe-3590238eea8c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:04.714269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe4601-4ac4-4fdb-a719-e91d25a94c83 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:04.733144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:04.753256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d1467-e11d-459b-8ffa-871f06a590fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:04.754283 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d1467-e11d-459b-8ffa-871f06a590fc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:04.754568 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d1467-e11d-459b-8ffa-871f06a590fc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:04.754882 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d1467-e11d-459b-8ffa-871f06a590fc None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:04.756099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d1467-e11d-459b-8ffa-871f06a590fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:04.756099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d1467-e11d-459b-8ffa-871f06a590fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:04.757606 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d1467-e11d-459b-8ffa-871f06a590fc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:04.772963 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 442/904] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:16:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:04.773816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d1467-e11d-459b-8ffa-871f06a590fc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:04.860654 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f4c1f-f5df-4e43-9abe-3590238eea8c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:04.888295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d1467-e11d-459b-8ffa-871f06a590fc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:04.897849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f37e3-80eb-4fbd-a890-30604408b545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:04.898710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f37e3-80eb-4fbd-a890-30604408b545 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:04.898953 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f37e3-80eb-4fbd-a890-30604408b545 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:04.899218 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f37e3-80eb-4fbd-a890-30604408b545 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:04.899919 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f37e3-80eb-4fbd-a890-30604408b545 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:04.900219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f37e3-80eb-4fbd-a890-30604408b545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:04.901643 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f37e3-80eb-4fbd-a890-30604408b545 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:04.906884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 463/905] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jul 20 19:16:04 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:04.907710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f37e3-80eb-4fbd-a890-30604408b545 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:04.934588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d65408-51c5-44a7-b681-4d963f105dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:04.935345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d65408-51c5-44a7-b681-4d963f105dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:04.935616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d65408-51c5-44a7-b681-4d963f105dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:04.935956 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d65408-51c5-44a7-b681-4d963f105dc9 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:04.936897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d65408-51c5-44a7-b681-4d963f105dc9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:04.937067 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d65408-51c5-44a7-b681-4d963f105dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:04.939158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d65408-51c5-44a7-b681-4d963f105dc9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:04.945933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 443/906] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:16:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:04.951625 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d65408-51c5-44a7-b681-4d963f105dc9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:04.955773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:05.032524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:05.065916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f37e3-80eb-4fbd-a890-30604408b545 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:05.075144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d65408-51c5-44a7-b681-4d963f105dc9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:05.114400 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d4dba-7b6f-4cf7-b633-9d05d7858249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:05.115193 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d4dba-7b6f-4cf7-b633-9d05d7858249 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:05.115477 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d4dba-7b6f-4cf7-b633-9d05d7858249 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:05.115752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d4dba-7b6f-4cf7-b633-9d05d7858249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:05.117812 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d4dba-7b6f-4cf7-b633-9d05d7858249 None admin] RBAC: Adding query filter params (role.id=38e63ce23c6d46878d5d205ba76ca2fb, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=391d83697b944e42b169e54535b7752f) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:05.117812 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d4dba-7b6f-4cf7-b633-9d05d7858249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:05.118576 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d4dba-7b6f-4cf7-b633-9d05d7858249 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:05.122564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae137f-0dd1-4660-8fcb-1dd1f352509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:05.123688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae137f-0dd1-4660-8fcb-1dd1f352509d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:05.124247 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae137f-0dd1-4660-8fcb-1dd1f352509d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:05.124721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae137f-0dd1-4660-8fcb-1dd1f352509d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:05.125950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 464/907] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:16:04 2022] GET /identity/v3/role_assignments?user.id=391d83697b944e42b169e54535b7752f&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=38e63ce23c6d46878d5d205ba76ca2fb => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:05.126614 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae137f-0dd1-4660-8fcb-1dd1f352509d None admin] RBAC: Adding query filter params (interface=public, service_id=d5f0186391084aa58321ce73a158795d, region_id=RegionOne) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:05.127091 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae137f-0dd1-4660-8fcb-1dd1f352509d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:05.128518 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae137f-0dd1-4660-8fcb-1dd1f352509d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:05.143686 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 444/908] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jul 20 19:16:04 2022] GET /identity/v3/endpoints?service_id=d5f0186391084aa58321ce73a158795d&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:05.149070 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d4dba-7b6f-4cf7-b633-9d05d7858249 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:05.273345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d4dba-7b6f-4cf7-b633-9d05d7858249 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:05.318538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43aca8-0b50-4797-965d-382be0d84f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:05.319328 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43aca8-0b50-4797-965d-382be0d84f2a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:05.319602 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43aca8-0b50-4797-965d-382be0d84f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:05.319871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43aca8-0b50-4797-965d-382be0d84f2a None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:05.320553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43aca8-0b50-4797-965d-382be0d84f2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:05.321926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43aca8-0b50-4797-965d-382be0d84f2a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:05.329085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 465/909] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 20 19:16:05 2022] GET /identity/v3/services => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:16:06.218461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539b5be-e7a6-4c41-9a82-ae519e370045 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:06.219277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539b5be-e7a6-4c41-9a82-ae519e370045 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:06.219277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539b5be-e7a6-4c41-9a82-ae519e370045 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:06.220864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 445/910] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:06.226192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac8bae-c5be-4946-8448-1733114c2cf7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:06.226621 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac8bae-c5be-4946-8448-1733114c2cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:06.226753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac8bae-c5be-4946-8448-1733114c2cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:06.233911 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:06.245638 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d7ac8bae-c5be-4946-8448-1733114c2cf7 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:06.246844 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d7ac8bae-c5be-4946-8448-1733114c2cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:06.324885 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 466/911] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:06.348321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539b5be-e7a6-4c41-9a82-ae519e370045 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:06.417406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:06.455393 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539b5be-e7a6-4c41-9a82-ae519e370045 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:06.493871 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a36ab9-b3ca-4621-936a-5e2107ebd48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:06.494608 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a36ab9-b3ca-4621-936a-5e2107ebd48b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:06.494970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a36ab9-b3ca-4621-936a-5e2107ebd48b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:06.495245 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a36ab9-b3ca-4621-936a-5e2107ebd48b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:06.495895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a36ab9-b3ca-4621-936a-5e2107ebd48b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:06.497279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a36ab9-b3ca-4621-936a-5e2107ebd48b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f7a36ab9-b3ca-4621-936a-5e2107ebd48b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:06.512684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:06.513697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:06.514563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 446/912] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jul 20 19:16:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:06.520585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac8bae-c5be-4946-8448-1733114c2cf7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:06.630148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac8bae-c5be-4946-8448-1733114c2cf7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:06.665969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ed5ea-4e58-4820-85d6-9b800e5e8fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:06.666702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ed5ea-4e58-4820-85d6-9b800e5e8fef None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:06.667013 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ed5ea-4e58-4820-85d6-9b800e5e8fef None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:06.667286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ed5ea-4e58-4820-85d6-9b800e5e8fef None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:06.668045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ed5ea-4e58-4820-85d6-9b800e5e8fef None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:06.668407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ed5ea-4e58-4820-85d6-9b800e5e8fef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:06.669792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ed5ea-4e58-4820-85d6-9b800e5e8fef None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:06.670839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:06.676434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 467/913] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 20 19:16:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:06.682151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a36ab9-b3ca-4621-936a-5e2107ebd48b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:06.792181 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a36ab9-b3ca-4621-936a-5e2107ebd48b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:06.825251 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:06.831773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b4ea3-a1e1-4f23-8e74-c4da76cc2530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:06.832507 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b4ea3-a1e1-4f23-8e74-c4da76cc2530 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:06.832786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b4ea3-a1e1-4f23-8e74-c4da76cc2530 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:06.833058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b4ea3-a1e1-4f23-8e74-c4da76cc2530 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:06.833763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b4ea3-a1e1-4f23-8e74-c4da76cc2530 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:06.834136 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b4ea3-a1e1-4f23-8e74-c4da76cc2530 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:06.835606 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b4ea3-a1e1-4f23-8e74-c4da76cc2530 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:06.845254 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 447/914] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 20 19:16:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:06.846930 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ed5ea-4e58-4820-85d6-9b800e5e8fef None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:06.973472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ed5ea-4e58-4820-85d6-9b800e5e8fef None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:07.013842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3153a3d-3c11-4041-9123-680f1efa5027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:07.014891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3153a3d-3c11-4041-9123-680f1efa5027 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:07.015916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3153a3d-3c11-4041-9123-680f1efa5027 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:07.016655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3153a3d-3c11-4041-9123-680f1efa5027 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:07.017663 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3153a3d-3c11-4041-9123-680f1efa5027 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:07.019319 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3153a3d-3c11-4041-9123-680f1efa5027 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:07.099696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 468/915] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 20 19:16:06 2022] POST /identity/v3/endpoints => generated 347 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:16:07.167112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7824a-69bf-4358-9204-2d19d7b8e09e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:07.167477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7824a-69bf-4358-9204-2d19d7b8e09e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:07.167673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7824a-69bf-4358-9204-2d19d7b8e09e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:07.169467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 448/916] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:07.175444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccea52-4f20-4a80-b9a7-c3e22adaf746 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:07.176081 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccea52-4f20-4a80-b9a7-c3e22adaf746 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:07.176565 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccea52-4f20-4a80-b9a7-c3e22adaf746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:07.196215 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-22ccea52-4f20-4a80-b9a7-c3e22adaf746 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:07.197806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-22ccea52-4f20-4a80-b9a7-c3e22adaf746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:07.258173 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:07.290010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 469/917] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:07.315824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7824a-69bf-4358-9204-2d19d7b8e09e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:07.392970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6eb3b-57ab-4f62-96bc-b6764c555f28 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:07.393589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6eb3b-57ab-4f62-96bc-b6764c555f28 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:07.394074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6eb3b-57ab-4f62-96bc-b6764c555f28 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:07.395981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 470/918] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:07.401413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd0d85-e518-4c6d-8c9e-c535e42afb59 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:07.401990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd0d85-e518-4c6d-8c9e-c535e42afb59 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:07.402489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd0d85-e518-4c6d-8c9e-c535e42afb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:07.420327 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-71cd0d85-e518-4c6d-8c9e-c535e42afb59 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:07.421715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-71cd0d85-e518-4c6d-8c9e-c535e42afb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:07.430540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7824a-69bf-4358-9204-2d19d7b8e09e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:07.469777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704080f7-73a8-42ef-895e-87dfd9074aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:07.470449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704080f7-73a8-42ef-895e-87dfd9074aee None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:07.471160 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704080f7-73a8-42ef-895e-87dfd9074aee None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:07.471444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704080f7-73a8-42ef-895e-87dfd9074aee None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:07.472176 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704080f7-73a8-42ef-895e-87dfd9074aee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:07.473541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704080f7-73a8-42ef-895e-87dfd9074aee None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:07.494697 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 471/919] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:07.496137 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559025a-7590-42c8-8fb7-54a9abb86bb3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:07.496425 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559025a-7590-42c8-8fb7-54a9abb86bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:07.496697 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559025a-7590-42c8-8fb7-54a9abb86bb3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:07.498104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 472/920] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:07.503482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec4da3-e0c0-4b22-8da0-9ecae9848731 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:07.503766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec4da3-e0c0-4b22-8da0-9ecae9848731 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:07.504037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec4da3-e0c0-4b22-8da0-9ecae9848731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:07.522805 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b0ec4da3-e0c0-4b22-8da0-9ecae9848731 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:07.523999 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b0ec4da3-e0c0-4b22-8da0-9ecae9848731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:07.547320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 449/921] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 20 19:16:07 2022] POST /identity/v3/services => generated 241 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:16:07.548382 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704080f7-73a8-42ef-895e-87dfd9074aee None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:07.616682 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:07.628664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 473/922] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:07.653000 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec4da3-e0c0-4b22-8da0-9ecae9848731 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:07.679154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704080f7-73a8-42ef-895e-87dfd9074aee None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:07.705840 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:07.725921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bd618-88a3-49c6-9a85-abd9820695b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:07.727056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bd618-88a3-49c6-9a85-abd9820695b4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:07.727342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bd618-88a3-49c6-9a85-abd9820695b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:07.727618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bd618-88a3-49c6-9a85-abd9820695b4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:07.744639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bd618-88a3-49c6-9a85-abd9820695b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-ad6bd618-88a3-49c6-9a85-abd9820695b4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:16:07.754640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:07.755634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:07.756471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:07.756471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:07.756471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:07.756471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:07.756471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:16:07.756471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:16:07.756471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:16:07.756471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:16:07.756471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:16:07.756471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:16:07.756471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:16:07.756471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:07.757106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 450/923] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jul 20 19:16:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:07.767883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bd618-88a3-49c6-9a85-abd9820695b4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:07.794627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec4da3-e0c0-4b22-8da0-9ecae9848731 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:07.849679 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebb882-2fe7-4500-bf84-3661cdd47c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:07.851565 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebb882-2fe7-4500-bf84-3661cdd47c01 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:07.851565 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebb882-2fe7-4500-bf84-3661cdd47c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:07.851565 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebb882-2fe7-4500-bf84-3661cdd47c01 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:07.852282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebb882-2fe7-4500-bf84-3661cdd47c01 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:07.854090 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebb882-2fe7-4500-bf84-3661cdd47c01 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d1ebb882-2fe7-4500-bf84-3661cdd47c01 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:07.870811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:07.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:07.873139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:07.873139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:07.873139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:07.873139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:07.873139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:07.873139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:07.873139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:07.873139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:07.873139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:07.873139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:07.873139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:16:07.873139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:07.873139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:16:07.873139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:07.873139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 474/924] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:16:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:07.886697 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebb882-2fe7-4500-bf84-3661cdd47c01 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:07.913987 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bd618-88a3-49c6-9a85-abd9820695b4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:07.933918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:07.963165 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed479bd-5534-493c-acac-69929751bafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:07.963833 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed479bd-5534-493c-acac-69929751bafe None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:07.964106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed479bd-5534-493c-acac-69929751bafe None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:07.964925 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed479bd-5534-493c-acac-69929751bafe None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:07.966739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed479bd-5534-493c-acac-69929751bafe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:07.967117 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed479bd-5534-493c-acac-69929751bafe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:07.969767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed479bd-5534-493c-acac-69929751bafe None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:07.979024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 451/925] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 20 19:16:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:07.984321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed479bd-5534-493c-acac-69929751bafe None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:07.995556 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:08.001854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebb882-2fe7-4500-bf84-3661cdd47c01 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:08.047685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3e7c5-9037-4a2e-9f1d-7cddb983a180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:08.048852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3e7c5-9037-4a2e-9f1d-7cddb983a180 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:08.049282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3e7c5-9037-4a2e-9f1d-7cddb983a180 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:08.050103 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3e7c5-9037-4a2e-9f1d-7cddb983a180 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:08.051277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3e7c5-9037-4a2e-9f1d-7cddb983a180 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:08.051724 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3e7c5-9037-4a2e-9f1d-7cddb983a180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:08.054177 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3e7c5-9037-4a2e-9f1d-7cddb983a180 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:08.061214 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 475/926] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:16:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:08.066765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3e7c5-9037-4a2e-9f1d-7cddb983a180 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:08.096795 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed479bd-5534-493c-acac-69929751bafe None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:08.134140 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e376c6-126c-4c40-87b1-a75c32646543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:08.135140 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e376c6-126c-4c40-87b1-a75c32646543 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:08.135518 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e376c6-126c-4c40-87b1-a75c32646543 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:08.135891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e376c6-126c-4c40-87b1-a75c32646543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:08.148304 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e376c6-126c-4c40-87b1-a75c32646543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:08.149902 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e376c6-126c-4c40-87b1-a75c32646543 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:08.169332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-91e376c6-126c-4c40-87b1-a75c32646543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:08.169332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:08.169332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:08.169332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:08.169332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:08.169332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:08.169332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:08.169332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:08.169332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:08.169332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:08.169332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:08.169332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:08.169332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:16:08.169332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:16:08.169332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:08.170450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:08.172189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:16:08.172189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:16:08.172189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:08.172189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:08.178319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 452/927] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:08.179425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e376c6-126c-4c40-87b1-a75c32646543 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:08.196056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3e7c5-9037-4a2e-9f1d-7cddb983a180 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:08.216586 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:08.234530 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53300c73-8500-4c61-bbf2-4206e7265f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:08.235474 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53300c73-8500-4c61-bbf2-4206e7265f97 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:08.235858 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53300c73-8500-4c61-bbf2-4206e7265f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:08.236522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53300c73-8500-4c61-bbf2-4206e7265f97 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:08.237081 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53300c73-8500-4c61-bbf2-4206e7265f97 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:08.237551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53300c73-8500-4c61-bbf2-4206e7265f97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:08.239029 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53300c73-8500-4c61-bbf2-4206e7265f97 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:08.244784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 476/928] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jul 20 19:16:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:08.250521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53300c73-8500-4c61-bbf2-4206e7265f97 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:08.290527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:08.304748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e376c6-126c-4c40-87b1-a75c32646543 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:08.353212 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e5fe1-6413-40af-b4d6-9908eed105f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:08.354631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e5fe1-6413-40af-b4d6-9908eed105f8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:08.355145 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e5fe1-6413-40af-b4d6-9908eed105f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:08.355600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e5fe1-6413-40af-b4d6-9908eed105f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:08.356520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e5fe1-6413-40af-b4d6-9908eed105f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:08.357026 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e5fe1-6413-40af-b4d6-9908eed105f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:08.358600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e5fe1-6413-40af-b4d6-9908eed105f8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:08.377975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 453/929] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:08.379262 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e5fe1-6413-40af-b4d6-9908eed105f8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:08.398289 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53300c73-8500-4c61-bbf2-4206e7265f97 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:08.442797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290db69c-2b9b-423e-aca5-eff3d25984ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:08.443417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db69c-2b9b-423e-aca5-eff3d25984ce None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:08.443700 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db69c-2b9b-423e-aca5-eff3d25984ce None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:08.444258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db69c-2b9b-423e-aca5-eff3d25984ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:08.445020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290db69c-2b9b-423e-aca5-eff3d25984ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:08.446396 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290db69c-2b9b-423e-aca5-eff3d25984ce None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:08.486810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:08.498585 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e5fe1-6413-40af-b4d6-9908eed105f8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:08.533319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578adff0-fef8-4e21-ba56-37620528a96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:08.534125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578adff0-fef8-4e21-ba56-37620528a96a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:08.534408 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578adff0-fef8-4e21-ba56-37620528a96a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:08.534704 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578adff0-fef8-4e21-ba56-37620528a96a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:08.541976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578adff0-fef8-4e21-ba56-37620528a96a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:08.543523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578adff0-fef8-4e21-ba56-37620528a96a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-578adff0-fef8-4e21-ba56-37620528a96a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:16:08.561422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:08.563042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:08.563990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:08.563990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:08.563990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:16:08.563990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:16:08.563990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:16:08.563990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:16:08.563990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:16:08.563990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:16:08.563990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:16:08.563990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:08.565416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 477/931] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 20 19:16:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:16:08.567275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 454/931] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jul 20 19:16:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:08.568282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290db69c-2b9b-423e-aca5-eff3d25984ce None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:08.672062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:08.697811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290db69c-2b9b-423e-aca5-eff3d25984ce None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:08.737436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8decd8-1425-42b4-a59e-c2f0b30f55fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:08.738117 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8decd8-1425-42b4-a59e-c2f0b30f55fd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:08.738847 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8decd8-1425-42b4-a59e-c2f0b30f55fd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:08.739127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8decd8-1425-42b4-a59e-c2f0b30f55fd None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:08.739991 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8decd8-1425-42b4-a59e-c2f0b30f55fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:08.740303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8decd8-1425-42b4-a59e-c2f0b30f55fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:08.741779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8decd8-1425-42b4-a59e-c2f0b30f55fd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:08.764158 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 478/932] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jul 20 19:16:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:08.770688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578adff0-fef8-4e21-ba56-37620528a96a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:08.891290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578adff0-fef8-4e21-ba56-37620528a96a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:08.935377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b7fbc-d6d6-4c74-9e31-8544cbc2bda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:08.936576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b7fbc-d6d6-4c74-9e31-8544cbc2bda9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:08.937147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b7fbc-d6d6-4c74-9e31-8544cbc2bda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:08.938124 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b7fbc-d6d6-4c74-9e31-8544cbc2bda9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:08.949395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b7fbc-d6d6-4c74-9e31-8544cbc2bda9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:08.951159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b7fbc-d6d6-4c74-9e31-8544cbc2bda9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:08.968183 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:08.971688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-000b7fbc-d6d6-4c74-9e31-8544cbc2bda9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:08.971688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:08.971688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:08.971688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:08.971688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:08.971688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:08.971688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:08.971688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:08.971688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:08.971688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:08.971688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:08.971688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:08.971688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:16:08.971688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:16:08.971688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:08.972835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:08.973932 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:16:08.973932 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:16:08.973932 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:08.973932 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:08.976036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 455/933] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:08.981418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8decd8-1425-42b4-a59e-c2f0b30f55fd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:09.094357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8decd8-1425-42b4-a59e-c2f0b30f55fd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:09.133166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b905c7-d8f8-4987-893f-9444e278a87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:09.133839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b905c7-d8f8-4987-893f-9444e278a87d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:09.134117 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b905c7-d8f8-4987-893f-9444e278a87d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:09.134388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b905c7-d8f8-4987-893f-9444e278a87d None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:09.135150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b905c7-d8f8-4987-893f-9444e278a87d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:09.135458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b905c7-d8f8-4987-893f-9444e278a87d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:09.136855 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b905c7-d8f8-4987-893f-9444e278a87d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:09.144454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:09.150443 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 479/934] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:09.156053 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b7fbc-d6d6-4c74-9e31-8544cbc2bda9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:09.268616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b7fbc-d6d6-4c74-9e31-8544cbc2bda9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:09.293553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bae9c-7e01-4a20-b823-5e4526c58ad8 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:09.294088 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bae9c-7e01-4a20-b823-5e4526c58ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:09.294088 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bae9c-7e01-4a20-b823-5e4526c58ad8 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:09.295741 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 480/935] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:16:09.302346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0874b0e-5fee-4e73-8b62-17fb97b763d7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:09.302987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0874b0e-5fee-4e73-8b62-17fb97b763d7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:09.303475 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0874b0e-5fee-4e73-8b62-17fb97b763d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:09.309408 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d7b90-693f-4dae-a9d6-eaa9fe4b40a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:09.310956 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d7b90-693f-4dae-a9d6-eaa9fe4b40a4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:09.311250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d7b90-693f-4dae-a9d6-eaa9fe4b40a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:09.311521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d7b90-693f-4dae-a9d6-eaa9fe4b40a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:09.321896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d7b90-693f-4dae-a9d6-eaa9fe4b40a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:09.323402 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d7b90-693f-4dae-a9d6-eaa9fe4b40a4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:09.324750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c0874b0e-5fee-4e73-8b62-17fb97b763d7 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:09.326461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c0874b0e-5fee-4e73-8b62-17fb97b763d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:09.339076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c64d7b90-693f-4dae-a9d6-eaa9fe4b40a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:09.339076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:09.339076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:09.339076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:09.339076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:09.339076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:09.339076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:09.339076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:09.339076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:09.339076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:09.339076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:09.339076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:09.339076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:16:09.339076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:16:09.339076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:09.340040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:09.340938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:16:09.340938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:16:09.340938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:16:09.340938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:16:09.340938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:16:09.340938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:16:09.340938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:09.340938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:09.340938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 456/936] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:16:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:09.348907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d7b90-693f-4dae-a9d6-eaa9fe4b40a4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:09.413580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 481/937] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:09.430708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:09.440057 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0874b0e-5fee-4e73-8b62-17fb97b763d7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:09.474654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d7b90-693f-4dae-a9d6-eaa9fe4b40a4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:09.514220 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c47001-1bf6-4af2-bca0-2993096423c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:09.514958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c47001-1bf6-4af2-bca0-2993096423c8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:09.515342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c47001-1bf6-4af2-bca0-2993096423c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:09.515618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c47001-1bf6-4af2-bca0-2993096423c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:09.517346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c47001-1bf6-4af2-bca0-2993096423c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:09.517661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c47001-1bf6-4af2-bca0-2993096423c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:09.519268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c47001-1bf6-4af2-bca0-2993096423c8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:09.538707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 457/938] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:16:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:09.543521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c47001-1bf6-4af2-bca0-2993096423c8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:09.559717 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0874b0e-5fee-4e73-8b62-17fb97b763d7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:09.598917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:09.611744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d9ec4-a4db-4f8f-9300-5ac60a25fb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:09.613155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d9ec4-a4db-4f8f-9300-5ac60a25fb21 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:09.613643 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d9ec4-a4db-4f8f-9300-5ac60a25fb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:09.614126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d9ec4-a4db-4f8f-9300-5ac60a25fb21 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:09.615689 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d9ec4-a4db-4f8f-9300-5ac60a25fb21 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:09.617611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d9ec4-a4db-4f8f-9300-5ac60a25fb21 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-939d9ec4-a4db-4f8f-9300-5ac60a25fb21 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:09.634387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:09.635466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:09.636317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:09.636317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:09.636317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:09.636317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:09.636317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:09.636317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:09.636317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:09.636317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:09.636317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:09.636317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:09.636317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:16:09.636317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:09.636317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:16:09.636317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:09.639207 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 482/939] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:16:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:16:09.645435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d9ec4-a4db-4f8f-9300-5ac60a25fb21 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:09.666287 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c47001-1bf6-4af2-bca0-2993096423c8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:09.694056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:09.713735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673e366-03be-4149-8520-c384c69e46da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:09.715035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673e366-03be-4149-8520-c384c69e46da None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:09.715479 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673e366-03be-4149-8520-c384c69e46da None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:09.715899 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673e366-03be-4149-8520-c384c69e46da None admin] PATH_INFO: `/v3/projects/50abbf0c38634795be669ec69da1f06d/users/391d83697b944e42b169e54535b7752f/roles/38e63ce23c6d46878d5d205ba76ca2fb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:09.719739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673e366-03be-4149-8520-c384c69e46da None admin] RBAC: Authorizing `identity:create_grant(project_id=50abbf0c38634795be669ec69da1f06d, user_id=391d83697b944e42b169e54535b7752f, role_id=38e63ce23c6d46878d5d205ba76ca2fb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:09.721650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673e366-03be-4149-8520-c384c69e46da None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:09.755446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d9ec4-a4db-4f8f-9300-5ac60a25fb21 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:09.789987 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 458/940] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:16:09 2022] PUT /identity/v3/projects/50abbf0c38634795be669ec69da1f06d/users/391d83697b944e42b169e54535b7752f/roles/38e63ce23c6d46878d5d205ba76ca2fb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:16:09.791105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e838ea1-3402-4b4c-8662-a878761cac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:09.791773 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e838ea1-3402-4b4c-8662-a878761cac31 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:09.792051 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e838ea1-3402-4b4c-8662-a878761cac31 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:09.792321 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e838ea1-3402-4b4c-8662-a878761cac31 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:09.793033 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e838ea1-3402-4b4c-8662-a878761cac31 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:09.793335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e838ea1-3402-4b4c-8662-a878761cac31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:09.794774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e838ea1-3402-4b4c-8662-a878761cac31 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:09.800245 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fcf0b-26aa-4e8c-90b5-d655d72dec0f None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:09.800547 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fcf0b-26aa-4e8c-90b5-d655d72dec0f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:09.801041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fcf0b-26aa-4e8c-90b5-d655d72dec0f None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:09.801175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 483/941] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 20 19:16:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:09.802158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 459/942] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:09.808680 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62fc69-0d12-47d7-844c-2f6a184b358a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:09.808895 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62fc69-0d12-47d7-844c-2f6a184b358a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:09.809099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62fc69-0d12-47d7-844c-2f6a184b358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:09.813610 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fcf0b-26aa-4e8c-90b5-d655d72dec0f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:09.829147 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ee62fc69-0d12-47d7-844c-2f6a184b358a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:09.830382 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ee62fc69-0d12-47d7-844c-2f6a184b358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:09.896706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:09.923057 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 484/943] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:09.941139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62fc69-0d12-47d7-844c-2f6a184b358a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:09.968341 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fcf0b-26aa-4e8c-90b5-d655d72dec0f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:10.014307 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f7750-d386-4c5e-a1ae-a9d9f26f4a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:10.019419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f7750-d386-4c5e-a1ae-a9d9f26f4a1a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:10.019419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f7750-d386-4c5e-a1ae-a9d9f26f4a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:10.019419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f7750-d386-4c5e-a1ae-a9d9f26f4a1a None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:10.019419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f7750-d386-4c5e-a1ae-a9d9f26f4a1a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:10.019419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f7750-d386-4c5e-a1ae-a9d9f26f4a1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:10.019419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f7750-d386-4c5e-a1ae-a9d9f26f4a1a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:10.023992 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 460/944] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 20 19:16:09 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:10.067764 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62fc69-0d12-47d7-844c-2f6a184b358a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:10.112418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266233ca-a6c2-4d3a-8bc2-696122f26a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:10.113645 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266233ca-a6c2-4d3a-8bc2-696122f26a7f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:10.114142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266233ca-a6c2-4d3a-8bc2-696122f26a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:10.114610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266233ca-a6c2-4d3a-8bc2-696122f26a7f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:10.115501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266233ca-a6c2-4d3a-8bc2-696122f26a7f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:10.117118 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266233ca-a6c2-4d3a-8bc2-696122f26a7f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-266233ca-a6c2-4d3a-8bc2-696122f26a7f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:10.131989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:10.133045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:10.133871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:10.133871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:10.133871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:10.133871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:10.133871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:10.133871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:10.133871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:10.133871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:10.133871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:10.133871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:10.133871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:16:10.133871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:10.133871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:16:10.133871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:10.137020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 485/945] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 20 19:16:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:16:10.143589 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f7750-d386-4c5e-a1ae-a9d9f26f4a1a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:10.195061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:10.252726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f7750-d386-4c5e-a1ae-a9d9f26f4a1a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:10.289946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee5878-727d-4b80-870b-4d28ec519fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:10.298884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee5878-727d-4b80-870b-4d28ec519fbd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:10.298884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee5878-727d-4b80-870b-4d28ec519fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:10.298884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee5878-727d-4b80-870b-4d28ec519fbd None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:10.298884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee5878-727d-4b80-870b-4d28ec519fbd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:10.298884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee5878-727d-4b80-870b-4d28ec519fbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:10.298884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee5878-727d-4b80-870b-4d28ec519fbd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:10.302786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 461/946] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jul 20 19:16:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:10.304697 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266233ca-a6c2-4d3a-8bc2-696122f26a7f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:10.359381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:10.419130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266233ca-a6c2-4d3a-8bc2-696122f26a7f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:10.457930 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702817cc-a32a-41e1-9107-a54791f7d41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:10.459029 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702817cc-a32a-41e1-9107-a54791f7d41e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:10.459676 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702817cc-a32a-41e1-9107-a54791f7d41e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:10.460160 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702817cc-a32a-41e1-9107-a54791f7d41e None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:10.461085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702817cc-a32a-41e1-9107-a54791f7d41e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:10.461612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702817cc-a32a-41e1-9107-a54791f7d41e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:10.463235 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702817cc-a32a-41e1-9107-a54791f7d41e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:10.469486 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 486/947] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jul 20 19:16:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:10.475187 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee5878-727d-4b80-870b-4d28ec519fbd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:10.580032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee5878-727d-4b80-870b-4d28ec519fbd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:10.589671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:10.614753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb7518-9acf-4d26-96fe-207866ebaa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:10.615334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7518-9acf-4d26-96fe-207866ebaa77 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:10.615608 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7518-9acf-4d26-96fe-207866ebaa77 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:10.615875 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7518-9acf-4d26-96fe-207866ebaa77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:10.616723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb7518-9acf-4d26-96fe-207866ebaa77 None admin] RBAC: Adding query filter params (interface=public, service_id=fc85be829efc4b2a82336082dc820d4f, region_id=RegionOne) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:10.617088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb7518-9acf-4d26-96fe-207866ebaa77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:10.618656 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb7518-9acf-4d26-96fe-207866ebaa77 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:10.627502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 462/948] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jul 20 19:16:10 2022] GET /identity/v3/endpoints?service_id=fc85be829efc4b2a82336082dc820d4f&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:10.633339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702817cc-a32a-41e1-9107-a54791f7d41e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:10.752425 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702817cc-a32a-41e1-9107-a54791f7d41e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:10.773711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:10.803232 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a4c58-b0a4-47c1-bc80-7fcfb51e054b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:10.804064 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a4c58-b0a4-47c1-bc80-7fcfb51e054b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:10.804398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a4c58-b0a4-47c1-bc80-7fcfb51e054b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:10.804854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a4c58-b0a4-47c1-bc80-7fcfb51e054b None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:10.806166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a4c58-b0a4-47c1-bc80-7fcfb51e054b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:10.807414 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422703d-9df3-419e-b640-c13897984585 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:10.807701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422703d-9df3-419e-b640-c13897984585 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:10.807973 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422703d-9df3-419e-b640-c13897984585 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:10.809020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a4c58-b0a4-47c1-bc80-7fcfb51e054b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:10.809662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 463/949] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:16:10.815786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d5b17-7693-4d04-a4b7-c1960f674261 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:10.816080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d5b17-7693-4d04-a4b7-c1960f674261 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:10.816337 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d5b17-7693-4d04-a4b7-c1960f674261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:10.817970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 487/950] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 20 19:16:10 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:16:10.839502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-154d5b17-7693-4d04-a4b7-c1960f674261 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:10.840847 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-154d5b17-7693-4d04-a4b7-c1960f674261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:10.927302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 464/951] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:10.955510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a4c58-b0a4-47c1-bc80-7fcfb51e054b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:11.077533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a4c58-b0a4-47c1-bc80-7fcfb51e054b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:11.114124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33d332-2760-4c6f-baa5-1a8d3b21eb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:11.114845 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33d332-2760-4c6f-baa5-1a8d3b21eb87 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:11.115127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33d332-2760-4c6f-baa5-1a8d3b21eb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:11.115405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33d332-2760-4c6f-baa5-1a8d3b21eb87 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:11.116153 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33d332-2760-4c6f-baa5-1a8d3b21eb87 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:11.117728 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33d332-2760-4c6f-baa5-1a8d3b21eb87 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:11.119221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: WARNING keystone.server.flask.common [None req-3c33d332-2760-4c6f-baa5-1a8d3b21eb87 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 19:16:11.193708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.sql.core [None req-3c33d332-2760-4c6f-baa5-1a8d3b21eb87 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 19:16:11.193708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 19:16:11.193708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [parameters: {'id': 'd49696e809664764b383c4ba132c946d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 19:16:11.193708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80398) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 19:16:11.212071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3c33d332-2760-4c6f-baa5-1a8d3b21eb87 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d49696e809664764b383c4ba132c946d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d49696e809664764b383c4ba132c946d. Jul 20 19:16:11.212071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:11.212071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:16:11.212071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:16:11.212071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:16:11.212071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:16:11.212071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:16:11.212071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:16:11.212071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:16:11.212071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:16:11.212071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:16:11.212071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:16:11.212071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result.read() Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 20 19:16:11.212951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application yield resource Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise self.value Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application session.commit() Jul 20 19:16:11.213912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.session.flush() Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application compat.raise_( Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 19:16:11.214851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 19:16:11.215760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 19:16:11.215760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 19:16:11.215760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 19:16:11.215760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 19:16:11.215760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 19:16:11.215760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 19:16:11.215760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 19:16:11.215760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 19:16:11.215760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 19:16:11.215760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 19:16:11.215760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 19:16:11.215760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 19:16:11.215760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 19:16:11.215760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 19:16:11.215760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result.read() Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:16:11.218228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:16:11.220437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:16:11.220437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:16:11.220437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:16:11.220437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:16:11.220437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:16:11.220437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:16:11.220437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 19:16:11.220437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 19:16:11.220437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [parameters: {'id': 'd49696e809664764b383c4ba132c946d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 19:16:11.220437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 19:16:11.220437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:11.220437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:11.220437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:11.220437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:11.220437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:11.222358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:11.224706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:11.224706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 20 19:16:11.224706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 20 19:16:11.224706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:11.224706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:11.224706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 20 19:16:11.224706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 20 19:16:11.224706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d49696e809664764b383c4ba132c946d. Jul 20 19:16:11.224706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:11.228288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 488/952] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Jul 20 19:16:10 2022] POST /identity/v3/projects => generated 262 bytes in 273 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:11.234505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d5b17-7693-4d04-a4b7-c1960f674261 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:11.346368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d5b17-7693-4d04-a4b7-c1960f674261 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:11.347952 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:11.384949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1d935-40ab-40ec-bfbb-d788b90619a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:11.385742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1d935-40ab-40ec-bfbb-d788b90619a5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:11.386018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1d935-40ab-40ec-bfbb-d788b90619a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:11.386284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1d935-40ab-40ec-bfbb-d788b90619a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:11.393647 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1d935-40ab-40ec-bfbb-d788b90619a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:11.395121 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1d935-40ab-40ec-bfbb-d788b90619a5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:11.409317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-80e1d935-40ab-40ec-bfbb-d788b90619a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:11.409317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:11.409317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:11.409317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:11.409317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:11.409317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:11.409317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:11.409317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:11.409317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:11.409317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:11.409317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:11.409317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:11.409317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:16:11.409317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:16:11.409317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:11.410240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:11.411232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:16:11.411232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:16:11.411232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:16:11.411232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:16:11.411232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:16:11.411232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:16:11.411232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:11.411232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:11.411232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 465/953] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:16:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:11.416871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33d332-2760-4c6f-baa5-1a8d3b21eb87 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:11.460136 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:11.538798 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33d332-2760-4c6f-baa5-1a8d3b21eb87 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:11.578398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a21753-9ef8-4552-8c93-471de599ea81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:11.579453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a21753-9ef8-4552-8c93-471de599ea81 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:11.579971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a21753-9ef8-4552-8c93-471de599ea81 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:11.580470 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a21753-9ef8-4552-8c93-471de599ea81 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:11.581441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a21753-9ef8-4552-8c93-471de599ea81 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:11.581996 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a21753-9ef8-4552-8c93-471de599ea81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:11.584028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a21753-9ef8-4552-8c93-471de599ea81 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:11.608808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 489/954] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 20 19:16:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:12.112637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8a561-f338-419a-9002-9eb24776bffb None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:12.113184 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8a561-f338-419a-9002-9eb24776bffb None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:12.113184 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8a561-f338-419a-9002-9eb24776bffb None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:12.114804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 466/955] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:12.120406 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b8de-0ec7-4887-b5fe-06d18e16b72c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:12.120689 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b8de-0ec7-4887-b5fe-06d18e16b72c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:12.120956 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b8de-0ec7-4887-b5fe-06d18e16b72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:12.140773 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ca31b8de-0ec7-4887-b5fe-06d18e16b72c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:12.142384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ca31b8de-0ec7-4887-b5fe-06d18e16b72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:12.222298 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 490/956] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:12.245640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8a561-f338-419a-9002-9eb24776bffb None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:12.290321 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc48ea-038c-4b77-a7f1-44b446d16222 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:12.290892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc48ea-038c-4b77-a7f1-44b446d16222 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:12.291375 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc48ea-038c-4b77-a7f1-44b446d16222 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:12.293222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 491/957] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:12.298625 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f59d7-960e-4a0a-8a9d-492f3a8c2253 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:12.299215 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f59d7-960e-4a0a-8a9d-492f3a8c2253 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:12.299716 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f59d7-960e-4a0a-8a9d-492f3a8c2253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:12.318368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c06f59d7-960e-4a0a-8a9d-492f3a8c2253 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:12.319952 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c06f59d7-960e-4a0a-8a9d-492f3a8c2253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:12.340229 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:12.363997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8a561-f338-419a-9002-9eb24776bffb None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:12.407060 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0f713-c742-4a9f-a997-951d2306020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:12.407060 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0f713-c742-4a9f-a997-951d2306020d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:12.407060 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0f713-c742-4a9f-a997-951d2306020d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:12.407060 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0f713-c742-4a9f-a997-951d2306020d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:12.407483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 492/958] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:12.414443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0f713-c742-4a9f-a997-951d2306020d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d5f0f713-c742-4a9f-a997-951d2306020d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:16:12.423257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:12.424214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:12.425090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:12.425090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:12.425090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:12.425090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:12.425090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:16:12.425090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:16:12.425090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:16:12.425090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:16:12.425090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:16:12.425090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:16:12.425090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:16:12.425090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:12.425090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 467/959] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jul 20 19:16:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:12.432268 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f59d7-960e-4a0a-8a9d-492f3a8c2253 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:12.438701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0f713-c742-4a9f-a997-951d2306020d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:12.460452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:12.549309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0f713-c742-4a9f-a997-951d2306020d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:12.562235 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f59d7-960e-4a0a-8a9d-492f3a8c2253 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:12.586454 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71245a17-e464-4195-b120-64e32b1bfb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:12.587241 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71245a17-e464-4195-b120-64e32b1bfb48 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:12.587593 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71245a17-e464-4195-b120-64e32b1bfb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:12.587938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71245a17-e464-4195-b120-64e32b1bfb48 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:12.588757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71245a17-e464-4195-b120-64e32b1bfb48 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:12.589227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71245a17-e464-4195-b120-64e32b1bfb48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:12.590761 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71245a17-e464-4195-b120-64e32b1bfb48 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:12.600429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 468/960] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 20 19:16:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:12.605964 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71245a17-e464-4195-b120-64e32b1bfb48 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:12.610112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95f9a7-9af9-464f-b0af-c8898b9d9b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:12.611913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95f9a7-9af9-464f-b0af-c8898b9d9b10 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:12.612303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95f9a7-9af9-464f-b0af-c8898b9d9b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:12.612683 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95f9a7-9af9-464f-b0af-c8898b9d9b10 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:12.613533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95f9a7-9af9-464f-b0af-c8898b9d9b10 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:12.615175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95f9a7-9af9-464f-b0af-c8898b9d9b10 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:12.694847 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 493/961] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 20 19:16:12 2022] POST /identity/v3/services => generated 242 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:16:12.707425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:12.726226 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71245a17-e464-4195-b120-64e32b1bfb48 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:12.775024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dc975-3460-469d-9be6-ca1278b9030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:12.776090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dc975-3460-469d-9be6-ca1278b9030f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:12.776548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dc975-3460-469d-9be6-ca1278b9030f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:12.777005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dc975-3460-469d-9be6-ca1278b9030f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:12.789552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595dc975-3460-469d-9be6-ca1278b9030f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:12.791503 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595dc975-3460-469d-9be6-ca1278b9030f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:12.812035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-595dc975-3460-469d-9be6-ca1278b9030f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:12.812035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:12.812035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:12.812035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:12.812035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:12.812035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:12.812035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:12.812035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:12.812035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:12.812035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:12.812035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:12.812035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:12.812035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:16:12.812035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:16:12.812035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:12.813856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:12.815021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:16:12.815021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:16:12.815021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:12.815021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:12.822058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 469/962] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:12.823797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95f9a7-9af9-464f-b0af-c8898b9d9b10 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:12.855093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:12.937398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95f9a7-9af9-464f-b0af-c8898b9d9b10 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:12.973831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caf6ed-b7ce-4693-8d1c-e19be970b3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:12.974946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caf6ed-b7ce-4693-8d1c-e19be970b3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:12.975432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caf6ed-b7ce-4693-8d1c-e19be970b3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:12.975922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caf6ed-b7ce-4693-8d1c-e19be970b3c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:12.976853 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4caf6ed-b7ce-4693-8d1c-e19be970b3c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:12.977358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4caf6ed-b7ce-4693-8d1c-e19be970b3c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:12.979042 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4caf6ed-b7ce-4693-8d1c-e19be970b3c4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:12.992778 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 494/963] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:13.006716 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dc975-3460-469d-9be6-ca1278b9030f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:13.070225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896574-f451-40e3-a88f-6f29299aaf8c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:13.070508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896574-f451-40e3-a88f-6f29299aaf8c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:13.070816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896574-f451-40e3-a88f-6f29299aaf8c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:13.072487 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 495/964] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:16:13.077845 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d5d42-d1e8-4c78-a92c-dd137bf41ab8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:13.078001 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d5d42-d1e8-4c78-a92c-dd137bf41ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:13.078176 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d5d42-d1e8-4c78-a92c-dd137bf41ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:13.096866 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bd3d5d42-d1e8-4c78-a92c-dd137bf41ab8 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:13.098431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bd3d5d42-d1e8-4c78-a92c-dd137bf41ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:13.127721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dc975-3460-469d-9be6-ca1278b9030f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:13.165069 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:13.172905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7139009-de23-4e0b-8e91-dd2dd222cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:13.174204 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7139009-de23-4e0b-8e91-dd2dd222cb18 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:13.178820 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7139009-de23-4e0b-8e91-dd2dd222cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:13.178820 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7139009-de23-4e0b-8e91-dd2dd222cb18 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:13.182137 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 496/965] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:13.188842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7139009-de23-4e0b-8e91-dd2dd222cb18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:13.190320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7139009-de23-4e0b-8e91-dd2dd222cb18 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:13.207063 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d5d42-d1e8-4c78-a92c-dd137bf41ab8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c7139009-de23-4e0b-8e91-dd2dd222cb18 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:16:13.208334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:13.209268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:13.210857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:13.210857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:13.210857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:16:13.210857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:16:13.210857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:16:13.210857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:16:13.210857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:16:13.210857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:16:13.210857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:16:13.210857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:13.210857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 470/966] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jul 20 19:16:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:13.211486 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:13.217277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7139009-de23-4e0b-8e91-dd2dd222cb18 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:13.341946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7139009-de23-4e0b-8e91-dd2dd222cb18 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:13.366315 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d5d42-d1e8-4c78-a92c-dd137bf41ab8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:13.384427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdc4d4-3067-4c5d-b51e-efb4715c53e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:13.385111 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdc4d4-3067-4c5d-b51e-efb4715c53e8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:13.385397 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdc4d4-3067-4c5d-b51e-efb4715c53e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:13.385676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdc4d4-3067-4c5d-b51e-efb4715c53e8 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:13.386537 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdc4d4-3067-4c5d-b51e-efb4715c53e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:13.386894 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdc4d4-3067-4c5d-b51e-efb4715c53e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:13.391209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdc4d4-3067-4c5d-b51e-efb4715c53e8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:13.420702 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 471/967] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jul 20 19:16:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:13.422834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdc4d4-3067-4c5d-b51e-efb4715c53e8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:13.424384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad13657-2f16-4ce9-9a99-eff1e9069b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:13.425437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad13657-2f16-4ce9-9a99-eff1e9069b47 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:13.426235 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad13657-2f16-4ce9-9a99-eff1e9069b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:13.427759 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad13657-2f16-4ce9-9a99-eff1e9069b47 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:13.428708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad13657-2f16-4ce9-9a99-eff1e9069b47 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:13.430315 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad13657-2f16-4ce9-9a99-eff1e9069b47 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-aad13657-2f16-4ce9-9a99-eff1e9069b47 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:13.447483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:13.449480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:13.450417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:13.450417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:13.450417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:13.450417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:13.450417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:13.450417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:13.450417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:13.450417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:13.450417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:13.450417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:13.450417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:16:13.450417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:13.450417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:16:13.450417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:13.457637 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 497/968] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 20 19:16:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:13.460007 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad13657-2f16-4ce9-9a99-eff1e9069b47 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:13.502637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:13.545092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:13.559760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdc4d4-3067-4c5d-b51e-efb4715c53e8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:13.585829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad13657-2f16-4ce9-9a99-eff1e9069b47 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:13.598616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a020c-9e6a-4cd5-87db-b328d155267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:13.599651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a020c-9e6a-4cd5-87db-b328d155267e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:13.600079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a020c-9e6a-4cd5-87db-b328d155267e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:13.600531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a020c-9e6a-4cd5-87db-b328d155267e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:13.626603 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf757c7-24a4-499d-b3b7-70a2ddea8ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:13.627493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf757c7-24a4-499d-b3b7-70a2ddea8ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:13.627857 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf757c7-24a4-499d-b3b7-70a2ddea8ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:13.628222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf757c7-24a4-499d-b3b7-70a2ddea8ba7 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:13.629236 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf757c7-24a4-499d-b3b7-70a2ddea8ba7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:13.629657 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf757c7-24a4-499d-b3b7-70a2ddea8ba7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:13.631350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf757c7-24a4-499d-b3b7-70a2ddea8ba7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:13.643161 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 498/969] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jul 20 19:16:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:13.644196 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf757c7-24a4-499d-b3b7-70a2ddea8ba7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:13.685895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a020c-9e6a-4cd5-87db-b328d155267e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:13.688777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a020c-9e6a-4cd5-87db-b328d155267e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:13.747256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:13.770250 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf757c7-24a4-499d-b3b7-70a2ddea8ba7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:13.805994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:13.817089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586de0de-5bd4-41a8-9042-a0f2b20ce7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:13.817329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 472/970] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:16:13 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 19:16:13.817418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586de0de-5bd4-41a8-9042-a0f2b20ce7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:13.817418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586de0de-5bd4-41a8-9042-a0f2b20ce7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:13.817418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586de0de-5bd4-41a8-9042-a0f2b20ce7a9 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:13.817631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74947565-44bd-487e-85da-40eee7b9a358 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:13.817631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74947565-44bd-487e-85da-40eee7b9a358 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:13.817631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74947565-44bd-487e-85da-40eee7b9a358 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:13.817827 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586de0de-5bd4-41a8-9042-a0f2b20ce7a9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:13.817827 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586de0de-5bd4-41a8-9042-a0f2b20ce7a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:13.817827 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586de0de-5bd4-41a8-9042-a0f2b20ce7a9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:13.819282 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 473/971] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:13.820155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74947565-44bd-487e-85da-40eee7b9a358 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:13.828819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 499/972] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jul 20 19:16:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:13.828819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a78e1-dfc0-4a6b-878d-5a85138631d8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:13.828819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a78e1-dfc0-4a6b-878d-5a85138631d8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:13.828819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a78e1-dfc0-4a6b-878d-5a85138631d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:13.846069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cb8a78e1-dfc0-4a6b-878d-5a85138631d8 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:13.848030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cb8a78e1-dfc0-4a6b-878d-5a85138631d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:13.936978 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 500/973] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:13.938126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a78e1-dfc0-4a6b-878d-5a85138631d8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:13.946594 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74947565-44bd-487e-85da-40eee7b9a358 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:13.985669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394f2b5-f6e6-47b1-914a-a564ee4cf4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:13.986471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394f2b5-f6e6-47b1-914a-a564ee4cf4cf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:13.986767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394f2b5-f6e6-47b1-914a-a564ee4cf4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:13.987042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394f2b5-f6e6-47b1-914a-a564ee4cf4cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:13.998188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394f2b5-f6e6-47b1-914a-a564ee4cf4cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:13.999841 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394f2b5-f6e6-47b1-914a-a564ee4cf4cf None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:14.018584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c394f2b5-f6e6-47b1-914a-a564ee4cf4cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:14.018584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:14.018584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:14.018584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:14.018584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:14.018584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:14.018584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:14.018584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:14.018584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:14.018584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:14.018584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:14.018584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:14.018584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:16:14.018584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:16:14.018584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:14.019741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:14.020766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:16:14.020766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:16:14.020766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:14.020766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:14.020766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 474/974] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:14.020766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394f2b5-f6e6-47b1-914a-a564ee4cf4cf None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:14.024709 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:14.056587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a78e1-dfc0-4a6b-878d-5a85138631d8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:14.087811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:14.098894 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cb44a-25d5-4a58-8a85-e8fba3d9ea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:14.100066 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cb44a-25d5-4a58-8a85-e8fba3d9ea60 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:14.100636 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cb44a-25d5-4a58-8a85-e8fba3d9ea60 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:14.101097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cb44a-25d5-4a58-8a85-e8fba3d9ea60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:14.102068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cb44a-25d5-4a58-8a85-e8fba3d9ea60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:14.103655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cb44a-25d5-4a58-8a85-e8fba3d9ea60 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:14.132732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394f2b5-f6e6-47b1-914a-a564ee4cf4cf None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:14.168671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67ce19-6051-4322-aaaf-0454bf4e9218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:14.169340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67ce19-6051-4322-aaaf-0454bf4e9218 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:14.169621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67ce19-6051-4322-aaaf-0454bf4e9218 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:14.169896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67ce19-6051-4322-aaaf-0454bf4e9218 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:14.170729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67ce19-6051-4322-aaaf-0454bf4e9218 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:14.172203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67ce19-6051-4322-aaaf-0454bf4e9218 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:14.173558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: WARNING keystone.server.flask.common [None req-7a67ce19-6051-4322-aaaf-0454bf4e9218 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 19:16:14.189968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 501/975] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 20 19:16:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:16:14.191034 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cb44a-25d5-4a58-8a85-e8fba3d9ea60 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:14.233389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.sql.core [None req-7a67ce19-6051-4322-aaaf-0454bf4e9218 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 19:16:14.233389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 19:16:14.233389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [parameters: {'user_id': '046b7d538dd048d68223eea87e8bfab4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 19:16:14.233389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80399) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 19:16:14.243645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7a67ce19-6051-4322-aaaf-0454bf4e9218 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 19:16:14.243645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:14.243645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:16:14.243645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:16:14.243645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:16:14.243645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:16:14.243645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:16:14.243645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:16:14.243645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:16:14.243645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:16:14.243645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:16:14.243645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:16:14.243645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:16:14.243645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result.read() Jul 20 19:16:14.243645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:16:14.252155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application yield resource Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise self.value Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application session.commit() Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 19:16:14.253228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.session.flush() Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application compat.raise_( Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 19:16:14.254206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:16:14.255137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result.read() Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:16:14.257332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:16:14.260730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:16:14.260730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:16:14.260730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:16:14.260730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:16:14.260730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 19:16:14.260730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 19:16:14.260730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [parameters: {'user_id': '046b7d538dd048d68223eea87e8bfab4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 19:16:14.260730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 19:16:14.260730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:14.260730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:14.260730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:14.260730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:14.260730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:14.260730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:14.260730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 20 19:16:14.262703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 20 19:16:14.267018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 20 19:16:14.267018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 20 19:16:14.267018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 19:16:14.267018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 19:16:14.267018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 19:16:14.267018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:14.267018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 475/976] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jul 20 19:16:14 2022] POST /identity/v3/users => generated 160 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:14.267018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67ce19-6051-4322-aaaf-0454bf4e9218 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:14.361226 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:14.377307 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cb44a-25d5-4a58-8a85-e8fba3d9ea60 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:14.414425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67ce19-6051-4322-aaaf-0454bf4e9218 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:14.424703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a46b6f-0a99-4d50-8f7a-8daab14e9191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:14.425548 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a46b6f-0a99-4d50-8f7a-8daab14e9191 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:14.425929 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a46b6f-0a99-4d50-8f7a-8daab14e9191 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:14.426338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a46b6f-0a99-4d50-8f7a-8daab14e9191 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:14.427244 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a46b6f-0a99-4d50-8f7a-8daab14e9191 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:14.427617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a46b6f-0a99-4d50-8f7a-8daab14e9191 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:14.429079 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a46b6f-0a99-4d50-8f7a-8daab14e9191 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:14.446723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 502/977] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:14.451136 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a46b6f-0a99-4d50-8f7a-8daab14e9191 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:14.463575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1293c-4b35-4377-8b0b-ff35e5c2af74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:14.465170 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1293c-4b35-4377-8b0b-ff35e5c2af74 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:14.465948 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1293c-4b35-4377-8b0b-ff35e5c2af74 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:14.466444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1293c-4b35-4377-8b0b-ff35e5c2af74 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:14.477824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1293c-4b35-4377-8b0b-ff35e5c2af74 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:14.480557 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1293c-4b35-4377-8b0b-ff35e5c2af74 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:14.496792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4dd1293c-4b35-4377-8b0b-ff35e5c2af74 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:16:14.503155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:14.504345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:14.505541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:14.505541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:14.505541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:16:14.505541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:16:14.505541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:16:14.505541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:16:14.505541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:16:14.505541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:16:14.505541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:16:14.505541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:14.508767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 476/978] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:16:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:14.515651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1293c-4b35-4377-8b0b-ff35e5c2af74 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:14.572370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a46b6f-0a99-4d50-8f7a-8daab14e9191 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:14.613421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45522424-06ec-4df2-b7d8-5c838b3f9aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:14.614590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45522424-06ec-4df2-b7d8-5c838b3f9aef None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:14.614998 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45522424-06ec-4df2-b7d8-5c838b3f9aef None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:14.615413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45522424-06ec-4df2-b7d8-5c838b3f9aef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:14.625673 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45522424-06ec-4df2-b7d8-5c838b3f9aef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:14.627936 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45522424-06ec-4df2-b7d8-5c838b3f9aef None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:14.647614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-45522424-06ec-4df2-b7d8-5c838b3f9aef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:14.647614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:14.647614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:14.647614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:14.647614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:14.647614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:14.647614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:14.647614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:14.647614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:14.647614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:14.647614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:14.647614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:14.647614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:16:14.647614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:16:14.647614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:14.648616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:14.654209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:16:14.654209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:16:14.654209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:16:14.654209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:16:14.654209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:16:14.654209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:16:14.654209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:14.654209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:14.654209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 503/979] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:16:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:14.657244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1293c-4b35-4377-8b0b-ff35e5c2af74 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:14.659805 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45522424-06ec-4df2-b7d8-5c838b3f9aef None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:14.683706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:14.696243 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ac683-aea6-413a-8906-fb29977913c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:14.696917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ac683-aea6-413a-8906-fb29977913c0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:14.703739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ac683-aea6-413a-8906-fb29977913c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:14.703739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ac683-aea6-413a-8906-fb29977913c0 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:14.703739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ac683-aea6-413a-8906-fb29977913c0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:14.703739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ac683-aea6-413a-8906-fb29977913c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:14.703739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ac683-aea6-413a-8906-fb29977913c0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:14.746715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 477/980] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jul 20 19:16:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:14.782956 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:14.787670 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45522424-06ec-4df2-b7d8-5c838b3f9aef None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:14.833026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec961849-325b-42ea-ade3-3d927a3cb244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:14.833747 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec961849-325b-42ea-ade3-3d927a3cb244 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:14.834035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec961849-325b-42ea-ade3-3d927a3cb244 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:14.834305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec961849-325b-42ea-ade3-3d927a3cb244 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:14.835142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec961849-325b-42ea-ade3-3d927a3cb244 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:14.835446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec961849-325b-42ea-ade3-3d927a3cb244 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:14.836934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec961849-325b-42ea-ade3-3d927a3cb244 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:14.850945 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 504/981] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:16:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:14.860178 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ac683-aea6-413a-8906-fb29977913c0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:14.964528 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821b5ea-1afa-4b5d-a2c8-34e9d1e3a788 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:14.964811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821b5ea-1afa-4b5d-a2c8-34e9d1e3a788 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:14.965082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821b5ea-1afa-4b5d-a2c8-34e9d1e3a788 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:14.966595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 505/982] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:14.974354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ac683-aea6-413a-8906-fb29977913c0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:14.975342 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688b429-903b-40fa-8c67-f3aaee23e6db None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:14.975988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688b429-903b-40fa-8c67-f3aaee23e6db None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:14.976462 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688b429-903b-40fa-8c67-f3aaee23e6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:15.000244 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b688b429-903b-40fa-8c67-f3aaee23e6db None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:15.001459 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b688b429-903b-40fa-8c67-f3aaee23e6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:15.030360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb5d27-cc8a-4f23-8190-63f0a91c2bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:15.031104 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb5d27-cc8a-4f23-8190-63f0a91c2bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:15.031374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb5d27-cc8a-4f23-8190-63f0a91c2bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:15.031642 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb5d27-cc8a-4f23-8190-63f0a91c2bb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:15.032495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb5d27-cc8a-4f23-8190-63f0a91c2bb4 None admin] RBAC: Adding query filter params (role.id=38e63ce23c6d46878d5d205ba76ca2fb, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=391d83697b944e42b169e54535b7752f) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:15.032800 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb5d27-cc8a-4f23-8190-63f0a91c2bb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:15.034283 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb5d27-cc8a-4f23-8190-63f0a91c2bb4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:15.042287 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 478/983] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:16:14 2022] GET /identity/v3/role_assignments?user.id=391d83697b944e42b169e54535b7752f&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=38e63ce23c6d46878d5d205ba76ca2fb => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:15.093086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 506/984] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:15.116933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb5d27-cc8a-4f23-8190-63f0a91c2bb4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:15.172145 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:15.237885 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb5d27-cc8a-4f23-8190-63f0a91c2bb4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:15.272035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3ddcc-9807-420f-87ec-e9604e6e09e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:15.273194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3ddcc-9807-420f-87ec-e9604e6e09e5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:15.273691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3ddcc-9807-420f-87ec-e9604e6e09e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:15.274171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3ddcc-9807-420f-87ec-e9604e6e09e5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:15.275066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3ddcc-9807-420f-87ec-e9604e6e09e5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:15.276708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3ddcc-9807-420f-87ec-e9604e6e09e5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c0e3ddcc-9807-420f-87ec-e9604e6e09e5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:15.296770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:15.297762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:15.298724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:15.298724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:15.298724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:15.298724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:15.298724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:15.298724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:15.298724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:15.298724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:15.298724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:15.298724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:15.298724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:16:15.298724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:15.298724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:16:15.298724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:15.298724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 479/985] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:16:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:15.305914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688b429-903b-40fa-8c67-f3aaee23e6db None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:15.400543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:15.415229 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688b429-903b-40fa-8c67-f3aaee23e6db None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:15.452074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b0154-4db3-4bb9-91d7-1acf28c0a2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:15.452863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b0154-4db3-4bb9-91d7-1acf28c0a2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:15.453104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b0154-4db3-4bb9-91d7-1acf28c0a2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:15.453516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b0154-4db3-4bb9-91d7-1acf28c0a2c2 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:15.454234 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b0154-4db3-4bb9-91d7-1acf28c0a2c2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:15.454535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b0154-4db3-4bb9-91d7-1acf28c0a2c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:15.455965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b0154-4db3-4bb9-91d7-1acf28c0a2c2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:15.466219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 507/986] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 20 19:16:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:15.468319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3ddcc-9807-420f-87ec-e9604e6e09e5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:15.572792 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3ddcc-9807-420f-87ec-e9604e6e09e5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:15.583521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:15.608949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a332468-7bbc-417a-afa4-ca4a41c3fe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:15.609605 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a332468-7bbc-417a-afa4-ca4a41c3fe66 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:15.609905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a332468-7bbc-417a-afa4-ca4a41c3fe66 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:15.610175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a332468-7bbc-417a-afa4-ca4a41c3fe66 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:15.610903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a332468-7bbc-417a-afa4-ca4a41c3fe66 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:15.611198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a332468-7bbc-417a-afa4-ca4a41c3fe66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:15.612560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a332468-7bbc-417a-afa4-ca4a41c3fe66 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:15.617818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 480/987] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 20 19:16:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:15.623579 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b0154-4db3-4bb9-91d7-1acf28c0a2c2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:15.724907 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b0154-4db3-4bb9-91d7-1acf28c0a2c2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:15.759145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79498ba5-7b88-4f19-b596-196898a30f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:15.759795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79498ba5-7b88-4f19-b596-196898a30f5e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:15.760070 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79498ba5-7b88-4f19-b596-196898a30f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:15.760340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79498ba5-7b88-4f19-b596-196898a30f5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:15.761118 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79498ba5-7b88-4f19-b596-196898a30f5e None admin] RBAC: Adding query filter params (interface=public, service_id=5f4032e54a20469bbb9c718ecdb2c6da, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:15.761422 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79498ba5-7b88-4f19-b596-196898a30f5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:15.762807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79498ba5-7b88-4f19-b596-196898a30f5e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:15.768755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 508/988] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jul 20 19:16:15 2022] GET /identity/v3/endpoints?service_id=5f4032e54a20469bbb9c718ecdb2c6da&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:15.774226 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a332468-7bbc-417a-afa4-ca4a41c3fe66 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:15.876384 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a332468-7bbc-417a-afa4-ca4a41c3fe66 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:15.916705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd466d6a-b707-409e-9c2f-c609dd99364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:15.917428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466d6a-b707-409e-9c2f-c609dd99364f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:15.917710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466d6a-b707-409e-9c2f-c609dd99364f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:15.917980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466d6a-b707-409e-9c2f-c609dd99364f None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:15.918803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd466d6a-b707-409e-9c2f-c609dd99364f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:15.920888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd466d6a-b707-409e-9c2f-c609dd99364f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:15.934724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 481/989] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 20 19:16:15 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:16:16.366858 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf0ef4-ee80-424c-9d98-896c108ec281 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:16.367231 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf0ef4-ee80-424c-9d98-896c108ec281 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:16.367411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf0ef4-ee80-424c-9d98-896c108ec281 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:16.368810 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 509/990] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:16.374793 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc03cf-2841-4085-8f38-3fd5979e196e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:16.375255 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc03cf-2841-4085-8f38-3fd5979e196e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:16.375532 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc03cf-2841-4085-8f38-3fd5979e196e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:16.394963 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bccc03cf-2841-4085-8f38-3fd5979e196e None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:16.396493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bccc03cf-2841-4085-8f38-3fd5979e196e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:16.426810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:16.464662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 482/991] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:16.488204 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf0ef4-ee80-424c-9d98-896c108ec281 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:16.507160 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:16.597112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf0ef4-ee80-424c-9d98-896c108ec281 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:16.631458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aeaf7-cc18-473e-8684-6dc14e1cd068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:16.632333 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aeaf7-cc18-473e-8684-6dc14e1cd068 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:16.632613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aeaf7-cc18-473e-8684-6dc14e1cd068 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:16.632934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aeaf7-cc18-473e-8684-6dc14e1cd068 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:16.633879 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aeaf7-cc18-473e-8684-6dc14e1cd068 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:16.635303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aeaf7-cc18-473e-8684-6dc14e1cd068 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7a8aeaf7-cc18-473e-8684-6dc14e1cd068 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:16.648446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:16.649453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:16.650299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:16.650299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:16.650299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:16.650299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:16.650299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:16.650299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:16.650299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:16.650299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:16.650299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:16.650299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:16.650299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:16:16.650299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:16.650299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:16:16.650299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:16.654789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 510/992] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 20 19:16:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:16.656219 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc03cf-2841-4085-8f38-3fd5979e196e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:16.756623 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc03cf-2841-4085-8f38-3fd5979e196e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:16.794234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556862fe-e7ce-4d09-9d85-592cf2b26724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:16.794931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556862fe-e7ce-4d09-9d85-592cf2b26724 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:16.795214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556862fe-e7ce-4d09-9d85-592cf2b26724 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:16.795489 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556862fe-e7ce-4d09-9d85-592cf2b26724 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:16.796222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556862fe-e7ce-4d09-9d85-592cf2b26724 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:16.796524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556862fe-e7ce-4d09-9d85-592cf2b26724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:16.797891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556862fe-e7ce-4d09-9d85-592cf2b26724 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:16.809293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 483/993] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jul 20 19:16:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:16.809566 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aeaf7-cc18-473e-8684-6dc14e1cd068 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:16.894878 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:16.913694 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aeaf7-cc18-473e-8684-6dc14e1cd068 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:16.949236 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b33586-3f1e-415b-a2ab-9771e5c7f2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:16.949897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b33586-3f1e-415b-a2ab-9771e5c7f2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:16.950174 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b33586-3f1e-415b-a2ab-9771e5c7f2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:16.950438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b33586-3f1e-415b-a2ab-9771e5c7f2b0 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:16.951172 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b33586-3f1e-415b-a2ab-9771e5c7f2b0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:16.951469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b33586-3f1e-415b-a2ab-9771e5c7f2b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:16.953124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b33586-3f1e-415b-a2ab-9771e5c7f2b0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:16.958190 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 511/994] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jul 20 19:16:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:16.963829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556862fe-e7ce-4d09-9d85-592cf2b26724 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:16.996121 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:17.070334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556862fe-e7ce-4d09-9d85-592cf2b26724 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:17.106836 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da1787-481a-467b-8d37-70e7e528e91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:17.107494 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1787-481a-467b-8d37-70e7e528e91f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:17.107759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1787-481a-467b-8d37-70e7e528e91f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:17.108123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1787-481a-467b-8d37-70e7e528e91f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:17.108889 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da1787-481a-467b-8d37-70e7e528e91f None admin] RBAC: Adding query filter params (interface=admin, service_id=fc85be829efc4b2a82336082dc820d4f, region_id=RegionOne) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:17.109189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da1787-481a-467b-8d37-70e7e528e91f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:17.110548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da1787-481a-467b-8d37-70e7e528e91f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:17.120970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 484/995] 10.222.0.16 () {56 vars in 1249 bytes} [Wed Jul 20 19:16:16 2022] GET /identity/v3/endpoints?service_id=fc85be829efc4b2a82336082dc820d4f&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:17.121920 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b33586-3f1e-415b-a2ab-9771e5c7f2b0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:17.170445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d9a34-fce8-4136-a5f1-f10d401535a6 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:17.171399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d9a34-fce8-4136-a5f1-f10d401535a6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:17.171676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d9a34-fce8-4136-a5f1-f10d401535a6 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:17.173194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 485/996] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:16:17.178297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c65e0-d4c2-4109-9722-b7fb251417c6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:17.178621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c65e0-d4c2-4109-9722-b7fb251417c6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:17.178877 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c65e0-d4c2-4109-9722-b7fb251417c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:17.196228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d23c65e0-d4c2-4109-9722-b7fb251417c6 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:17.197443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d23c65e0-d4c2-4109-9722-b7fb251417c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:17.229824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b33586-3f1e-415b-a2ab-9771e5c7f2b0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:17.268065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bb8f9-1d51-4d24-bbeb-76e53a2bf773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:17.269138 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bb8f9-1d51-4d24-bbeb-76e53a2bf773 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:17.269416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bb8f9-1d51-4d24-bbeb-76e53a2bf773 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:17.269687 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bb8f9-1d51-4d24-bbeb-76e53a2bf773 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:17.270393 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bb8f9-1d51-4d24-bbeb-76e53a2bf773 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:17.271010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 486/997] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:17.271832 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bb8f9-1d51-4d24-bbeb-76e53a2bf773 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:17.278468 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 512/998] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 20 19:16:17 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:16:17.298560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c65e0-d4c2-4109-9722-b7fb251417c6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:17.330039 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:17.412327 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c65e0-d4c2-4109-9722-b7fb251417c6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:17.457361 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9addb7-c082-456d-8401-c2a6c927adac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:17.458096 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9addb7-c082-456d-8401-c2a6c927adac None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:17.458376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9addb7-c082-456d-8401-c2a6c927adac None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:17.458645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9addb7-c082-456d-8401-c2a6c927adac None admin] PATH_INFO: `/v3/services/image` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:17.459367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9addb7-c082-456d-8401-c2a6c927adac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:17.460722 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9addb7-c082-456d-8401-c2a6c927adac None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-2b9addb7-c082-456d-8401-c2a6c927adac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:17.474707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:17.475822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:17.476690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:17.476690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:17.476690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:17.476690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:17.476690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:17.476690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:17.476690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:17.476690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:17.476690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:17.476690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:17.476690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:16:17.476690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:17.476690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:16:17.476690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:17.476690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 487/999] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jul 20 19:16:17 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:17.482851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bb8f9-1d51-4d24-bbeb-76e53a2bf773 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:17.500606 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:17.618571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bb8f9-1d51-4d24-bbeb-76e53a2bf773 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:17.656009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4807d-d19a-4a1f-9c71-f727faca73f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:17.656936 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4807d-d19a-4a1f-9c71-f727faca73f9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:17.657368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4807d-d19a-4a1f-9c71-f727faca73f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:17.657782 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4807d-d19a-4a1f-9c71-f727faca73f9 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:17.658708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4807d-d19a-4a1f-9c71-f727faca73f9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:17.659022 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4807d-d19a-4a1f-9c71-f727faca73f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:17.660447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4807d-d19a-4a1f-9c71-f727faca73f9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:17.666022 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 513/1000] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:17.672052 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9addb7-c082-456d-8401-c2a6c927adac None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:17.779502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:17.789785 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9addb7-c082-456d-8401-c2a6c927adac None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:17.826357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665832d-3837-4e9d-a632-e39df9ec54e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:17.828187 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665832d-3837-4e9d-a632-e39df9ec54e6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:17.828731 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665832d-3837-4e9d-a632-e39df9ec54e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:17.829091 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665832d-3837-4e9d-a632-e39df9ec54e6 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:17.830319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665832d-3837-4e9d-a632-e39df9ec54e6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:17.830809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665832d-3837-4e9d-a632-e39df9ec54e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:17.832295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665832d-3837-4e9d-a632-e39df9ec54e6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:17.842707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 488/1001] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:18.012300 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cf906-a50f-4f0e-beb0-c2ef0e622d49 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:18.012640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cf906-a50f-4f0e-beb0-c2ef0e622d49 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:18.012861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cf906-a50f-4f0e-beb0-c2ef0e622d49 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:18.015345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 514/1002] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:18.020623 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732aee7-3ccc-4bba-a100-150a58156c13 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:18.020916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732aee7-3ccc-4bba-a100-150a58156c13 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:18.021192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732aee7-3ccc-4bba-a100-150a58156c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:18.039696 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2732aee7-3ccc-4bba-a100-150a58156c13 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:18.040813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2732aee7-3ccc-4bba-a100-150a58156c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:18.114722 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 489/1003] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:18.137286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cf906-a50f-4f0e-beb0-c2ef0e622d49 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:18.213500 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:18.245628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cf906-a50f-4f0e-beb0-c2ef0e622d49 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:18.285489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e813e-4eb5-4c5a-9a69-d24ff6eb0360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:18.286660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e813e-4eb5-4c5a-9a69-d24ff6eb0360 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:18.287215 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e813e-4eb5-4c5a-9a69-d24ff6eb0360 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:18.287694 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e813e-4eb5-4c5a-9a69-d24ff6eb0360 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:18.288575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e813e-4eb5-4c5a-9a69-d24ff6eb0360 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:18.290247 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e813e-4eb5-4c5a-9a69-d24ff6eb0360 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-313e813e-4eb5-4c5a-9a69-d24ff6eb0360 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:18.303032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:18.304089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:18.310619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:18.310619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:18.310619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:18.310619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:18.310619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:18.310619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:18.310619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:18.310619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:18.310619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:18.310619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:18.310619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:16:18.310619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:18.310619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:16:18.310619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:18.310619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 515/1004] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:16:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:18.312154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732aee7-3ccc-4bba-a100-150a58156c13 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:18.400916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:18.418485 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732aee7-3ccc-4bba-a100-150a58156c13 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:18.455613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8daaa-a814-4860-a275-e76f049e0e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:18.456340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8daaa-a814-4860-a275-e76f049e0e7c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:18.456574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8daaa-a814-4860-a275-e76f049e0e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:18.456846 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8daaa-a814-4860-a275-e76f049e0e7c None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:18.457576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8daaa-a814-4860-a275-e76f049e0e7c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:18.457878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8daaa-a814-4860-a275-e76f049e0e7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:18.459395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8daaa-a814-4860-a275-e76f049e0e7c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:18.465059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 490/1005] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 20 19:16:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:18.471310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e813e-4eb5-4c5a-9a69-d24ff6eb0360 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:18.578780 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e813e-4eb5-4c5a-9a69-d24ff6eb0360 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:18.613766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ae492-cad2-458d-ac68-533b72a02aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:18.614427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ae492-cad2-458d-ac68-533b72a02aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:18.614724 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ae492-cad2-458d-ac68-533b72a02aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:18.615000 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ae492-cad2-458d-ac68-533b72a02aa2 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:18.615710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ae492-cad2-458d-ac68-533b72a02aa2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:18.616010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ae492-cad2-458d-ac68-533b72a02aa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:18.617393 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ae492-cad2-458d-ac68-533b72a02aa2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:18.619485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:18.623356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 516/1006] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jul 20 19:16:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:18.628933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8daaa-a814-4860-a275-e76f049e0e7c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:18.729112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8daaa-a814-4860-a275-e76f049e0e7c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:18.764332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da4737-7c79-4fd1-900f-5f52480e1556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:18.764987 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da4737-7c79-4fd1-900f-5f52480e1556 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:18.765269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da4737-7c79-4fd1-900f-5f52480e1556 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:18.765539 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da4737-7c79-4fd1-900f-5f52480e1556 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:18.766285 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da4737-7c79-4fd1-900f-5f52480e1556 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:18.767684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da4737-7c79-4fd1-900f-5f52480e1556 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:18.835347 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 491/1007] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 20 19:16:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:16:19.388821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b92cf3-00d5-410c-ba78-2c991205067b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:19.389713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b92cf3-00d5-410c-ba78-2c991205067b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:19.390184 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b92cf3-00d5-410c-ba78-2c991205067b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:19.392091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 517/1008] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:19.397317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340eaae0-b521-4b0d-a7f0-aa87bf869e53 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:19.397600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340eaae0-b521-4b0d-a7f0-aa87bf869e53 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:19.397872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340eaae0-b521-4b0d-a7f0-aa87bf869e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:19.403918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:19.415352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-340eaae0-b521-4b0d-a7f0-aa87bf869e53 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:19.416558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-340eaae0-b521-4b0d-a7f0-aa87bf869e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:19.493169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 492/1009] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:19 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:19.517238 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b92cf3-00d5-410c-ba78-2c991205067b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:19.623946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b92cf3-00d5-410c-ba78-2c991205067b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:19.658364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328f23f-d083-4d9d-9cee-fd592916f90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:19.659211 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328f23f-d083-4d9d-9cee-fd592916f90a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:19.659492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328f23f-d083-4d9d-9cee-fd592916f90a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:19.659760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328f23f-d083-4d9d-9cee-fd592916f90a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:19.660417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328f23f-d083-4d9d-9cee-fd592916f90a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:19.661798 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328f23f-d083-4d9d-9cee-fd592916f90a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a328f23f-d083-4d9d-9cee-fd592916f90a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:19.674756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:19.675791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:19.676652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:19.676652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:19.676652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:19.676652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:19.676652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:19.676652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:19.676652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:19.676652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:19.676652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:19.676652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:19.676652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:16:19.676652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:19.676652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:16:19.676652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:19.676652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 518/1010] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jul 20 19:16:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:19.682098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340eaae0-b521-4b0d-a7f0-aa87bf869e53 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:19.790018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340eaae0-b521-4b0d-a7f0-aa87bf869e53 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:19.820800 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:19.827927 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231fe81-018b-4cd3-82fe-5e06756a5a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:19.828632 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231fe81-018b-4cd3-82fe-5e06756a5a70 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:19.828906 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231fe81-018b-4cd3-82fe-5e06756a5a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:19.829234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231fe81-018b-4cd3-82fe-5e06756a5a70 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:19.829881 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231fe81-018b-4cd3-82fe-5e06756a5a70 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:19.830185 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231fe81-018b-4cd3-82fe-5e06756a5a70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:19.832340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231fe81-018b-4cd3-82fe-5e06756a5a70 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:19.837560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 493/1011] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jul 20 19:16:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:19.844201 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328f23f-d083-4d9d-9cee-fd592916f90a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:19.910417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:19.931878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb0e00-f900-4d1c-915f-c78618868c69 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:19.932168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb0e00-f900-4d1c-915f-c78618868c69 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:19.932444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb0e00-f900-4d1c-915f-c78618868c69 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:19.933843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 494/1012] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:16:19.939307 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72d26c-260d-4367-ad84-eac820fa0318 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:19.939591 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72d26c-260d-4367-ad84-eac820fa0318 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:19.939871 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72d26c-260d-4367-ad84-eac820fa0318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:19.951504 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328f23f-d083-4d9d-9cee-fd592916f90a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:19.960410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ce72d26c-260d-4367-ad84-eac820fa0318 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:19.961630 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ce72d26c-260d-4367-ad84-eac820fa0318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:19.998552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7e475-7c50-40b8-bde2-055a4e155799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:19.999266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7e475-7c50-40b8-bde2-055a4e155799 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:19.999548 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7e475-7c50-40b8-bde2-055a4e155799 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:19.999948 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7e475-7c50-40b8-bde2-055a4e155799 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:20.000784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7e475-7c50-40b8-bde2-055a4e155799 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:20.001127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7e475-7c50-40b8-bde2-055a4e155799 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:20.002472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7e475-7c50-40b8-bde2-055a4e155799 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:20.007953 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 519/1013] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jul 20 19:16:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:20.013441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7e475-7c50-40b8-bde2-055a4e155799 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:20.035737 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 495/1014] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:19 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:20.059670 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72d26c-260d-4367-ad84-eac820fa0318 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:20.126747 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7e475-7c50-40b8-bde2-055a4e155799 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:20.155820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:20.165653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be819a51-19b2-4985-bfff-e427ea0105aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:20.165653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be819a51-19b2-4985-bfff-e427ea0105aa None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:20.165904 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72d26c-260d-4367-ad84-eac820fa0318 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:20.165987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be819a51-19b2-4985-bfff-e427ea0105aa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:20.166237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be819a51-19b2-4985-bfff-e427ea0105aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:20.167031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be819a51-19b2-4985-bfff-e427ea0105aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:20.168710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be819a51-19b2-4985-bfff-e427ea0105aa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:20.190717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:20.201127 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04487fcb-ca2d-4732-b383-f2050d005927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:20.202413 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04487fcb-ca2d-4732-b383-f2050d005927 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:20.202884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04487fcb-ca2d-4732-b383-f2050d005927 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:20.203161 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04487fcb-ca2d-4732-b383-f2050d005927 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:20.203956 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04487fcb-ca2d-4732-b383-f2050d005927 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:20.205329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04487fcb-ca2d-4732-b383-f2050d005927 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:20.274865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 520/1015] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 20 19:16:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:16:20.305166 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 496/1016] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 20 19:16:20 2022] POST /identity/v3/services => generated 242 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:16:21.028524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49908712-18f8-4854-b8e2-8ac0358cf9aa None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:21.029045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49908712-18f8-4854-b8e2-8ac0358cf9aa None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:21.029148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49908712-18f8-4854-b8e2-8ac0358cf9aa None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:21.030886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 521/1017] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:21.036115 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefc341-a6d7-4afc-8c20-0f80eb4a6030 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:21.036569 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefc341-a6d7-4afc-8c20-0f80eb4a6030 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:21.036692 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefc341-a6d7-4afc-8c20-0f80eb4a6030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:21.054090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-fcefc341-a6d7-4afc-8c20-0f80eb4a6030 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:21.055340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fcefc341-a6d7-4afc-8c20-0f80eb4a6030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:21.138581 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 497/1018] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:21.162176 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49908712-18f8-4854-b8e2-8ac0358cf9aa None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:21.268060 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49908712-18f8-4854-b8e2-8ac0358cf9aa None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:21.305601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b944da9-4893-4db4-a8bd-0b27c4c537cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:21.306698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b944da9-4893-4db4-a8bd-0b27c4c537cf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:21.307004 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b944da9-4893-4db4-a8bd-0b27c4c537cf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:21.307277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b944da9-4893-4db4-a8bd-0b27c4c537cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:21.318035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b944da9-4893-4db4-a8bd-0b27c4c537cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0b944da9-4893-4db4-a8bd-0b27c4c537cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:16:21.326485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:21.327533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:21.333316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:21.333316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:21.333316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:21.333316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:21.333316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:16:21.333316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:16:21.333316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:16:21.333316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:16:21.333316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:16:21.333316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:16:21.333316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:16:21.333316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:21.333316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 522/1019] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jul 20 19:16:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:21.335499 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefc341-a6d7-4afc-8c20-0f80eb4a6030 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:21.442426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefc341-a6d7-4afc-8c20-0f80eb4a6030 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:21.454730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:21.479933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7a40c-eeca-4409-ad1a-3319bc606d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:21.480617 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7a40c-eeca-4409-ad1a-3319bc606d9d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:21.480899 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7a40c-eeca-4409-ad1a-3319bc606d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:21.481172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7a40c-eeca-4409-ad1a-3319bc606d9d None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:21.481931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7a40c-eeca-4409-ad1a-3319bc606d9d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:21.482232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7a40c-eeca-4409-ad1a-3319bc606d9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:21.484653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7a40c-eeca-4409-ad1a-3319bc606d9d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:21.499176 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 498/1020] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 20 19:16:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:21.500873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b944da9-4893-4db4-a8bd-0b27c4c537cf None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:21.557301 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:21.608575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b944da9-4893-4db4-a8bd-0b27c4c537cf None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:21.641678 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfa54a-2a12-409b-ba39-9f9d96c40cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:21.642484 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfa54a-2a12-409b-ba39-9f9d96c40cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:21.642993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfa54a-2a12-409b-ba39-9f9d96c40cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:21.643320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfa54a-2a12-409b-ba39-9f9d96c40cb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:21.656617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfa54a-2a12-409b-ba39-9f9d96c40cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:21.658092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfa54a-2a12-409b-ba39-9f9d96c40cb2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:21.675146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-babfa54a-2a12-409b-ba39-9f9d96c40cb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:21.675146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:21.675146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:21.675146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:21.675146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:21.675146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:21.675146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:21.675146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:21.675146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:21.675146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:21.675146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:21.675146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:21.675146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:16:21.675146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:16:21.675146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:21.676179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:21.677075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:16:21.677075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:16:21.677075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:21.677075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:21.681351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 523/1021] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:21.682720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7a40c-eeca-4409-ad1a-3319bc606d9d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:21.783167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7a40c-eeca-4409-ad1a-3319bc606d9d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:21.818847 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff21ec-c2d1-44c8-b10d-8a7c6a8bf49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:21.819075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff21ec-c2d1-44c8-b10d-8a7c6a8bf49d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:21.819365 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff21ec-c2d1-44c8-b10d-8a7c6a8bf49d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:21.819699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff21ec-c2d1-44c8-b10d-8a7c6a8bf49d None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:21.820567 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff21ec-c2d1-44c8-b10d-8a7c6a8bf49d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:21.820868 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff21ec-c2d1-44c8-b10d-8a7c6a8bf49d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:21.822414 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff21ec-c2d1-44c8-b10d-8a7c6a8bf49d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:21.838713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 499/1022] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:21.841380 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfa54a-2a12-409b-ba39-9f9d96c40cb2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:21.943405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:21.947097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfa54a-2a12-409b-ba39-9f9d96c40cb2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:21.981329 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cbd23-965d-489b-a4e2-6d48a4188b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:21.982126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cbd23-965d-489b-a4e2-6d48a4188b68 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:21.982963 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cbd23-965d-489b-a4e2-6d48a4188b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:21.983247 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cbd23-965d-489b-a4e2-6d48a4188b68 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:21.997669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cbd23-965d-489b-a4e2-6d48a4188b68 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:21.999960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cbd23-965d-489b-a4e2-6d48a4188b68 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-125cbd23-965d-489b-a4e2-6d48a4188b68 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:16:22.016444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:22.017483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:22.018434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:22.018434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:22.018434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:16:22.018434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:16:22.018434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:16:22.018434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:16:22.018434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:16:22.018434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:16:22.018434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:16:22.018434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:22.022511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 524/1023] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jul 20 19:16:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:22.023983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff21ec-c2d1-44c8-b10d-8a7c6a8bf49d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:22.058181 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:22.128965 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff21ec-c2d1-44c8-b10d-8a7c6a8bf49d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:22.163855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05165b26-9939-4628-a071-57dfd2d41870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:22.164526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05165b26-9939-4628-a071-57dfd2d41870 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:22.164845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05165b26-9939-4628-a071-57dfd2d41870 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:22.165115 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05165b26-9939-4628-a071-57dfd2d41870 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:22.165941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05165b26-9939-4628-a071-57dfd2d41870 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:22.166255 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05165b26-9939-4628-a071-57dfd2d41870 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:22.167708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05165b26-9939-4628-a071-57dfd2d41870 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:22.191679 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 500/1024] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 20 19:16:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:22.193335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cbd23-965d-489b-a4e2-6d48a4188b68 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:22.307099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cbd23-965d-489b-a4e2-6d48a4188b68 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:22.343741 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d21334-b83d-47d4-980d-825430addea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:22.344353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d21334-b83d-47d4-980d-825430addea3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:22.344629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d21334-b83d-47d4-980d-825430addea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:22.344891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d21334-b83d-47d4-980d-825430addea3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:22.372918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:22.391023 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a7ee7-6030-4648-a7d9-8b4407a782f8 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:22.391207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a7ee7-6030-4648-a7d9-8b4407a782f8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:22.391491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a7ee7-6030-4648-a7d9-8b4407a782f8 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:22.393077 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 501/1025] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:16:22.398081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037167c-f238-4bac-bd43-4e26fcd7d8b2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:22.398365 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037167c-f238-4bac-bd43-4e26fcd7d8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:22.398645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037167c-f238-4bac-bd43-4e26fcd7d8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:22.416538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0037167c-f238-4bac-bd43-4e26fcd7d8b2 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:22.417175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d21334-b83d-47d4-980d-825430addea3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:22.417720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0037167c-f238-4bac-bd43-4e26fcd7d8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:22.418629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d21334-b83d-47d4-980d-825430addea3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:22.489236 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 502/1026] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:22.490518 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fead3-e2ae-43b7-b297-b6ef7ef993f5 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:22.490836 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fead3-e2ae-43b7-b297-b6ef7ef993f5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:22.491110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fead3-e2ae-43b7-b297-b6ef7ef993f5 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:22.492492 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 503/1027] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:22.497505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8168512-ba3c-4b32-a85b-bb43d41d4666 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:22.497790 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8168512-ba3c-4b32-a85b-bb43d41d4666 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:22.498732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8168512-ba3c-4b32-a85b-bb43d41d4666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:22.516347 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a8168512-ba3c-4b32-a85b-bb43d41d4666 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:22.517542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a8168512-ba3c-4b32-a85b-bb43d41d4666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:22.524025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 525/1028] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:16:22 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:22.526437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d21334-b83d-47d4-980d-825430addea3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:22.532549 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:22.586197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:22.590360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 504/1029] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:22.591235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8168512-ba3c-4b32-a85b-bb43d41d4666 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:22.630655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d21334-b83d-47d4-980d-825430addea3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:22.663326 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b9b79-bd8d-4d5b-93ea-9e77f6367e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:22.664109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b9b79-bd8d-4d5b-93ea-9e77f6367e66 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:22.664385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b9b79-bd8d-4d5b-93ea-9e77f6367e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:22.664650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b9b79-bd8d-4d5b-93ea-9e77f6367e66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:22.665823 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b9b79-bd8d-4d5b-93ea-9e77f6367e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:22.667334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b9b79-bd8d-4d5b-93ea-9e77f6367e66 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:22.669102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 526/1030] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:22.669770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b9b79-bd8d-4d5b-93ea-9e77f6367e66 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:22.692526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8168512-ba3c-4b32-a85b-bb43d41d4666 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:22.726492 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ceed2-33dd-4185-a098-eb0816c5945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:22.727341 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ceed2-33dd-4185-a098-eb0816c5945f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:22.727622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ceed2-33dd-4185-a098-eb0816c5945f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:22.727894 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ceed2-33dd-4185-a098-eb0816c5945f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:22.738521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ceed2-33dd-4185-a098-eb0816c5945f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:22.740008 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ceed2-33dd-4185-a098-eb0816c5945f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:22.758224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-074ceed2-33dd-4185-a098-eb0816c5945f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:22.758224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:22.758224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:22.758224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:22.758224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:22.758224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:22.758224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:22.758224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:22.758224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:22.758224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:22.758224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:22.758224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:22.758224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:16:22.758224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:16:22.758224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:22.759377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:22.760280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:16:22.760280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:16:22.760280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:22.760280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:22.760280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 505/1031] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:22.760280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ceed2-33dd-4185-a098-eb0816c5945f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:22.763008 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:22.772797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b9b79-bd8d-4d5b-93ea-9e77f6367e66 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:22.799773 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:22.807565 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5c5bc-f94a-47cb-828e-017aefac7a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:22.808351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c5bc-f94a-47cb-828e-017aefac7a38 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:22.808630 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c5bc-f94a-47cb-828e-017aefac7a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:22.808949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c5bc-f94a-47cb-828e-017aefac7a38 None admin] PATH_INFO: `/v3/services/image` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:22.809551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5c5bc-f94a-47cb-828e-017aefac7a38 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:22.810968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5c5bc-f94a-47cb-828e-017aefac7a38 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2dd5c5bc-f94a-47cb-828e-017aefac7a38 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:22.823115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:22.824242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:22.825123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:22.825123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:22.825123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:22.825123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:22.825123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:22.825123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:22.825123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:22.825123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:22.825123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:22.825123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:22.825123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:16:22.825123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:22.825123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:16:22.825123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:22.825123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 527/1032] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jul 20 19:16:22 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:22.825941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5c5bc-f94a-47cb-828e-017aefac7a38 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:22.869389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ceed2-33dd-4185-a098-eb0816c5945f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:22.903762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f774d9e-0ad5-4b89-b9ba-a7069aa66462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:22.905084 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f774d9e-0ad5-4b89-b9ba-a7069aa66462 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:22.905425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f774d9e-0ad5-4b89-b9ba-a7069aa66462 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:22.905693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f774d9e-0ad5-4b89-b9ba-a7069aa66462 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:22.906394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f774d9e-0ad5-4b89-b9ba-a7069aa66462 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:22.907863 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f774d9e-0ad5-4b89-b9ba-a7069aa66462 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:22.945276 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5c5bc-f94a-47cb-828e-017aefac7a38 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:22.963583 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99348b1-b8bf-4b83-b99a-7152ef5ebcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:22.964241 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99348b1-b8bf-4b83-b99a-7152ef5ebcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:22.964520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99348b1-b8bf-4b83-b99a-7152ef5ebcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:22.964793 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99348b1-b8bf-4b83-b99a-7152ef5ebcd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:22.965508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99348b1-b8bf-4b83-b99a-7152ef5ebcd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:22.965810 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99348b1-b8bf-4b83-b99a-7152ef5ebcd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:22.967764 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99348b1-b8bf-4b83-b99a-7152ef5ebcd4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:22.979479 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 528/1033] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:22.980338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99348b1-b8bf-4b83-b99a-7152ef5ebcd4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:23.012356 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 506/1034] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 20 19:16:22 2022] POST /identity/v3/projects => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:16:23.012356 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f774d9e-0ad5-4b89-b9ba-a7069aa66462 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:23.047278 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:23.083446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:23.108587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99348b1-b8bf-4b83-b99a-7152ef5ebcd4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:23.133854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f774d9e-0ad5-4b89-b9ba-a7069aa66462 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:23.160217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf9fff-ff10-4af8-852f-ec763812453e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:23.161266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf9fff-ff10-4af8-852f-ec763812453e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:23.161727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf9fff-ff10-4af8-852f-ec763812453e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:23.162182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf9fff-ff10-4af8-852f-ec763812453e None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:23.163429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf9fff-ff10-4af8-852f-ec763812453e None admin] RBAC: Adding query filter params (name=image) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:23.163935 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf9fff-ff10-4af8-852f-ec763812453e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:23.165920 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf9fff-ff10-4af8-852f-ec763812453e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:23.181539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 529/1035] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:23.188303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf9fff-ff10-4af8-852f-ec763812453e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:23.189423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33e38d-868f-4bc9-9faf-47c1001748f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:23.190906 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33e38d-868f-4bc9-9faf-47c1001748f0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:23.190906 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33e38d-868f-4bc9-9faf-47c1001748f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:23.190906 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33e38d-868f-4bc9-9faf-47c1001748f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:23.200721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33e38d-868f-4bc9-9faf-47c1001748f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:23.202851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33e38d-868f-4bc9-9faf-47c1001748f0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:23.219317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-bc33e38d-868f-4bc9-9faf-47c1001748f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:23.219317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:23.219317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:23.219317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:23.219317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:23.219317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:23.219317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:23.219317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:23.219317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:23.219317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:23.219317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:23.219317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:23.219317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:16:23.219317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:16:23.219317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:23.220306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:23.221237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:16:23.221237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:16:23.221237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:16:23.221237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:16:23.221237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:16:23.221237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:16:23.221237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:23.221237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:23.221237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 507/1036] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:23.227722 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33e38d-868f-4bc9-9faf-47c1001748f0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:23.320298 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf9fff-ff10-4af8-852f-ec763812453e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:23.339818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:23.344274 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33e38d-868f-4bc9-9faf-47c1001748f0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:23.358892 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:23.360649 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f7f43-9c8d-42af-af93-248b4b243b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:23.361327 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f7f43-9c8d-42af-af93-248b4b243b1c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:23.361610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f7f43-9c8d-42af-af93-248b4b243b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:23.361881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f7f43-9c8d-42af-af93-248b4b243b1c None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:23.362612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f7f43-9c8d-42af-af93-248b4b243b1c None admin] RBAC: Adding query filter params (type=image) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:23.362946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f7f43-9c8d-42af-af93-248b4b243b1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:23.364403 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f7f43-9c8d-42af-af93-248b4b243b1c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:23.375904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 530/1037] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:23.376818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f7f43-9c8d-42af-af93-248b4b243b1c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:23.381934 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc654b8-7d4e-4d30-b355-baf16534bbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:23.382612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc654b8-7d4e-4d30-b355-baf16534bbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:23.387030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc654b8-7d4e-4d30-b355-baf16534bbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:23.387030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc654b8-7d4e-4d30-b355-baf16534bbe8 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:23.387030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc654b8-7d4e-4d30-b355-baf16534bbe8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:23.387030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc654b8-7d4e-4d30-b355-baf16534bbe8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:23.387030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc654b8-7d4e-4d30-b355-baf16534bbe8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:23.398733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 508/1038] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:16:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:23.405618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc654b8-7d4e-4d30-b355-baf16534bbe8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:23.495685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f7f43-9c8d-42af-af93-248b4b243b1c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:23.528345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc654b8-7d4e-4d30-b355-baf16534bbe8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:23.534866 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5de5dc-0cb6-4e99-85ae-d50474e499db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:23.535548 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5de5dc-0cb6-4e99-85ae-d50474e499db None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:23.535873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5de5dc-0cb6-4e99-85ae-d50474e499db None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:23.536167 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5de5dc-0cb6-4e99-85ae-d50474e499db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:23.537386 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5de5dc-0cb6-4e99-85ae-d50474e499db None admin] RBAC: Adding query filter params (interface=public, service_id=066a071998ed42f8b68f1e5ee7e4bd8c, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:23.537386 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5de5dc-0cb6-4e99-85ae-d50474e499db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:23.539524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5de5dc-0cb6-4e99-85ae-d50474e499db None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:23.548527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 531/1039] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jul 20 19:16:23 2022] GET /identity/v3/endpoints?service_id=066a071998ed42f8b68f1e5ee7e4bd8c&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:23.554696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5de5dc-0cb6-4e99-85ae-d50474e499db None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:23.578607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329c32f-3ef4-4c8a-b090-e877fbbd8962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:23.579410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329c32f-3ef4-4c8a-b090-e877fbbd8962 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:23.579574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329c32f-3ef4-4c8a-b090-e877fbbd8962 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:23.579827 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329c32f-3ef4-4c8a-b090-e877fbbd8962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:23.580721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329c32f-3ef4-4c8a-b090-e877fbbd8962 None admin] RBAC: Adding query filter params (role.id=38e63ce23c6d46878d5d205ba76ca2fb, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=e3fd38ebb5514af686204d0b02a91edd) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:23.581029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329c32f-3ef4-4c8a-b090-e877fbbd8962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:23.582458 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329c32f-3ef4-4c8a-b090-e877fbbd8962 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:23.588342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 509/1040] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:16:23 2022] GET /identity/v3/role_assignments?user.id=e3fd38ebb5514af686204d0b02a91edd&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=38e63ce23c6d46878d5d205ba76ca2fb => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:23.618870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:23.682101 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5de5dc-0cb6-4e99-85ae-d50474e499db None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:23.721222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8f0f3-8e62-4af8-8403-5ab7eb3eefc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:23.722197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8f0f3-8e62-4af8-8403-5ab7eb3eefc3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:23.722628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8f0f3-8e62-4af8-8403-5ab7eb3eefc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:23.723086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8f0f3-8e62-4af8-8403-5ab7eb3eefc3 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:23.723957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8f0f3-8e62-4af8-8403-5ab7eb3eefc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:23.725529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8f0f3-8e62-4af8-8403-5ab7eb3eefc3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:23.738261 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 532/1041] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 20 19:16:23 2022] GET /identity/v3/services => generated 1957 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:16:25.132118 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b01c0-2f51-485a-9c92-f3a5e540464b None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:25.132648 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b01c0-2f51-485a-9c92-f3a5e540464b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:25.132648 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b01c0-2f51-485a-9c92-f3a5e540464b None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:25.134156 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 510/1042] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:25.139520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04276025-98b1-4af4-bc43-301bb4c7556d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:25.139969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04276025-98b1-4af4-bc43-301bb4c7556d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:25.140044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04276025-98b1-4af4-bc43-301bb4c7556d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:25.157134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-04276025-98b1-4af4-bc43-301bb4c7556d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:25.158300 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-04276025-98b1-4af4-bc43-301bb4c7556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:25.255891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 533/1043] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:25.283383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b01c0-2f51-485a-9c92-f3a5e540464b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:25.329997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:25.397115 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b01c0-2f51-485a-9c92-f3a5e540464b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:25.432675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddaba4-1f94-476f-98d6-629881a661b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:25.433527 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddaba4-1f94-476f-98d6-629881a661b2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:25.433736 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddaba4-1f94-476f-98d6-629881a661b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:25.434001 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddaba4-1f94-476f-98d6-629881a661b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:25.435277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddaba4-1f94-476f-98d6-629881a661b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:25.436713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddaba4-1f94-476f-98d6-629881a661b2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:25.443012 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 511/1044] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:25.444570 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04276025-98b1-4af4-bc43-301bb4c7556d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:25.487733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:25.550858 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04276025-98b1-4af4-bc43-301bb4c7556d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:25.586648 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4cf21-ec2c-4c03-baa0-a2f4270eb542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:25.587344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4cf21-ec2c-4c03-baa0-a2f4270eb542 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:25.587619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4cf21-ec2c-4c03-baa0-a2f4270eb542 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:25.587892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4cf21-ec2c-4c03-baa0-a2f4270eb542 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:25.588608 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4cf21-ec2c-4c03-baa0-a2f4270eb542 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:25.590043 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4cf21-ec2c-4c03-baa0-a2f4270eb542 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:25.659185 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941cb38-92dc-4c1b-91fa-c61dbdfd23d6 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:25.659570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941cb38-92dc-4c1b-91fa-c61dbdfd23d6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:25.659908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941cb38-92dc-4c1b-91fa-c61dbdfd23d6 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:25.661587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 512/1045] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:25.666696 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc723bc-d1c3-4e97-b566-bdb800899543 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:25.666985 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc723bc-d1c3-4e97-b566-bdb800899543 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:25.667256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc723bc-d1c3-4e97-b566-bdb800899543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:25.675229 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 534/1046] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:16:25 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:16:25.691753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9fc723bc-d1c3-4e97-b566-bdb800899543 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:25.692838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9fc723bc-d1c3-4e97-b566-bdb800899543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:25.771912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 513/1047] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:25.795337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4cf21-ec2c-4c03-baa0-a2f4270eb542 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:25.824039 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92da4b5-0156-4914-accb-8a774d781740 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:25.824335 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92da4b5-0156-4914-accb-8a774d781740 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:25.824616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92da4b5-0156-4914-accb-8a774d781740 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:25.826905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 514/1048] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:16:25.832440 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73d49d-5b14-425a-a40b-ea2bdd3a315f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:25.832736 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73d49d-5b14-425a-a40b-ea2bdd3a315f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:25.833080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73d49d-5b14-425a-a40b-ea2bdd3a315f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:25.850326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8d73d49d-5b14-425a-a40b-ea2bdd3a315f None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:25.851564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8d73d49d-5b14-425a-a40b-ea2bdd3a315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:25.883876 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:25.909568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:25.917290 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4cf21-ec2c-4c03-baa0-a2f4270eb542 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:25.933785 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 515/1049] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:25.956038 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31017d87-f31a-414f-b666-0ab8b23ed077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:25.956856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31017d87-f31a-414f-b666-0ab8b23ed077 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:25.957139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31017d87-f31a-414f-b666-0ab8b23ed077 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:25.957480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31017d87-f31a-414f-b666-0ab8b23ed077 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:25.958297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73d49d-5b14-425a-a40b-ea2bdd3a315f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:25.968973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31017d87-f31a-414f-b666-0ab8b23ed077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-31017d87-f31a-414f-b666-0ab8b23ed077 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:16:25.979097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:25.980222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:25.981351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:25.981351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:25.981351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:25.981351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:25.981351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:16:25.981351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:16:25.981351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:16:25.981351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:16:25.981351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:16:25.981351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:16:25.981351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:16:25.981351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:25.981351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 535/1050] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jul 20 19:16:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:25.987070 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31017d87-f31a-414f-b666-0ab8b23ed077 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:26.078411 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73d49d-5b14-425a-a40b-ea2bdd3a315f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:26.096525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31017d87-f31a-414f-b666-0ab8b23ed077 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:26.114917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02202ee5-5781-4e88-915a-4ff5af97c74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:26.115796 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02202ee5-5781-4e88-915a-4ff5af97c74e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:26.116081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02202ee5-5781-4e88-915a-4ff5af97c74e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:26.116353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02202ee5-5781-4e88-915a-4ff5af97c74e None admin] PATH_INFO: `/v3/services/image` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:26.117504 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02202ee5-5781-4e88-915a-4ff5af97c74e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:26.118920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02202ee5-5781-4e88-915a-4ff5af97c74e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-02202ee5-5781-4e88-915a-4ff5af97c74e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:26.131441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:26.137766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:26.139570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:26.139570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:26.139570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:26.139570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:26.139570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:26.139570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:26.139570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:26.139570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:26.139570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:26.139570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:26.139570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:16:26.139570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:16:26.139570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:16:26.139570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:26.140510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2627c-a515-40e4-83f2-cdedd4d434ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:26.140510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2627c-a515-40e4-83f2-cdedd4d434ce None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:26.140510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2627c-a515-40e4-83f2-cdedd4d434ce None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:26.140510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2627c-a515-40e4-83f2-cdedd4d434ce None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:26.141065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 516/1051] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jul 20 19:16:25 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:26.141145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2627c-a515-40e4-83f2-cdedd4d434ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:26.141145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2627c-a515-40e4-83f2-cdedd4d434ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:26.141145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2627c-a515-40e4-83f2-cdedd4d434ce None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:26.141321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02202ee5-5781-4e88-915a-4ff5af97c74e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:26.151343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 536/1052] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 20 19:16:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:26.157038 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2627c-a515-40e4-83f2-cdedd4d434ce None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:26.175172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:26.177990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:26.259609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02202ee5-5781-4e88-915a-4ff5af97c74e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:26.267210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2627c-a515-40e4-83f2-cdedd4d434ce None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:26.306198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03931dc8-6dce-435e-b86d-f59eeeed4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:26.306907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03931dc8-6dce-435e-b86d-f59eeeed4b05 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:26.307192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03931dc8-6dce-435e-b86d-f59eeeed4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:26.307293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736087c3-43a4-4cd7-a962-e4c556e5ae82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:26.307474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03931dc8-6dce-435e-b86d-f59eeeed4b05 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:26.308187 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03931dc8-6dce-435e-b86d-f59eeeed4b05 None admin] RBAC: Adding query filter params (name=image) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:26.308288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736087c3-43a4-4cd7-a962-e4c556e5ae82 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:26.308486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03931dc8-6dce-435e-b86d-f59eeeed4b05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:26.308579 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736087c3-43a4-4cd7-a962-e4c556e5ae82 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:26.308869 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736087c3-43a4-4cd7-a962-e4c556e5ae82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:26.309871 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03931dc8-6dce-435e-b86d-f59eeeed4b05 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:26.321100 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 517/1053] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:26.321277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736087c3-43a4-4cd7-a962-e4c556e5ae82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:26.321594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736087c3-43a4-4cd7-a962-e4c556e5ae82 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:26.322227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03931dc8-6dce-435e-b86d-f59eeeed4b05 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:26.340567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-736087c3-43a4-4cd7-a962-e4c556e5ae82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:26.340567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:26.340567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:26.340567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:26.340567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:26.340567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:26.340567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:26.340567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:26.340567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:26.340567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:26.340567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:26.340567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:26.340567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:16:26.340567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:16:26.340567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:26.341767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:26.343126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:16:26.343126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:16:26.343126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:26.343126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:26.343126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 537/1054] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:16:26.348188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736087c3-43a4-4cd7-a962-e4c556e5ae82 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:26.423054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:26.438726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:26.445469 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03931dc8-6dce-435e-b86d-f59eeeed4b05 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:26.457714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736087c3-43a4-4cd7-a962-e4c556e5ae82 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:26.480812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6ec9e-910e-44fe-af0e-77c4bec03c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:26.481508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6ec9e-910e-44fe-af0e-77c4bec03c61 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:26.481792 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6ec9e-910e-44fe-af0e-77c4bec03c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:26.482988 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6ec9e-910e-44fe-af0e-77c4bec03c61 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:26.483800 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6ec9e-910e-44fe-af0e-77c4bec03c61 None admin] RBAC: Adding query filter params (type=image) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:26.484103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6ec9e-910e-44fe-af0e-77c4bec03c61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:26.485455 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6ec9e-910e-44fe-af0e-77c4bec03c61 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:26.491362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 518/1055] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:26.496390 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6ec9e-910e-44fe-af0e-77c4bec03c61 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:26.499556 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dab3cc-d58a-438f-a60c-32fc2b1535d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:26.500231 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dab3cc-d58a-438f-a60c-32fc2b1535d5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:26.500525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dab3cc-d58a-438f-a60c-32fc2b1535d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:26.500784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dab3cc-d58a-438f-a60c-32fc2b1535d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:26.501513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dab3cc-d58a-438f-a60c-32fc2b1535d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:26.501819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dab3cc-d58a-438f-a60c-32fc2b1535d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:26.503233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dab3cc-d58a-438f-a60c-32fc2b1535d5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:26.520566 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 538/1056] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:26.521727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dab3cc-d58a-438f-a60c-32fc2b1535d5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:26.611643 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6ec9e-910e-44fe-af0e-77c4bec03c61 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:26.636972 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dab3cc-d58a-438f-a60c-32fc2b1535d5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:26.648236 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3624ed-2164-4b56-95f8-76ff6be5f2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:26.648897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3624ed-2164-4b56-95f8-76ff6be5f2f0 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:26.649192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3624ed-2164-4b56-95f8-76ff6be5f2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:26.649450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3624ed-2164-4b56-95f8-76ff6be5f2f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:26.650191 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3624ed-2164-4b56-95f8-76ff6be5f2f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:26.651699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3624ed-2164-4b56-95f8-76ff6be5f2f0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:26.664438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:26.672165 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f171cd-7a54-4fed-813a-d416eb35286f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:26.672952 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f171cd-7a54-4fed-813a-d416eb35286f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:26.673234 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f171cd-7a54-4fed-813a-d416eb35286f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:26.673508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f171cd-7a54-4fed-813a-d416eb35286f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:26.681351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f171cd-7a54-4fed-813a-d416eb35286f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:26.682828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f171cd-7a54-4fed-813a-d416eb35286f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-15f171cd-7a54-4fed-813a-d416eb35286f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:16:26.702958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:26.704124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:26.705116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:26.705116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:26.705116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:16:26.705116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:16:26.705116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:16:26.705116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:16:26.705116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:16:26.705116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:16:26.705116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:16:26.705116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:26.705116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 539/1057] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jul 20 19:16:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:26.705116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f171cd-7a54-4fed-813a-d416eb35286f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:26.731281 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 519/1058] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 20 19:16:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:16:26.822048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f171cd-7a54-4fed-813a-d416eb35286f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:26.867863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdfeda-3508-4c5f-a291-19fadf8cb207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:26.868551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdfeda-3508-4c5f-a291-19fadf8cb207 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:26.868831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdfeda-3508-4c5f-a291-19fadf8cb207 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:26.869162 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdfeda-3508-4c5f-a291-19fadf8cb207 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:26.870043 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdfeda-3508-4c5f-a291-19fadf8cb207 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:26.870353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdfeda-3508-4c5f-a291-19fadf8cb207 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:26.871875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdfeda-3508-4c5f-a291-19fadf8cb207 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:26.893166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 540/1059] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 20 19:16:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:26.900092 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3624ed-2164-4b56-95f8-76ff6be5f2f0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:26.919645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:27.008845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3624ed-2164-4b56-95f8-76ff6be5f2f0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:27.042612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f574a-37a1-4ade-b38f-fe345f1e7820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:27.043437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f574a-37a1-4ade-b38f-fe345f1e7820 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:27.043712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f574a-37a1-4ade-b38f-fe345f1e7820 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:27.043983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f574a-37a1-4ade-b38f-fe345f1e7820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:27.055910 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f574a-37a1-4ade-b38f-fe345f1e7820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:27.057357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f574a-37a1-4ade-b38f-fe345f1e7820 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:27.075476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a91f574a-37a1-4ade-b38f-fe345f1e7820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:27.075476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:27.075476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:27.075476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:27.075476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:27.075476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:27.075476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:27.075476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:27.075476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:27.075476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:27.075476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:27.075476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:27.075476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:16:27.075476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:16:27.075476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:27.077163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:27.082938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:16:27.082938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:16:27.082938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:27.082938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:27.082938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 520/1060] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:27.084685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdfeda-3508-4c5f-a291-19fadf8cb207 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:27.130275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:27.189576 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdfeda-3508-4c5f-a291-19fadf8cb207 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:27.231026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37075433-efb8-4919-adc1-6810d9b1bc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:27.231691 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37075433-efb8-4919-adc1-6810d9b1bc14 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:27.232822 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37075433-efb8-4919-adc1-6810d9b1bc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:27.232822 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37075433-efb8-4919-adc1-6810d9b1bc14 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:27.233303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37075433-efb8-4919-adc1-6810d9b1bc14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:27.233610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37075433-efb8-4919-adc1-6810d9b1bc14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:27.235037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37075433-efb8-4919-adc1-6810d9b1bc14 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:27.247285 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 541/1061] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:27.252957 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f574a-37a1-4ade-b38f-fe345f1e7820 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:27.329585 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:27.366007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f574a-37a1-4ade-b38f-fe345f1e7820 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:27.402561 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f0f39-b550-46d7-b39b-d4d685e0936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:27.403385 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f0f39-b550-46d7-b39b-d4d685e0936b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:27.403735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f0f39-b550-46d7-b39b-d4d685e0936b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:27.404168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f0f39-b550-46d7-b39b-d4d685e0936b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:27.411358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f0f39-b550-46d7-b39b-d4d685e0936b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:27.412804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f0f39-b550-46d7-b39b-d4d685e0936b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:27.427508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-dd0f0f39-b550-46d7-b39b-d4d685e0936b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:27.427508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:27.427508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:27.427508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:27.427508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:27.427508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:27.427508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:27.427508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:27.427508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:27.427508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:27.427508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:27.427508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:27.427508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:16:27.427508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:16:27.427508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:27.428423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:27.429354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:16:27.429354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:16:27.429354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:16:27.429354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:16:27.429354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:16:27.429354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:16:27.429354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:27.429354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:27.430995 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 521/1062] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:16:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:27.435397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37075433-efb8-4919-adc1-6810d9b1bc14 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:27.545951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37075433-efb8-4919-adc1-6810d9b1bc14 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:27.547676 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:27.582258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bc606-ab43-4dd6-af78-d56cea58349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:27.582958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bc606-ab43-4dd6-af78-d56cea58349e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:27.583219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bc606-ab43-4dd6-af78-d56cea58349e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:27.583492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bc606-ab43-4dd6-af78-d56cea58349e None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:27.584281 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bc606-ab43-4dd6-af78-d56cea58349e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:27.584588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bc606-ab43-4dd6-af78-d56cea58349e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:27.586395 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bc606-ab43-4dd6-af78-d56cea58349e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:27.599147 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 542/1063] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:16:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:27.605426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f0f39-b550-46d7-b39b-d4d685e0936b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:27.712685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f0f39-b550-46d7-b39b-d4d685e0936b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:27.740696 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:27.750388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1873e-eaf6-4594-9a58-025b09c0feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:27.751313 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1873e-eaf6-4594-9a58-025b09c0feef None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:27.751588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1873e-eaf6-4594-9a58-025b09c0feef None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:27.751856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1873e-eaf6-4594-9a58-025b09c0feef None admin] PATH_INFO: `/v3/projects/50abbf0c38634795be669ec69da1f06d/users/e3fd38ebb5514af686204d0b02a91edd/roles/38e63ce23c6d46878d5d205ba76ca2fb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:27.754165 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1873e-eaf6-4594-9a58-025b09c0feef None admin] RBAC: Authorizing `identity:create_grant(project_id=50abbf0c38634795be669ec69da1f06d, user_id=e3fd38ebb5514af686204d0b02a91edd, role_id=38e63ce23c6d46878d5d205ba76ca2fb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:27.755618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1873e-eaf6-4594-9a58-025b09c0feef None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:27.828690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 522/1064] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:16:27 2022] PUT /identity/v3/projects/50abbf0c38634795be669ec69da1f06d/users/e3fd38ebb5514af686204d0b02a91edd/roles/38e63ce23c6d46878d5d205ba76ca2fb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:16:27.880501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea9286-1ff7-443b-a3c6-ab132f6dc7dd None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:27.880798 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea9286-1ff7-443b-a3c6-ab132f6dc7dd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:27.881283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea9286-1ff7-443b-a3c6-ab132f6dc7dd None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:27.883283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 543/1065] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:27.889856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a9bf8-ff5d-41f3-8507-5985e71230e2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:27.890184 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a9bf8-ff5d-41f3-8507-5985e71230e2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:27.890417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a9bf8-ff5d-41f3-8507-5985e71230e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:27.911144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8a0a9bf8-ff5d-41f3-8507-5985e71230e2 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:27.912733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8a0a9bf8-ff5d-41f3-8507-5985e71230e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:28.002583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 523/1066] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:28.026199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea9286-1ff7-443b-a3c6-ab132f6dc7dd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:28.136622 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea9286-1ff7-443b-a3c6-ab132f6dc7dd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:28.172301 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844600f5-fd4b-4d75-93af-cbba63424bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:28.173092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844600f5-fd4b-4d75-93af-cbba63424bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:28.173372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844600f5-fd4b-4d75-93af-cbba63424bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:28.173716 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844600f5-fd4b-4d75-93af-cbba63424bd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:28.184176 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844600f5-fd4b-4d75-93af-cbba63424bd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-844600f5-fd4b-4d75-93af-cbba63424bd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:16:28.192411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:28.193791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:28.199624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:28.199624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:28.199624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:28.199624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:28.199624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:16:28.199624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:16:28.199624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:16:28.199624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:16:28.199624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:16:28.199624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:16:28.199624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:16:28.199624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:28.199624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 544/1067] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:16:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:28.202125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a9bf8-ff5d-41f3-8507-5985e71230e2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:28.316687 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a9bf8-ff5d-41f3-8507-5985e71230e2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:28.334768 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:28.353766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f907e90-9404-45db-ae2d-2feb41c55593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:28.354441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f907e90-9404-45db-ae2d-2feb41c55593 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:28.354873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f907e90-9404-45db-ae2d-2feb41c55593 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:28.355007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f907e90-9404-45db-ae2d-2feb41c55593 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:28.355768 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f907e90-9404-45db-ae2d-2feb41c55593 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:28.356075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f907e90-9404-45db-ae2d-2feb41c55593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:28.358608 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f907e90-9404-45db-ae2d-2feb41c55593 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:28.367658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 524/1068] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:16:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:28.373577 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844600f5-fd4b-4d75-93af-cbba63424bd5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:28.401463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:28.484210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844600f5-fd4b-4d75-93af-cbba63424bd5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:28.520642 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1c12d-28b0-487d-b580-ee410789d9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:28.521515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1c12d-28b0-487d-b580-ee410789d9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:28.521795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1c12d-28b0-487d-b580-ee410789d9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:28.522069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1c12d-28b0-487d-b580-ee410789d9f8 None admin] PATH_INFO: `/v3/users/e79df0cc78424216822b30aab9e60afb` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:28.537027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1c12d-28b0-487d-b580-ee410789d9f8 None admin] RBAC: Authorizing `identity:get_user(user_id=e79df0cc78424216822b30aab9e60afb)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:28.538540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1c12d-28b0-487d-b580-ee410789d9f8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:28.545340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 545/1069] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:16:28 2022] GET /identity/v3/users/e79df0cc78424216822b30aab9e60afb => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:28.547144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f907e90-9404-45db-ae2d-2feb41c55593 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:28.661153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f907e90-9404-45db-ae2d-2feb41c55593 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:28.696350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810e5a4-ea04-44a2-854f-dfcb65b32372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:28.697064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810e5a4-ea04-44a2-854f-dfcb65b32372 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:28.697348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810e5a4-ea04-44a2-854f-dfcb65b32372 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:28.697658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810e5a4-ea04-44a2-854f-dfcb65b32372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:28.744788 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:28.767993 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810e5a4-ea04-44a2-854f-dfcb65b32372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:28.769674 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810e5a4-ea04-44a2-854f-dfcb65b32372 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:28.828908 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b8430-ae95-4096-9146-032ade94b0e7 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:28.829190 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b8430-ae95-4096-9146-032ade94b0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:28.829467 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b8430-ae95-4096-9146-032ade94b0e7 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:28.831128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 546/1070] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:16:28.836177 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a74342-ac8c-4f9e-b3a2-52e519591bd6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:28.836469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a74342-ac8c-4f9e-b3a2-52e519591bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:28.836754 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a74342-ac8c-4f9e-b3a2-52e519591bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:28.857870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-79a74342-ac8c-4f9e-b3a2-52e519591bd6 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:28.859092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-79a74342-ac8c-4f9e-b3a2-52e519591bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:28.874709 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 525/1071] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:16:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:28.880341 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810e5a4-ea04-44a2-854f-dfcb65b32372 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:28.935341 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 547/1072] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:28.955971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a74342-ac8c-4f9e-b3a2-52e519591bd6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:28.965228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:28.968222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:28.991656 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810e5a4-ea04-44a2-854f-dfcb65b32372 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:29.027090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01aad1-23b1-475c-9187-b50e0e5f3f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:29.027950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01aad1-23b1-475c-9187-b50e0e5f3f8b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:29.028230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01aad1-23b1-475c-9187-b50e0e5f3f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:29.029335 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01aad1-23b1-475c-9187-b50e0e5f3f8b None admin] PATH_INFO: `/v3/projects/0350028977754bcf9eed4690b2f98af5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:29.031370 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01aad1-23b1-475c-9187-b50e0e5f3f8b None admin] RBAC: Authorizing `identity:get_project(project_id=0350028977754bcf9eed4690b2f98af5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:29.032937 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01aad1-23b1-475c-9187-b50e0e5f3f8b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:29.039879 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 526/1073] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:16:28 2022] GET /identity/v3/projects/0350028977754bcf9eed4690b2f98af5 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:29.040952 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01aad1-23b1-475c-9187-b50e0e5f3f8b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:29.063195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a74342-ac8c-4f9e-b3a2-52e519591bd6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:29.100245 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4391f7-cf26-4621-bb75-50b0cb93565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:29.101007 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4391f7-cf26-4621-bb75-50b0cb93565b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:29.101283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4391f7-cf26-4621-bb75-50b0cb93565b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:29.101570 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4391f7-cf26-4621-bb75-50b0cb93565b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:29.144507 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01aad1-23b1-475c-9187-b50e0e5f3f8b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:29.177151 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4391f7-cf26-4621-bb75-50b0cb93565b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:29.179031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4391f7-cf26-4621-bb75-50b0cb93565b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:29.179183 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251eb4b-79ca-4170-932d-a0ada7b8dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:29.179817 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251eb4b-79ca-4170-932d-a0ada7b8dc9d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:29.180406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251eb4b-79ca-4170-932d-a0ada7b8dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:29.180682 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251eb4b-79ca-4170-932d-a0ada7b8dc9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:29.181715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251eb4b-79ca-4170-932d-a0ada7b8dc9d None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=0350028977754bcf9eed4690b2f98af5, user.id=e79df0cc78424216822b30aab9e60afb) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:29.182841 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251eb4b-79ca-4170-932d-a0ada7b8dc9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:29.184275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251eb4b-79ca-4170-932d-a0ada7b8dc9d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:29.190716 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:29.191368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 527/1074] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:16:29 2022] GET /identity/v3/role_assignments?user.id=e79df0cc78424216822b30aab9e60afb&scope.project.id=0350028977754bcf9eed4690b2f98af5&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:29.311492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 548/1075] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:16:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 19:16:29.312735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251eb4b-79ca-4170-932d-a0ada7b8dc9d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:29.326316 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:29.422960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251eb4b-79ca-4170-932d-a0ada7b8dc9d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:29.457876 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47984e-59e0-403d-ae45-787ceca8c699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:29.458588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47984e-59e0-403d-ae45-787ceca8c699 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:29.458890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47984e-59e0-403d-ae45-787ceca8c699 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:29.459161 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47984e-59e0-403d-ae45-787ceca8c699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:29.470715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47984e-59e0-403d-ae45-787ceca8c699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:29.472174 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47984e-59e0-403d-ae45-787ceca8c699 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:29.490061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3b47984e-59e0-403d-ae45-787ceca8c699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:29.490061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:29.490061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:29.490061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:29.490061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:29.490061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:29.490061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:29.490061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:29.490061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:29.490061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:29.490061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:29.490061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:29.490061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:16:29.490061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:16:29.490061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:29.491106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:29.492074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:16:29.492074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:16:29.492074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:29.492074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:29.492074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 528/1076] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:16:29.499024 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4391f7-cf26-4621-bb75-50b0cb93565b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:29.602271 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4391f7-cf26-4621-bb75-50b0cb93565b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:29.614169 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:29.640275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621a1b7-5c81-4204-bfc8-4bea43ffaa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:29.640947 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621a1b7-5c81-4204-bfc8-4bea43ffaa9d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:29.641229 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621a1b7-5c81-4204-bfc8-4bea43ffaa9d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:29.641507 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621a1b7-5c81-4204-bfc8-4bea43ffaa9d None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:29.642232 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621a1b7-5c81-4204-bfc8-4bea43ffaa9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:29.642537 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621a1b7-5c81-4204-bfc8-4bea43ffaa9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:29.645205 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621a1b7-5c81-4204-bfc8-4bea43ffaa9d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:29.662719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 549/1077] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:29.938266 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760017-30d7-4897-bca5-ba44efd5c76f None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:29.938558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760017-30d7-4897-bca5-ba44efd5c76f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:29.938847 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760017-30d7-4897-bca5-ba44efd5c76f None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:29.940292 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 529/1078] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:29.946163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74777b93-1fee-4242-b61d-de22372a6799 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:29.946458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74777b93-1fee-4242-b61d-de22372a6799 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:29.946789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74777b93-1fee-4242-b61d-de22372a6799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:29.968396 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-74777b93-1fee-4242-b61d-de22372a6799 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:29.970036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-74777b93-1fee-4242-b61d-de22372a6799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:30.042265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 550/1079] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:30.065716 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e760017-30d7-4897-bca5-ba44efd5c76f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:30.132177 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:30.171789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e760017-30d7-4897-bca5-ba44efd5c76f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:30.205564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2cbb1-9528-4baa-90b5-81932b9da314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:30.206291 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2cbb1-9528-4baa-90b5-81932b9da314 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:30.206569 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2cbb1-9528-4baa-90b5-81932b9da314 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:30.206867 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2cbb1-9528-4baa-90b5-81932b9da314 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:30.217427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2cbb1-9528-4baa-90b5-81932b9da314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-6da2cbb1-9528-4baa-90b5-81932b9da314 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:16:30.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:30.226765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:30.227672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:30.227672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:30.227672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:30.227672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:30.227672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:16:30.227672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:16:30.227672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:16:30.227672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:16:30.227672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:16:30.227672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:16:30.227672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:16:30.227672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:30.227672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 530/1080] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jul 20 19:16:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:30.233282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74777b93-1fee-4242-b61d-de22372a6799 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:30.337910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:30.340844 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74777b93-1fee-4242-b61d-de22372a6799 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:30.377343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a0ee2-6e4a-4e8f-8974-c163aa0512f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:30.378002 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a0ee2-6e4a-4e8f-8974-c163aa0512f2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:30.378278 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a0ee2-6e4a-4e8f-8974-c163aa0512f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:30.378546 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a0ee2-6e4a-4e8f-8974-c163aa0512f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:30.379325 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a0ee2-6e4a-4e8f-8974-c163aa0512f2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:30.379625 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a0ee2-6e4a-4e8f-8974-c163aa0512f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:30.381003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a0ee2-6e4a-4e8f-8974-c163aa0512f2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:30.390327 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 551/1081] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 20 19:16:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:30.396008 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2cbb1-9528-4baa-90b5-81932b9da314 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:30.497644 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2cbb1-9528-4baa-90b5-81932b9da314 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:30.520415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:30.532819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42121282-488d-459d-88f0-5e599b1539be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:30.533631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42121282-488d-459d-88f0-5e599b1539be None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:30.533952 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42121282-488d-459d-88f0-5e599b1539be None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:30.534222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42121282-488d-459d-88f0-5e599b1539be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:30.545985 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42121282-488d-459d-88f0-5e599b1539be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:30.547448 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42121282-488d-459d-88f0-5e599b1539be None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:30.564946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-42121282-488d-459d-88f0-5e599b1539be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:30.564946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:30.564946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:30.564946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:30.564946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:30.564946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:30.564946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:30.564946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:30.564946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:30.564946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:30.564946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:30.564946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:30.564946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:16:30.564946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:16:30.564946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:30.565947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:30.566900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:16:30.566900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:16:30.566900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:30.566900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:30.570853 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 531/1082] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:30.572195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a0ee2-6e4a-4e8f-8974-c163aa0512f2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:30.677673 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a0ee2-6e4a-4e8f-8974-c163aa0512f2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:30.711259 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55fb23-576e-4018-9671-37f9eb3a712b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:30.711906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55fb23-576e-4018-9671-37f9eb3a712b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:30.712181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55fb23-576e-4018-9671-37f9eb3a712b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:30.712446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55fb23-576e-4018-9671-37f9eb3a712b None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:30.713154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55fb23-576e-4018-9671-37f9eb3a712b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:30.713448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55fb23-576e-4018-9671-37f9eb3a712b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:30.714863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55fb23-576e-4018-9671-37f9eb3a712b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:30.727993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 552/1083] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:30.733992 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42121282-488d-459d-88f0-5e599b1539be None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:30.833660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42121282-488d-459d-88f0-5e599b1539be None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:30.868328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32418a-e16c-41ff-9dc6-29261dc89cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:30.869124 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32418a-e16c-41ff-9dc6-29261dc89cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:30.869404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32418a-e16c-41ff-9dc6-29261dc89cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:30.869672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32418a-e16c-41ff-9dc6-29261dc89cb5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:30.877574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32418a-e16c-41ff-9dc6-29261dc89cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:30.879041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32418a-e16c-41ff-9dc6-29261dc89cb5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3f32418a-e16c-41ff-9dc6-29261dc89cb5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:16:30.893908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:30.895102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:30.896456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:30.896456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:30.896456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:16:30.896456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:16:30.896456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:16:30.896456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:16:30.896456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:16:30.896456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:16:30.896456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:16:30.896456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:30.896456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 532/1084] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jul 20 19:16:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:30.900819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55fb23-576e-4018-9671-37f9eb3a712b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:30.926334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:31.004626 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55fb23-576e-4018-9671-37f9eb3a712b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:31.039654 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c418e-b234-4f41-95fb-a0b05c38e5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:31.040316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c418e-b234-4f41-95fb-a0b05c38e5ab None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:31.040590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c418e-b234-4f41-95fb-a0b05c38e5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:31.040855 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c418e-b234-4f41-95fb-a0b05c38e5ab None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:31.041682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c418e-b234-4f41-95fb-a0b05c38e5ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:31.041983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c418e-b234-4f41-95fb-a0b05c38e5ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:31.043440 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c418e-b234-4f41-95fb-a0b05c38e5ab None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:31.061847 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 553/1085] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jul 20 19:16:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:31.067526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32418a-e16c-41ff-9dc6-29261dc89cb5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:31.101188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:31.168031 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32418a-e16c-41ff-9dc6-29261dc89cb5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:31.201611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c9600-ed3c-4fd2-91ed-76d5088712ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:31.202255 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c9600-ed3c-4fd2-91ed-76d5088712ed None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:31.202532 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c9600-ed3c-4fd2-91ed-76d5088712ed None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:31.202837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c9600-ed3c-4fd2-91ed-76d5088712ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:31.269014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac9f40-eb16-469d-8447-09bf38acc994 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:31.269289 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac9f40-eb16-469d-8447-09bf38acc994 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:31.269558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac9f40-eb16-469d-8447-09bf38acc994 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:31.271301 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 554/1086] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:16:31.274379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c9600-ed3c-4fd2-91ed-76d5088712ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:31.275883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c9600-ed3c-4fd2-91ed-76d5088712ed None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:31.276755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dadae-d380-494e-b41c-53bfeb9a4bc8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:31.277036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dadae-d380-494e-b41c-53bfeb9a4bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:31.277307 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dadae-d380-494e-b41c-53bfeb9a4bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:31.298615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-339dadae-d380-494e-b41c-53bfeb9a4bc8 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:31.299835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-339dadae-d380-494e-b41c-53bfeb9a4bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:31.312918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:31.368858 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 555/1087] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:16:31.384709 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 533/1088] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:16:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 19:16:31.385907 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dadae-d380-494e-b41c-53bfeb9a4bc8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:31.391719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c9600-ed3c-4fd2-91ed-76d5088712ed None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:31.398955 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:31.487154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dadae-d380-494e-b41c-53bfeb9a4bc8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:31.491241 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c9600-ed3c-4fd2-91ed-76d5088712ed None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:31.522971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e412e-cbe6-4e2e-8799-fcc31ce3834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:31.523758 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e412e-cbe6-4e2e-8799-fcc31ce3834a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:31.524035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e412e-cbe6-4e2e-8799-fcc31ce3834a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:31.524305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e412e-cbe6-4e2e-8799-fcc31ce3834a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:31.525688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daed030-6107-496b-ba9e-94ab9d16259e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:31.526474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daed030-6107-496b-ba9e-94ab9d16259e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:31.526781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daed030-6107-496b-ba9e-94ab9d16259e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:31.527058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daed030-6107-496b-ba9e-94ab9d16259e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:31.529606 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:31.535949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e412e-cbe6-4e2e-8799-fcc31ce3834a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:31.537894 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e412e-cbe6-4e2e-8799-fcc31ce3834a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:31.538560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daed030-6107-496b-ba9e-94ab9d16259e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3daed030-6107-496b-ba9e-94ab9d16259e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:16:31.546712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:31.547860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:31.548928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:31.548928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:31.548928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:31.548928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:31.548928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:16:31.548928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:16:31.548928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:16:31.548928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:16:31.548928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:16:31.548928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:16:31.548928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:16:31.548928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:31.548928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 534/1089] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:16:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:16:31.553931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daed030-6107-496b-ba9e-94ab9d16259e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:31.558447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f47e412e-cbe6-4e2e-8799-fcc31ce3834a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:31.558447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:31.558447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:31.558447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:31.558447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:31.558447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:31.558447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:31.558447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:31.558447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:31.558447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:31.558447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:31.558447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:31.558447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:16:31.558447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:16:31.558447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:31.559571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:31.560820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:16:31.560820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:16:31.560820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:16:31.560820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:31.560820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 556/1090] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:31.569711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e412e-cbe6-4e2e-8799-fcc31ce3834a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:31.634036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:31.659540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daed030-6107-496b-ba9e-94ab9d16259e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:31.675851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e412e-cbe6-4e2e-8799-fcc31ce3834a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:31.692980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8c14d-2012-47d2-b87c-700d975b7466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:31.693649 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8c14d-2012-47d2-b87c-700d975b7466 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:31.693935 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8c14d-2012-47d2-b87c-700d975b7466 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:31.694209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8c14d-2012-47d2-b87c-700d975b7466 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:31.694988 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8c14d-2012-47d2-b87c-700d975b7466 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:31.695296 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8c14d-2012-47d2-b87c-700d975b7466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:31.696666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8c14d-2012-47d2-b87c-700d975b7466 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:31.705299 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 535/1091] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:16:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:31.711079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8c14d-2012-47d2-b87c-700d975b7466 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:31.716348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0beb4-b534-4d0d-9e25-b21d9c249ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:31.717013 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0beb4-b534-4d0d-9e25-b21d9c249ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:31.717287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0beb4-b534-4d0d-9e25-b21d9c249ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:31.717554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0beb4-b534-4d0d-9e25-b21d9c249ff1 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:31.718285 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0beb4-b534-4d0d-9e25-b21d9c249ff1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:31.718583 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0beb4-b534-4d0d-9e25-b21d9c249ff1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:31.719996 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0beb4-b534-4d0d-9e25-b21d9c249ff1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:31.732552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 557/1092] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:31.738151 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0beb4-b534-4d0d-9e25-b21d9c249ff1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:31.766408 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:31.811270 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8c14d-2012-47d2-b87c-700d975b7466 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:31.843113 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0beb4-b534-4d0d-9e25-b21d9c249ff1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:31.845031 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217ff7b-3d4b-4485-b030-f7bbfe01fb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:31.845905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217ff7b-3d4b-4485-b030-f7bbfe01fb8d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:31.846179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217ff7b-3d4b-4485-b030-f7bbfe01fb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:31.846449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217ff7b-3d4b-4485-b030-f7bbfe01fb8d None admin] PATH_INFO: `/v3/users/e79df0cc78424216822b30aab9e60afb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:31.848013 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217ff7b-3d4b-4485-b030-f7bbfe01fb8d None admin] RBAC: Authorizing `identity:get_user(user_id=e79df0cc78424216822b30aab9e60afb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:31.849144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217ff7b-3d4b-4485-b030-f7bbfe01fb8d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:31.855502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 536/1093] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:16:31 2022] GET /identity/v3/users/e79df0cc78424216822b30aab9e60afb => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:31.857264 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217ff7b-3d4b-4485-b030-f7bbfe01fb8d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:31.866090 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:31.878754 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5548db4-5ed6-4d0f-9d98-c66742182227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:31.879551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5548db4-5ed6-4d0f-9d98-c66742182227 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:31.879831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5548db4-5ed6-4d0f-9d98-c66742182227 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:31.880101 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5548db4-5ed6-4d0f-9d98-c66742182227 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:31.887054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5548db4-5ed6-4d0f-9d98-c66742182227 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:31.889198 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5548db4-5ed6-4d0f-9d98-c66742182227 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:31.903831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e5548db4-5ed6-4d0f-9d98-c66742182227 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:31.903831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:31.903831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:31.903831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:31.903831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:31.903831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:31.903831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:31.903831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:31.903831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:31.903831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:31.903831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:31.903831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:31.903831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:16:31.903831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:16:31.903831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:31.904789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:31.905826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:16:31.905826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:16:31.905826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:16:31.905826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:16:31.905826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:16:31.905826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:16:31.905826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:16:31.905826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:16:31.905826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 558/1094] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:16:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:16:31.910784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5548db4-5ed6-4d0f-9d98-c66742182227 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:31.958150 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217ff7b-3d4b-4485-b030-f7bbfe01fb8d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:31.980810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:31.991666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95e40f-d1e6-49bf-a833-f3eecaf68206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:31.992509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95e40f-d1e6-49bf-a833-f3eecaf68206 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:31.992788 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95e40f-d1e6-49bf-a833-f3eecaf68206 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:31.993054 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95e40f-d1e6-49bf-a833-f3eecaf68206 None admin] PATH_INFO: `/v3/projects/0350028977754bcf9eed4690b2f98af5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:31.994237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95e40f-d1e6-49bf-a833-f3eecaf68206 None admin] RBAC: Authorizing `identity:get_project(project_id=0350028977754bcf9eed4690b2f98af5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:31.995700 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95e40f-d1e6-49bf-a833-f3eecaf68206 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:31.997925 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 537/1095] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:16:31 2022] GET /identity/v3/projects/0350028977754bcf9eed4690b2f98af5 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:32.004112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95e40f-d1e6-49bf-a833-f3eecaf68206 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:32.012000 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5548db4-5ed6-4d0f-9d98-c66742182227 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:32.047759 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b536a62-326f-48aa-a55a-711081d8e73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:32.048462 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b536a62-326f-48aa-a55a-711081d8e73d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:32.048744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b536a62-326f-48aa-a55a-711081d8e73d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:32.049021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b536a62-326f-48aa-a55a-711081d8e73d None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:32.049806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b536a62-326f-48aa-a55a-711081d8e73d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:32.050115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b536a62-326f-48aa-a55a-711081d8e73d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:32.051598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b536a62-326f-48aa-a55a-711081d8e73d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:32.063877 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 559/1096] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:32.070099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b536a62-326f-48aa-a55a-711081d8e73d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:32.105633 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95e40f-d1e6-49bf-a833-f3eecaf68206 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:32.112685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:32.143402 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3aede-a5be-4b04-8b03-71e88c6004c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:32.144205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3aede-a5be-4b04-8b03-71e88c6004c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:32.144482 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3aede-a5be-4b04-8b03-71e88c6004c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:32.144752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3aede-a5be-4b04-8b03-71e88c6004c3 None admin] PATH_INFO: `/v3/projects/0350028977754bcf9eed4690b2f98af5/users/e79df0cc78424216822b30aab9e60afb/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:32.146776 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3aede-a5be-4b04-8b03-71e88c6004c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0350028977754bcf9eed4690b2f98af5, user_id=e79df0cc78424216822b30aab9e60afb, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:32.148244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3aede-a5be-4b04-8b03-71e88c6004c3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:32.176671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b536a62-326f-48aa-a55a-711081d8e73d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:32.210201 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83866b84-8748-438c-8a85-04a9b59b9461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:32.210890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83866b84-8748-438c-8a85-04a9b59b9461 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:32.211167 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83866b84-8748-438c-8a85-04a9b59b9461 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:32.211436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83866b84-8748-438c-8a85-04a9b59b9461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:32.212259 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83866b84-8748-438c-8a85-04a9b59b9461 None admin] RBAC: Adding query filter params (role.id=38e63ce23c6d46878d5d205ba76ca2fb, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=e3fd38ebb5514af686204d0b02a91edd) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:32.212560 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83866b84-8748-438c-8a85-04a9b59b9461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:32.213987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83866b84-8748-438c-8a85-04a9b59b9461 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:32.215369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 538/1097] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:16:32 2022] PUT /identity/v3/projects/0350028977754bcf9eed4690b2f98af5/users/e79df0cc78424216822b30aab9e60afb/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:16:32.223330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 560/1098] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:16:32 2022] GET /identity/v3/role_assignments?user.id=e3fd38ebb5514af686204d0b02a91edd&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=38e63ce23c6d46878d5d205ba76ca2fb => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:34.318182 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aeccb-ede0-4af3-b623-94c49a33b0f1 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:34.318753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aeccb-ede0-4af3-b623-94c49a33b0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:34.318872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aeccb-ede0-4af3-b623-94c49a33b0f1 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:34.320168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 539/1099] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:34.326287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f0f2b-b65d-43a8-a1ec-c8089e7d0702 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:34.326783 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f0f2b-b65d-43a8-a1ec-c8089e7d0702 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:34.326901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f0f2b-b65d-43a8-a1ec-c8089e7d0702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:34.344990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-656f0f2b-b65d-43a8-a1ec-c8089e7d0702 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:34.346293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-656f0f2b-b65d-43a8-a1ec-c8089e7d0702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:34.420277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 561/1100] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:34.444673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7aeccb-ede0-4af3-b623-94c49a33b0f1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:34.504571 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:34.562500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7aeccb-ede0-4af3-b623-94c49a33b0f1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:34.601576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bb066-5e6b-4dbd-8ca5-c00d0038b619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:34.602360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bb066-5e6b-4dbd-8ca5-c00d0038b619 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:34.602639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bb066-5e6b-4dbd-8ca5-c00d0038b619 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:34.602940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bb066-5e6b-4dbd-8ca5-c00d0038b619 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:34.614532 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bb066-5e6b-4dbd-8ca5-c00d0038b619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5a0bb066-5e6b-4dbd-8ca5-c00d0038b619 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:16:34.622921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:34.624194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:34.625484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:34.625484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:34.625484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:34.625484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:34.625484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:16:34.625484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:16:34.625484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:16:34.625484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:16:34.625484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:16:34.625484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:16:34.625484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:16:34.625484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:34.625484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 540/1101] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:16:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:16:34.630312 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f0f2b-b65d-43a8-a1ec-c8089e7d0702 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:34.664773 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:34.732001 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f0f2b-b65d-43a8-a1ec-c8089e7d0702 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:34.766455 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952427d-8d46-4da7-b6f3-68ea88065d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:34.767146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952427d-8d46-4da7-b6f3-68ea88065d51 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:34.767427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952427d-8d46-4da7-b6f3-68ea88065d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:34.767722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952427d-8d46-4da7-b6f3-68ea88065d51 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:34.768435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952427d-8d46-4da7-b6f3-68ea88065d51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:34.768737 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952427d-8d46-4da7-b6f3-68ea88065d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:34.770110 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952427d-8d46-4da7-b6f3-68ea88065d51 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:34.778829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 562/1102] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:16:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:34.784690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bb066-5e6b-4dbd-8ca5-c00d0038b619 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:34.887816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bb066-5e6b-4dbd-8ca5-c00d0038b619 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:34.900335 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:34.926572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faffaf-f604-4d6e-8f3b-09aa27f2a498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:34.927480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faffaf-f604-4d6e-8f3b-09aa27f2a498 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:34.927757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faffaf-f604-4d6e-8f3b-09aa27f2a498 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:34.928030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faffaf-f604-4d6e-8f3b-09aa27f2a498 None admin] PATH_INFO: `/v3/users/e79df0cc78424216822b30aab9e60afb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:34.929241 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16faffaf-f604-4d6e-8f3b-09aa27f2a498 None admin] RBAC: Authorizing `identity:get_user(user_id=e79df0cc78424216822b30aab9e60afb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:34.931031 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16faffaf-f604-4d6e-8f3b-09aa27f2a498 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:34.932686 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 541/1103] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:16:34 2022] GET /identity/v3/users/e79df0cc78424216822b30aab9e60afb => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:34.938640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952427d-8d46-4da7-b6f3-68ea88065d51 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:35.034768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:35.038573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952427d-8d46-4da7-b6f3-68ea88065d51 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:35.071531 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c1a02-b001-49b8-aeb0-fabe0ed928fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:35.072168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c1a02-b001-49b8-aeb0-fabe0ed928fe None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:35.072446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c1a02-b001-49b8-aeb0-fabe0ed928fe None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:35.072716 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c1a02-b001-49b8-aeb0-fabe0ed928fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:35.139806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c1a02-b001-49b8-aeb0-fabe0ed928fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:35.141184 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c1a02-b001-49b8-aeb0-fabe0ed928fe None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:35.234536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:35.239123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 563/1104] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:16:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:35.245049 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faffaf-f604-4d6e-8f3b-09aa27f2a498 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:35.349638 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faffaf-f604-4d6e-8f3b-09aa27f2a498 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:35.383256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea734fa9-c16a-4039-b7fd-6976033e0656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:35.384109 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734fa9-c16a-4039-b7fd-6976033e0656 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:35.384384 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734fa9-c16a-4039-b7fd-6976033e0656 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:35.384651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734fa9-c16a-4039-b7fd-6976033e0656 None admin] PATH_INFO: `/v3/projects/0350028977754bcf9eed4690b2f98af5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:35.385824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea734fa9-c16a-4039-b7fd-6976033e0656 None admin] RBAC: Authorizing `identity:get_project(project_id=0350028977754bcf9eed4690b2f98af5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:35.387827 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea734fa9-c16a-4039-b7fd-6976033e0656 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:35.389536 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 542/1105] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:16:35 2022] GET /identity/v3/projects/0350028977754bcf9eed4690b2f98af5 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:35.395901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c1a02-b001-49b8-aeb0-fabe0ed928fe None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:35.493243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c1a02-b001-49b8-aeb0-fabe0ed928fe None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:35.526678 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7506f1-f49a-4a7e-b9f5-c3590e3aad02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:35.527345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7506f1-f49a-4a7e-b9f5-c3590e3aad02 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:35.527621 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7506f1-f49a-4a7e-b9f5-c3590e3aad02 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:35.532126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7506f1-f49a-4a7e-b9f5-c3590e3aad02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:35.532126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7506f1-f49a-4a7e-b9f5-c3590e3aad02 None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=0350028977754bcf9eed4690b2f98af5, user.id=e79df0cc78424216822b30aab9e60afb) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:35.532126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7506f1-f49a-4a7e-b9f5-c3590e3aad02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:35.532126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7506f1-f49a-4a7e-b9f5-c3590e3aad02 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:35.536860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 564/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:16:35 2022] GET /identity/v3/role_assignments?user.id=e79df0cc78424216822b30aab9e60afb&scope.project.id=0350028977754bcf9eed4690b2f98af5&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:37.594694 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf0cc1-1109-43f4-8584-740bd3384656 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:37.595211 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf0cc1-1109-43f4-8584-740bd3384656 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:37.595211 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf0cc1-1109-43f4-8584-740bd3384656 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:37.596519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 543/1107] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:37.601758 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeca11e-fe8c-4246-a068-eb1c8dcaf462 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:37.602191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeca11e-fe8c-4246-a068-eb1c8dcaf462 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:37.602284 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeca11e-fe8c-4246-a068-eb1c8dcaf462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:37.618800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8aeca11e-fe8c-4246-a068-eb1c8dcaf462 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:37.620016 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8aeca11e-fe8c-4246-a068-eb1c8dcaf462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:37.675767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:37.686199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 565/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:37.711176 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf0cc1-1109-43f4-8584-740bd3384656 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:37.761757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:37.815833 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf0cc1-1109-43f4-8584-740bd3384656 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:37.848531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036485e9-d9b7-41c8-be44-5ce391328b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:37.849228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036485e9-d9b7-41c8-be44-5ce391328b56 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:37.849502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036485e9-d9b7-41c8-be44-5ce391328b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:37.849766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036485e9-d9b7-41c8-be44-5ce391328b56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:37.850951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036485e9-d9b7-41c8-be44-5ce391328b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:37.852364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036485e9-d9b7-41c8-be44-5ce391328b56 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:37.853962 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 544/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:37.859757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeca11e-fe8c-4246-a068-eb1c8dcaf462 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:37.958070 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeca11e-fe8c-4246-a068-eb1c8dcaf462 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:37.990690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce231e-6292-432e-bdee-623f65ce699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:37.991377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce231e-6292-432e-bdee-623f65ce699a None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:37.991656 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce231e-6292-432e-bdee-623f65ce699a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:37.991926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce231e-6292-432e-bdee-623f65ce699a None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:37.992645 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce231e-6292-432e-bdee-623f65ce699a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:37.994077 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce231e-6292-432e-bdee-623f65ce699a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:38.066549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 566/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:16:37 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:16:40.181115 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95269d98-1d18-49d6-849f-1db79b4fd78e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:40.181682 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95269d98-1d18-49d6-849f-1db79b4fd78e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:40.181682 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95269d98-1d18-49d6-849f-1db79b4fd78e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:40.183063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 545/1111] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:40.188978 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d26d4-f702-46ad-9dd1-f99cf75212f1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:40.189399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d26d4-f702-46ad-9dd1-f99cf75212f1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:40.189539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d26d4-f702-46ad-9dd1-f99cf75212f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:40.206693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-729d26d4-f702-46ad-9dd1-f99cf75212f1 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:40.207883 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-729d26d4-f702-46ad-9dd1-f99cf75212f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:40.252744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:40.275382 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 567/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:40.298970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95269d98-1d18-49d6-849f-1db79b4fd78e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:40.400315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95269d98-1d18-49d6-849f-1db79b4fd78e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:40.415515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:40.433003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e4728-da04-423e-b8f3-78580cfa1458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:40.434371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e4728-da04-423e-b8f3-78580cfa1458 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:40.434643 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e4728-da04-423e-b8f3-78580cfa1458 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:40.434944 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e4728-da04-423e-b8f3-78580cfa1458 None admin] PATH_INFO: `/v3/roles/d73c76bc61c44f3a94e66397b0d9c359` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:40.436418 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e4728-da04-423e-b8f3-78580cfa1458 None admin] RBAC: Authorizing `identity:get_role(role_id=d73c76bc61c44f3a94e66397b0d9c359)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:40.437777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e4728-da04-423e-b8f3-78580cfa1458 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:40.439182 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 546/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:16:40 2022] GET /identity/v3/roles/d73c76bc61c44f3a94e66397b0d9c359 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:40.445103 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d26d4-f702-46ad-9dd1-f99cf75212f1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:40.547896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d26d4-f702-46ad-9dd1-f99cf75212f1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:40.581958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b927ca6-abb6-45aa-8733-05615da0b724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:40.582839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b927ca6-abb6-45aa-8733-05615da0b724 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:40.583114 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b927ca6-abb6-45aa-8733-05615da0b724 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:40.583378 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b927ca6-abb6-45aa-8733-05615da0b724 None admin] PATH_INFO: `/v3/users/e3463119f3864141bb38dd4940d88589` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:40.596440 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b927ca6-abb6-45aa-8733-05615da0b724 None admin] RBAC: Authorizing `identity:get_user(user_id=e3463119f3864141bb38dd4940d88589)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:40.597887 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b927ca6-abb6-45aa-8733-05615da0b724 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:40.599585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 568/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:16:40 2022] GET /identity/v3/users/e3463119f3864141bb38dd4940d88589 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:40.606102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e4728-da04-423e-b8f3-78580cfa1458 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:40.706006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e4728-da04-423e-b8f3-78580cfa1458 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:40.739515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2245491-5da0-489c-b515-65a5101602ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:40.740157 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2245491-5da0-489c-b515-65a5101602ff None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:40.740437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2245491-5da0-489c-b515-65a5101602ff None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:40.740709 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2245491-5da0-489c-b515-65a5101602ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:40.791098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:40.806646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2245491-5da0-489c-b515-65a5101602ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:40.808122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2245491-5da0-489c-b515-65a5101602ff None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:40.904713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 547/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:16:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:40.910725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b927ca6-abb6-45aa-8733-05615da0b724 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:40.945393 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:41.006816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b927ca6-abb6-45aa-8733-05615da0b724 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:41.039350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdb287-d591-470c-8c16-dd83ce0894c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:41.040183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdb287-d591-470c-8c16-dd83ce0894c5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:41.040456 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdb287-d591-470c-8c16-dd83ce0894c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:41.040723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdb287-d591-470c-8c16-dd83ce0894c5 None admin] PATH_INFO: `/v3/projects/0350028977754bcf9eed4690b2f98af5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:41.041882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdb287-d591-470c-8c16-dd83ce0894c5 None admin] RBAC: Authorizing `identity:get_project(project_id=0350028977754bcf9eed4690b2f98af5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:41.043896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdb287-d591-470c-8c16-dd83ce0894c5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:41.045573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 569/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:16:40 2022] GET /identity/v3/projects/0350028977754bcf9eed4690b2f98af5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:41.051743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2245491-5da0-489c-b515-65a5101602ff None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:41.132886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:41.148796 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2245491-5da0-489c-b515-65a5101602ff None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:41.186351 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e19476-f846-4fbc-8d70-421e199d0939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:41.187399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e19476-f846-4fbc-8d70-421e199d0939 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:41.187685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e19476-f846-4fbc-8d70-421e199d0939 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:41.187962 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e19476-f846-4fbc-8d70-421e199d0939 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:41.188800 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e19476-f846-4fbc-8d70-421e199d0939 None admin] RBAC: Adding query filter params (role.id=d73c76bc61c44f3a94e66397b0d9c359, scope.project.id=0350028977754bcf9eed4690b2f98af5, user.id=e3463119f3864141bb38dd4940d88589) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:41.189113 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e19476-f846-4fbc-8d70-421e199d0939 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:41.190551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e19476-f846-4fbc-8d70-421e199d0939 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:41.196508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 548/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:16:41 2022] GET /identity/v3/role_assignments?user.id=e3463119f3864141bb38dd4940d88589&scope.project.id=0350028977754bcf9eed4690b2f98af5&role.id=d73c76bc61c44f3a94e66397b0d9c359 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:43.275535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5c4f-0bc8-4e37-a424-db652342db67 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:43.276104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5c4f-0bc8-4e37-a424-db652342db67 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:43.276104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5c4f-0bc8-4e37-a424-db652342db67 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:43.278145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 570/1118] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:43.284125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624e887-fbb0-41e1-a7d5-37f60fc74f61 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:43.284125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624e887-fbb0-41e1-a7d5-37f60fc74f61 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:43.284125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624e887-fbb0-41e1-a7d5-37f60fc74f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:43.301464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5624e887-fbb0-41e1-a7d5-37f60fc74f61 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:43.302631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5624e887-fbb0-41e1-a7d5-37f60fc74f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:43.368210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 549/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:43.391704 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5c4f-0bc8-4e37-a424-db652342db67 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:43.494915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5c4f-0bc8-4e37-a424-db652342db67 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:43.497430 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:43.530221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d87423-452a-4a55-bef0-667ba448794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:43.531019 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d87423-452a-4a55-bef0-667ba448794d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:43.531300 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d87423-452a-4a55-bef0-667ba448794d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:43.531572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d87423-452a-4a55-bef0-667ba448794d None admin] PATH_INFO: `/v3/roles/d73c76bc61c44f3a94e66397b0d9c359` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:43.533059 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d87423-452a-4a55-bef0-667ba448794d None admin] RBAC: Authorizing `identity:get_role(role_id=d73c76bc61c44f3a94e66397b0d9c359)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:43.534443 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d87423-452a-4a55-bef0-667ba448794d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:43.535851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 571/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:16:43 2022] GET /identity/v3/roles/d73c76bc61c44f3a94e66397b0d9c359 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:43.541882 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624e887-fbb0-41e1-a7d5-37f60fc74f61 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:43.620474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:43.643091 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624e887-fbb0-41e1-a7d5-37f60fc74f61 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:43.676934 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba9c14-549d-40a2-a9f6-c7f6e3dbb574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:43.677785 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9c14-549d-40a2-a9f6-c7f6e3dbb574 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:43.678061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9c14-549d-40a2-a9f6-c7f6e3dbb574 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:43.678586 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9c14-549d-40a2-a9f6-c7f6e3dbb574 None admin] PATH_INFO: `/v3/users/e3463119f3864141bb38dd4940d88589` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:43.679783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba9c14-549d-40a2-a9f6-c7f6e3dbb574 None admin] RBAC: Authorizing `identity:get_user(user_id=e3463119f3864141bb38dd4940d88589)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:43.681195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba9c14-549d-40a2-a9f6-c7f6e3dbb574 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:43.682886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 550/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:16:43 2022] GET /identity/v3/users/e3463119f3864141bb38dd4940d88589 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:43.688717 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d87423-452a-4a55-bef0-667ba448794d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:43.790541 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d87423-452a-4a55-bef0-667ba448794d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:43.827571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a2381-5b1e-4a11-acb9-8f17746edcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:43.828421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a2381-5b1e-4a11-acb9-8f17746edcfd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:43.828690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a2381-5b1e-4a11-acb9-8f17746edcfd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:43.828957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a2381-5b1e-4a11-acb9-8f17746edcfd None admin] PATH_INFO: `/v3/projects/0350028977754bcf9eed4690b2f98af5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:43.830164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a2381-5b1e-4a11-acb9-8f17746edcfd None admin] RBAC: Authorizing `identity:get_project(project_id=0350028977754bcf9eed4690b2f98af5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:43.831630 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a2381-5b1e-4a11-acb9-8f17746edcfd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:43.833347 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 572/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:16:43 2022] GET /identity/v3/projects/0350028977754bcf9eed4690b2f98af5 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:43.839603 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba9c14-549d-40a2-a9f6-c7f6e3dbb574 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:43.940265 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba9c14-549d-40a2-a9f6-c7f6e3dbb574 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:43.973829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec66c89-0766-4188-ad9c-2d2a69990c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:43.974723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec66c89-0766-4188-ad9c-2d2a69990c1e None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:43.975003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec66c89-0766-4188-ad9c-2d2a69990c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:43.975273 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec66c89-0766-4188-ad9c-2d2a69990c1e None admin] PATH_INFO: `/v3/projects/0350028977754bcf9eed4690b2f98af5/users/e3463119f3864141bb38dd4940d88589/roles/d73c76bc61c44f3a94e66397b0d9c359` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:43.977453 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec66c89-0766-4188-ad9c-2d2a69990c1e None admin] RBAC: Authorizing `identity:create_grant(project_id=0350028977754bcf9eed4690b2f98af5, user_id=e3463119f3864141bb38dd4940d88589, role_id=d73c76bc61c44f3a94e66397b0d9c359)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:43.978910 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec66c89-0766-4188-ad9c-2d2a69990c1e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:44.047163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 551/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:16:43 2022] PUT /identity/v3/projects/0350028977754bcf9eed4690b2f98af5/users/e3463119f3864141bb38dd4940d88589/roles/d73c76bc61c44f3a94e66397b0d9c359 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:16:46.108159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b357d41-3a48-40c1-88d1-4a383c150e4a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:46.108728 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b357d41-3a48-40c1-88d1-4a383c150e4a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:46.108728 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b357d41-3a48-40c1-88d1-4a383c150e4a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:46.110112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 573/1124] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:46.115707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24225a27-7d3f-420c-9374-6a32b7b5c963 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:46.116301 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24225a27-7d3f-420c-9374-6a32b7b5c963 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:46.116301 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24225a27-7d3f-420c-9374-6a32b7b5c963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:46.127695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:46.133415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-24225a27-7d3f-420c-9374-6a32b7b5c963 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:46.134597 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-24225a27-7d3f-420c-9374-6a32b7b5c963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:46.200668 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 552/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:46.224378 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b357d41-3a48-40c1-88d1-4a383c150e4a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:46.267972 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:46.333817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b357d41-3a48-40c1-88d1-4a383c150e4a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:46.367903 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe46a0-ebe4-4a39-b571-4434a9c2933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:46.368678 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe46a0-ebe4-4a39-b571-4434a9c2933d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:46.368978 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe46a0-ebe4-4a39-b571-4434a9c2933d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:46.369249 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe46a0-ebe4-4a39-b571-4434a9c2933d None admin] PATH_INFO: `/v3/roles/d73c76bc61c44f3a94e66397b0d9c359` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:46.371459 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe46a0-ebe4-4a39-b571-4434a9c2933d None admin] RBAC: Authorizing `identity:get_role(role_id=d73c76bc61c44f3a94e66397b0d9c359)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:46.372945 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe46a0-ebe4-4a39-b571-4434a9c2933d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:46.374368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 574/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:16:46 2022] GET /identity/v3/roles/d73c76bc61c44f3a94e66397b0d9c359 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:46.380326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24225a27-7d3f-420c-9374-6a32b7b5c963 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:46.476731 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24225a27-7d3f-420c-9374-6a32b7b5c963 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:46.509952 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786b709-e6e4-4f51-89be-7aae706b9398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:46.510878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786b709-e6e4-4f51-89be-7aae706b9398 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:46.511156 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786b709-e6e4-4f51-89be-7aae706b9398 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:46.511428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786b709-e6e4-4f51-89be-7aae706b9398 None admin] PATH_INFO: `/v3/users/e3463119f3864141bb38dd4940d88589` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:46.512629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786b709-e6e4-4f51-89be-7aae706b9398 None admin] RBAC: Authorizing `identity:get_user(user_id=e3463119f3864141bb38dd4940d88589)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:46.514056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786b709-e6e4-4f51-89be-7aae706b9398 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:46.515698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 553/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:16:46 2022] GET /identity/v3/users/e3463119f3864141bb38dd4940d88589 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:46.521509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe46a0-ebe4-4a39-b571-4434a9c2933d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:46.618817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe46a0-ebe4-4a39-b571-4434a9c2933d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:46.629035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:46.653084 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da500c-8e99-4e7b-868f-c7713bc29a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:46.653724 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da500c-8e99-4e7b-868f-c7713bc29a47 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:46.654268 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da500c-8e99-4e7b-868f-c7713bc29a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:46.654406 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da500c-8e99-4e7b-868f-c7713bc29a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:46.721002 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da500c-8e99-4e7b-868f-c7713bc29a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:46.722410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da500c-8e99-4e7b-868f-c7713bc29a47 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:46.819003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 575/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:16:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:46.825257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786b709-e6e4-4f51-89be-7aae706b9398 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:46.829103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:46.931685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786b709-e6e4-4f51-89be-7aae706b9398 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:46.965309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337c2eb-4e60-46e9-a219-7781d3cecfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:46.966152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337c2eb-4e60-46e9-a219-7781d3cecfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:46.966431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337c2eb-4e60-46e9-a219-7781d3cecfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:46.966727 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337c2eb-4e60-46e9-a219-7781d3cecfa1 None admin] PATH_INFO: `/v3/projects/0350028977754bcf9eed4690b2f98af5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:46.967899 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337c2eb-4e60-46e9-a219-7781d3cecfa1 None admin] RBAC: Authorizing `identity:get_project(project_id=0350028977754bcf9eed4690b2f98af5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:46.969332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337c2eb-4e60-46e9-a219-7781d3cecfa1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:46.971057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 554/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:16:46 2022] GET /identity/v3/projects/0350028977754bcf9eed4690b2f98af5 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:46.977213 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da500c-8e99-4e7b-868f-c7713bc29a47 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:46.987830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:47.075598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da500c-8e99-4e7b-868f-c7713bc29a47 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:47.110083 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ec1e9-5029-47bd-afc4-1034acbeb5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:47.110747 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ec1e9-5029-47bd-afc4-1034acbeb5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:47.111025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ec1e9-5029-47bd-afc4-1034acbeb5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:47.111294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ec1e9-5029-47bd-afc4-1034acbeb5b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:47.112120 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ec1e9-5029-47bd-afc4-1034acbeb5b1 None admin] RBAC: Adding query filter params (role.id=d73c76bc61c44f3a94e66397b0d9c359, scope.project.id=0350028977754bcf9eed4690b2f98af5, user.id=e3463119f3864141bb38dd4940d88589) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:47.112428 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ec1e9-5029-47bd-afc4-1034acbeb5b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:47.113870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ec1e9-5029-47bd-afc4-1034acbeb5b1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:47.119614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 576/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:16:46 2022] GET /identity/v3/role_assignments?user.id=e3463119f3864141bb38dd4940d88589&scope.project.id=0350028977754bcf9eed4690b2f98af5&role.id=d73c76bc61c44f3a94e66397b0d9c359 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:49.191191 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46d9e1-77de-4eb6-ac11-553f5520bbf8 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:49.191834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46d9e1-77de-4eb6-ac11-553f5520bbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:49.191834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46d9e1-77de-4eb6-ac11-553f5520bbf8 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:49.193090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 555/1131] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:49.198272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b294cf-e7e8-4aa6-b3ac-62e9c1cadd21 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:49.198740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b294cf-e7e8-4aa6-b3ac-62e9c1cadd21 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:49.198844 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b294cf-e7e8-4aa6-b3ac-62e9c1cadd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:49.215971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-31b294cf-e7e8-4aa6-b3ac-62e9c1cadd21 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:49.217160 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-31b294cf-e7e8-4aa6-b3ac-62e9c1cadd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:49.284316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 577/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:49.307740 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46d9e1-77de-4eb6-ac11-553f5520bbf8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:49.377321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:49.407357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46d9e1-77de-4eb6-ac11-553f5520bbf8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:49.441517 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce25364-8295-447f-9035-976398ecdd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:49.442229 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce25364-8295-447f-9035-976398ecdd81 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:49.442505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce25364-8295-447f-9035-976398ecdd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:49.442806 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce25364-8295-447f-9035-976398ecdd81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:49.443969 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce25364-8295-447f-9035-976398ecdd81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:49.445396 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce25364-8295-447f-9035-976398ecdd81 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:49.447043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 556/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:49.453010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b294cf-e7e8-4aa6-b3ac-62e9c1cadd21 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:49.455218 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:49.560402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b294cf-e7e8-4aa6-b3ac-62e9c1cadd21 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:49.593313 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86130f4a-5c72-44e0-845c-7463afcc0ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:49.593961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86130f4a-5c72-44e0-845c-7463afcc0ec8 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:49.594240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86130f4a-5c72-44e0-845c-7463afcc0ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:49.594512 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86130f4a-5c72-44e0-845c-7463afcc0ec8 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:49.595263 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86130f4a-5c72-44e0-845c-7463afcc0ec8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:49.596703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86130f4a-5c72-44e0-845c-7463afcc0ec8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:49.717592 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 578/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 20 19:16:49 2022] POST /identity/v3/projects => generated 311 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:16:51.848160 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288fbbb-76e8-4f7c-af54-4a88531bef1d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:51.848718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288fbbb-76e8-4f7c-af54-4a88531bef1d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:51.848718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288fbbb-76e8-4f7c-af54-4a88531bef1d None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:51.850069 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 557/1135] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:51.855688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa145a5-303a-4ed6-8bce-e7fe3c7f4567 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:51.856086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa145a5-303a-4ed6-8bce-e7fe3c7f4567 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:51.856241 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa145a5-303a-4ed6-8bce-e7fe3c7f4567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:51.873472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7aa145a5-303a-4ed6-8bce-e7fe3c7f4567 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:51.874655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7aa145a5-303a-4ed6-8bce-e7fe3c7f4567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:51.942045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:51.959802 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 579/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:51.985121 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288fbbb-76e8-4f7c-af54-4a88531bef1d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:52.086839 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288fbbb-76e8-4f7c-af54-4a88531bef1d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:52.120125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a5c32-0e6d-411c-91b3-c390cd7151ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:52.120918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a5c32-0e6d-411c-91b3-c390cd7151ea None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:52.121198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a5c32-0e6d-411c-91b3-c390cd7151ea None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:52.121475 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a5c32-0e6d-411c-91b3-c390cd7151ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:52.122651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a5c32-0e6d-411c-91b3-c390cd7151ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:52.124118 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a5c32-0e6d-411c-91b3-c390cd7151ea None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:52.125745 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 558/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:16:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:52.131512 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa145a5-303a-4ed6-8bce-e7fe3c7f4567 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:52.229771 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa145a5-303a-4ed6-8bce-e7fe3c7f4567 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:52.265540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054417bc-3b63-4f12-bee7-d15c8dc5266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:52.266215 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054417bc-3b63-4f12-bee7-d15c8dc5266f None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:52.266496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054417bc-3b63-4f12-bee7-d15c8dc5266f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:52.266798 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054417bc-3b63-4f12-bee7-d15c8dc5266f None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:52.267525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054417bc-3b63-4f12-bee7-d15c8dc5266f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:52.268971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054417bc-3b63-4f12-bee7-d15c8dc5266f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:52.356474 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 580/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:16:52 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:16:54.496437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f880900-aade-4deb-9b26-08a99e01aa85 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:54.496989 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f880900-aade-4deb-9b26-08a99e01aa85 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:54.496989 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f880900-aade-4deb-9b26-08a99e01aa85 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:54.498365 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 559/1139] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:54.503836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038439d2-482f-4e42-9f0d-038bb9b66271 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:54.504246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038439d2-482f-4e42-9f0d-038bb9b66271 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:54.504377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038439d2-482f-4e42-9f0d-038bb9b66271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:54.522745 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-038439d2-482f-4e42-9f0d-038bb9b66271 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:54.530044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-038439d2-482f-4e42-9f0d-038bb9b66271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:54.561639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:54.604109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 581/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:54.628009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f880900-aade-4deb-9b26-08a99e01aa85 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:54.639456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:54.732355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f880900-aade-4deb-9b26-08a99e01aa85 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:54.766545 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf0916-4a7a-4c0b-8f79-ed5d86e95775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:54.767380 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf0916-4a7a-4c0b-8f79-ed5d86e95775 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:54.767664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf0916-4a7a-4c0b-8f79-ed5d86e95775 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:54.767934 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf0916-4a7a-4c0b-8f79-ed5d86e95775 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:54.778230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf0916-4a7a-4c0b-8f79-ed5d86e95775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-03bf0916-4a7a-4c0b-8f79-ed5d86e95775 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:16:54.785880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:54.787043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:54.787976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:54.787976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:54.787976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:54.787976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:54.787976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:16:54.787976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:16:54.787976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:16:54.787976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:16:54.787976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:16:54.787976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:16:54.787976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:16:54.787976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:54.787976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 560/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:16:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:54.793899 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038439d2-482f-4e42-9f0d-038bb9b66271 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:54.892895 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038439d2-482f-4e42-9f0d-038bb9b66271 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:54.926932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dd973-2907-45af-849a-979c65ae3242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:54.927847 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd973-2907-45af-849a-979c65ae3242 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:54.928206 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd973-2907-45af-849a-979c65ae3242 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:54.928399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd973-2907-45af-849a-979c65ae3242 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:54.929144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dd973-2907-45af-849a-979c65ae3242 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:54.929450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dd973-2907-45af-849a-979c65ae3242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:54.930859 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dd973-2907-45af-849a-979c65ae3242 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:54.939374 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 582/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:16:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:16:54.945179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf0916-4a7a-4c0b-8f79-ed5d86e95775 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:55.008984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:55.041828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf0916-4a7a-4c0b-8f79-ed5d86e95775 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:55.073773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f577d-f68e-47c0-874d-911b1779e22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:55.074592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f577d-f68e-47c0-874d-911b1779e22c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:55.074891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f577d-f68e-47c0-874d-911b1779e22c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:55.075159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f577d-f68e-47c0-874d-911b1779e22c None admin] PATH_INFO: `/v3/users/e46931a8823b440abdb8d63da3a9d2e1` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:55.088496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f577d-f68e-47c0-874d-911b1779e22c None admin] RBAC: Authorizing `identity:get_user(user_id=e46931a8823b440abdb8d63da3a9d2e1)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:55.089910 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f577d-f68e-47c0-874d-911b1779e22c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:55.091580 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 561/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:16:54 2022] GET /identity/v3/users/e46931a8823b440abdb8d63da3a9d2e1 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:55.097430 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dd973-2907-45af-849a-979c65ae3242 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:55.129346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:55.202899 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dd973-2907-45af-849a-979c65ae3242 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:55.236605 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99772d53-325f-4294-8b73-ce92c5ff34fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:55.237238 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772d53-325f-4294-8b73-ce92c5ff34fa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:55.237514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772d53-325f-4294-8b73-ce92c5ff34fa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:55.237782 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772d53-325f-4294-8b73-ce92c5ff34fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:55.303747 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99772d53-325f-4294-8b73-ce92c5ff34fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:55.305231 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99772d53-325f-4294-8b73-ce92c5ff34fa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:55.335341 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:55.404936 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 583/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:16:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:55.410915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f577d-f68e-47c0-874d-911b1779e22c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:55.507206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f577d-f68e-47c0-874d-911b1779e22c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:55.532887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:55.541235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e5b84-85a5-402b-beb2-85ecf8312d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:55.545360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e5b84-85a5-402b-beb2-85ecf8312d82 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:55.545360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e5b84-85a5-402b-beb2-85ecf8312d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:55.545360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e5b84-85a5-402b-beb2-85ecf8312d82 None admin] PATH_INFO: `/v3/projects/009ea37c1ad045b993e399fa56fb48e0` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:55.545360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e5b84-85a5-402b-beb2-85ecf8312d82 None admin] RBAC: Authorizing `identity:get_project(project_id=009ea37c1ad045b993e399fa56fb48e0)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:55.545360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e5b84-85a5-402b-beb2-85ecf8312d82 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:55.546892 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 562/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:16:55 2022] GET /identity/v3/projects/009ea37c1ad045b993e399fa56fb48e0 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:55.553426 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99772d53-325f-4294-8b73-ce92c5ff34fa None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:55.660217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99772d53-325f-4294-8b73-ce92c5ff34fa None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:55.691053 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:55.696132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ef803-8d23-440d-868d-0f45ec481c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:55.696786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef803-8d23-440d-868d-0f45ec481c07 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:55.697624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef803-8d23-440d-868d-0f45ec481c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:55.697985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef803-8d23-440d-868d-0f45ec481c07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:55.698868 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ef803-8d23-440d-868d-0f45ec481c07 None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=009ea37c1ad045b993e399fa56fb48e0, user.id=e46931a8823b440abdb8d63da3a9d2e1) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:55.699181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ef803-8d23-440d-868d-0f45ec481c07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:55.700678 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ef803-8d23-440d-868d-0f45ec481c07 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:55.706254 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 584/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:16:55 2022] GET /identity/v3/role_assignments?user.id=e46931a8823b440abdb8d63da3a9d2e1&scope.project.id=009ea37c1ad045b993e399fa56fb48e0&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:57.739557 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394164d6-0938-4b03-a1eb-a6ecf2ec75dc None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:57.740090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394164d6-0938-4b03-a1eb-a6ecf2ec75dc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:57.740090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394164d6-0938-4b03-a1eb-a6ecf2ec75dc None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:57.741477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 563/1147] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:57.747585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aba17-87c2-4eb0-a88e-901e7a5b719e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:57.747983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aba17-87c2-4eb0-a88e-901e7a5b719e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:57.748126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aba17-87c2-4eb0-a88e-901e7a5b719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:57.764713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-166aba17-87c2-4eb0-a88e-901e7a5b719e None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:57.765893 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-166aba17-87c2-4eb0-a88e-901e7a5b719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:57.832493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 585/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:16:57.855197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394164d6-0938-4b03-a1eb-a6ecf2ec75dc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:57.955959 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394164d6-0938-4b03-a1eb-a6ecf2ec75dc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:57.989318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55d8c9-3f49-43ce-9586-39b79c2d317b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:57.990149 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55d8c9-3f49-43ce-9586-39b79c2d317b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:57.990379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55d8c9-3f49-43ce-9586-39b79c2d317b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:57.990653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55d8c9-3f49-43ce-9586-39b79c2d317b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:58.001169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55d8c9-3f49-43ce-9586-39b79c2d317b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4e55d8c9-3f49-43ce-9586-39b79c2d317b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:16:58.008837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:16:58.009991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:16:58.011064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:16:58.011064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:16:58.011064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:16:58.011064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:16:58.011064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:16:58.011064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:16:58.011064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:16:58.011064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:16:58.011064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:16:58.011064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:16:58.011064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:16:58.011064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:16:58.011064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 564/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:16:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:16:58.016142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166aba17-87c2-4eb0-a88e-901e7a5b719e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:58.121948 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166aba17-87c2-4eb0-a88e-901e7a5b719e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:58.146624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:58.155493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead72c66-f889-4fee-9268-a879e504964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:58.156152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead72c66-f889-4fee-9268-a879e504964b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:58.156436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead72c66-f889-4fee-9268-a879e504964b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:58.156710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead72c66-f889-4fee-9268-a879e504964b None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:58.157451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead72c66-f889-4fee-9268-a879e504964b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:16:58.157756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead72c66-f889-4fee-9268-a879e504964b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:58.159181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead72c66-f889-4fee-9268-a879e504964b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:58.167848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 586/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:16:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:58.173952 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55d8c9-3f49-43ce-9586-39b79c2d317b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:58.228906 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:58.273241 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55d8c9-3f49-43ce-9586-39b79c2d317b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:58.307323 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9d70a-b03d-41b2-982c-06966ef9fed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:58.308179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9d70a-b03d-41b2-982c-06966ef9fed2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:58.308454 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9d70a-b03d-41b2-982c-06966ef9fed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:58.308721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9d70a-b03d-41b2-982c-06966ef9fed2 None admin] PATH_INFO: `/v3/users/e46931a8823b440abdb8d63da3a9d2e1` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:58.309886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9d70a-b03d-41b2-982c-06966ef9fed2 None admin] RBAC: Authorizing `identity:get_user(user_id=e46931a8823b440abdb8d63da3a9d2e1)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:58.311332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9d70a-b03d-41b2-982c-06966ef9fed2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:58.312939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 565/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:16:58 2022] GET /identity/v3/users/e46931a8823b440abdb8d63da3a9d2e1 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:58.318823 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead72c66-f889-4fee-9268-a879e504964b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:58.419864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead72c66-f889-4fee-9268-a879e504964b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:58.452917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b804c5-54e1-432b-8ffd-f3e5b0e9e686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:58.453767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b804c5-54e1-432b-8ffd-f3e5b0e9e686 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:58.454047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b804c5-54e1-432b-8ffd-f3e5b0e9e686 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:58.454319 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b804c5-54e1-432b-8ffd-f3e5b0e9e686 None admin] PATH_INFO: `/v3/projects/009ea37c1ad045b993e399fa56fb48e0` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:58.455527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b804c5-54e1-432b-8ffd-f3e5b0e9e686 None admin] RBAC: Authorizing `identity:get_project(project_id=009ea37c1ad045b993e399fa56fb48e0)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:58.456972 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b804c5-54e1-432b-8ffd-f3e5b0e9e686 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:58.458683 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 587/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:16:58 2022] GET /identity/v3/projects/009ea37c1ad045b993e399fa56fb48e0 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:16:58.465356 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9d70a-b03d-41b2-982c-06966ef9fed2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:58.572527 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9d70a-b03d-41b2-982c-06966ef9fed2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:58.595230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:58.606664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb006b3b-9c31-4fbf-afb8-0206dcbec5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:58.609414 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb006b3b-9c31-4fbf-afb8-0206dcbec5c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:58.609414 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb006b3b-9c31-4fbf-afb8-0206dcbec5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:58.609414 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb006b3b-9c31-4fbf-afb8-0206dcbec5c8 None admin] PATH_INFO: `/v3/projects/009ea37c1ad045b993e399fa56fb48e0/users/e46931a8823b440abdb8d63da3a9d2e1/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:58.610100 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb006b3b-9c31-4fbf-afb8-0206dcbec5c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=009ea37c1ad045b993e399fa56fb48e0, user_id=e46931a8823b440abdb8d63da3a9d2e1, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:58.611568 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb006b3b-9c31-4fbf-afb8-0206dcbec5c8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:58.704037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 566/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:16:58 2022] PUT /identity/v3/projects/009ea37c1ad045b993e399fa56fb48e0/users/e46931a8823b440abdb8d63da3a9d2e1/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:17:00.733759 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e64c9d-2bc5-40eb-b2dc-8f50aa1b6e95 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:00.734287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e64c9d-2bc5-40eb-b2dc-8f50aa1b6e95 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:00.734287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e64c9d-2bc5-40eb-b2dc-8f50aa1b6e95 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:00.735736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 588/1154] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:00.740929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d35b9-70bd-420f-b9e4-937ac5cccde2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:00.741343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d35b9-70bd-420f-b9e4-937ac5cccde2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:00.741484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d35b9-70bd-420f-b9e4-937ac5cccde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:00.763298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0b2d35b9-70bd-420f-b9e4-937ac5cccde2 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:00.764504 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0b2d35b9-70bd-420f-b9e4-937ac5cccde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:00.831804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 567/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:17:00.856865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e64c9d-2bc5-40eb-b2dc-8f50aa1b6e95 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:00.914036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:00.958843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e64c9d-2bc5-40eb-b2dc-8f50aa1b6e95 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:00.992661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e8ec2-6b22-4f8a-987a-4efbed2485c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:00.993443 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e8ec2-6b22-4f8a-987a-4efbed2485c0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:00.993754 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e8ec2-6b22-4f8a-987a-4efbed2485c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:00.994117 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e8ec2-6b22-4f8a-987a-4efbed2485c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:01.004011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e8ec2-6b22-4f8a-987a-4efbed2485c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-837e8ec2-6b22-4f8a-987a-4efbed2485c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:17:01.012334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:17:01.013469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:17:01.014715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:17:01.014715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:17:01.014715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:17:01.014715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:17:01.014715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:17:01.014715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:17:01.014715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:17:01.014715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:17:01.014715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:17:01.014715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:17:01.014715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:17:01.014715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:17:01.014715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 589/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:17:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:17:01.019600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d35b9-70bd-420f-b9e4-937ac5cccde2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:01.128422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d35b9-70bd-420f-b9e4-937ac5cccde2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:01.142725 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:01.162496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2622ec5-28c0-4ffd-9ada-2b9ea3eac217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:01.163182 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2622ec5-28c0-4ffd-9ada-2b9ea3eac217 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:01.163460 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2622ec5-28c0-4ffd-9ada-2b9ea3eac217 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:01.163733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2622ec5-28c0-4ffd-9ada-2b9ea3eac217 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:01.164521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2622ec5-28c0-4ffd-9ada-2b9ea3eac217 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:17:01.164818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2622ec5-28c0-4ffd-9ada-2b9ea3eac217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:01.166326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2622ec5-28c0-4ffd-9ada-2b9ea3eac217 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:01.174199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 568/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:17:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:01.180314 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e8ec2-6b22-4f8a-987a-4efbed2485c0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:01.279680 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e8ec2-6b22-4f8a-987a-4efbed2485c0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:01.297575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:01.316047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf949e2-05b8-4e9a-b506-a3f8d54e30c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:01.316851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf949e2-05b8-4e9a-b506-a3f8d54e30c5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:01.317127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf949e2-05b8-4e9a-b506-a3f8d54e30c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:01.317396 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf949e2-05b8-4e9a-b506-a3f8d54e30c5 None admin] PATH_INFO: `/v3/users/e46931a8823b440abdb8d63da3a9d2e1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:01.318577 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf949e2-05b8-4e9a-b506-a3f8d54e30c5 None admin] RBAC: Authorizing `identity:get_user(user_id=e46931a8823b440abdb8d63da3a9d2e1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:01.320046 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf949e2-05b8-4e9a-b506-a3f8d54e30c5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:01.322268 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 590/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:17:01 2022] GET /identity/v3/users/e46931a8823b440abdb8d63da3a9d2e1 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:01.328211 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2622ec5-28c0-4ffd-9ada-2b9ea3eac217 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:01.428348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2622ec5-28c0-4ffd-9ada-2b9ea3eac217 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:01.461022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902639d5-1ab2-4cab-9f24-6f650db166b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:01.461660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902639d5-1ab2-4cab-9f24-6f650db166b8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:01.461944 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902639d5-1ab2-4cab-9f24-6f650db166b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:01.462266 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902639d5-1ab2-4cab-9f24-6f650db166b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:01.503798 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:01.527306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902639d5-1ab2-4cab-9f24-6f650db166b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:01.528748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902639d5-1ab2-4cab-9f24-6f650db166b8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:01.624371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 569/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:17:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:17:01.630487 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf949e2-05b8-4e9a-b506-a3f8d54e30c5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:01.735411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf949e2-05b8-4e9a-b506-a3f8d54e30c5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:01.768244 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb675cc8-b198-4773-9688-e31cd2aed1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:01.769091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb675cc8-b198-4773-9688-e31cd2aed1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:01.769370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb675cc8-b198-4773-9688-e31cd2aed1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:01.769650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb675cc8-b198-4773-9688-e31cd2aed1d2 None admin] PATH_INFO: `/v3/projects/009ea37c1ad045b993e399fa56fb48e0` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:01.770851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb675cc8-b198-4773-9688-e31cd2aed1d2 None admin] RBAC: Authorizing `identity:get_project(project_id=009ea37c1ad045b993e399fa56fb48e0)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:01.772293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb675cc8-b198-4773-9688-e31cd2aed1d2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:01.773988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 591/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:17:01 2022] GET /identity/v3/projects/009ea37c1ad045b993e399fa56fb48e0 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:01.780774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902639d5-1ab2-4cab-9f24-6f650db166b8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:01.853714 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:01.877490 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902639d5-1ab2-4cab-9f24-6f650db166b8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:01.911375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe27f32-02ee-4d18-869f-828de03f898d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:01.912019 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe27f32-02ee-4d18-869f-828de03f898d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:01.912297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe27f32-02ee-4d18-869f-828de03f898d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:01.912566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe27f32-02ee-4d18-869f-828de03f898d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:01.913391 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe27f32-02ee-4d18-869f-828de03f898d None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=009ea37c1ad045b993e399fa56fb48e0, user.id=e46931a8823b440abdb8d63da3a9d2e1) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:17:01.913698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe27f32-02ee-4d18-869f-828de03f898d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:01.915712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe27f32-02ee-4d18-869f-828de03f898d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:01.921437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 570/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:17:01 2022] GET /identity/v3/role_assignments?user.id=e46931a8823b440abdb8d63da3a9d2e1&scope.project.id=009ea37c1ad045b993e399fa56fb48e0&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:03.969272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda39a70-e8d1-49e8-8148-c8a2427691eb None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:03.969830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda39a70-e8d1-49e8-8148-c8a2427691eb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:03.969830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda39a70-e8d1-49e8-8148-c8a2427691eb None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:03.971242 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 592/1162] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:03.976463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54725a10-9aad-4611-a535-7e25714ed75c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:03.976910 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54725a10-9aad-4611-a535-7e25714ed75c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:03.977013 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54725a10-9aad-4611-a535-7e25714ed75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:03.994566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-54725a10-9aad-4611-a535-7e25714ed75c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:03.995766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-54725a10-9aad-4611-a535-7e25714ed75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:04.060944 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 571/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:17:04.083539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda39a70-e8d1-49e8-8148-c8a2427691eb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:04.136886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:04.187610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda39a70-e8d1-49e8-8148-c8a2427691eb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:04.222441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecda15-6208-41f3-950f-5a81bc59bcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:04.223032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecda15-6208-41f3-950f-5a81bc59bcfe None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:04.223315 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecda15-6208-41f3-950f-5a81bc59bcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:04.223591 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecda15-6208-41f3-950f-5a81bc59bcfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:04.291987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecda15-6208-41f3-950f-5a81bc59bcfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:04.293462 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecda15-6208-41f3-950f-5a81bc59bcfe None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:04.345826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:04.394144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 593/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:17:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:17:04.400395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54725a10-9aad-4611-a535-7e25714ed75c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:04.464059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:04.495948 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54725a10-9aad-4611-a535-7e25714ed75c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:04.528734 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a1861-2028-48b7-bbde-807d3afedb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:04.529525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a1861-2028-48b7-bbde-807d3afedb08 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:04.529834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a1861-2028-48b7-bbde-807d3afedb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:04.530101 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a1861-2028-48b7-bbde-807d3afedb08 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:04.536830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a1861-2028-48b7-bbde-807d3afedb08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:04.538257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a1861-2028-48b7-bbde-807d3afedb08 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-552a1861-2028-48b7-bbde-807d3afedb08 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:17:04.553317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:17:04.554607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:17:04.555691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:17:04.555691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:17:04.555691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:17:04.555691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:17:04.555691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:17:04.555691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:17:04.555691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:17:04.555691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:17:04.555691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:17:04.555691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:17:04.555691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 20 19:17:04.555691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:17:04.555691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 19:17:04.555691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:17:04.555691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 572/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jul 20 19:17:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:17:04.561595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecda15-6208-41f3-950f-5a81bc59bcfe None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:04.662982 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecda15-6208-41f3-950f-5a81bc59bcfe None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:04.697467 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e32c52-1fee-4076-a2e8-819026a6e8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:04.698125 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e32c52-1fee-4076-a2e8-819026a6e8ab None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:04.698402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e32c52-1fee-4076-a2e8-819026a6e8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:04.698692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e32c52-1fee-4076-a2e8-819026a6e8ab None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:04.699420 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e32c52-1fee-4076-a2e8-819026a6e8ab None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:17:04.699719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e32c52-1fee-4076-a2e8-819026a6e8ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:04.701098 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e32c52-1fee-4076-a2e8-819026a6e8ab None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:04.708429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 594/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jul 20 19:17:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:06.754069 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93596dc-429b-452a-a676-b66c5a57f8a6 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:06.754622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93596dc-429b-452a-a676-b66c5a57f8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:06.754622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93596dc-429b-452a-a676-b66c5a57f8a6 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:06.756018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 573/1167] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:06.762426 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7084a32-f159-4016-a81b-e21c2e8a1589 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:06.762883 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7084a32-f159-4016-a81b-e21c2e8a1589 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:06.762989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7084a32-f159-4016-a81b-e21c2e8a1589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:06.780062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d7084a32-f159-4016-a81b-e21c2e8a1589 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:06.781248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d7084a32-f159-4016-a81b-e21c2e8a1589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:06.792019 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:06.850625 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 595/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:17:06.874825 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93596dc-429b-452a-a676-b66c5a57f8a6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:06.974065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93596dc-429b-452a-a676-b66c5a57f8a6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:06.998392 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:07.005771 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6eb61-9600-4e42-addd-c6a1b0a0a99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:07.006362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6eb61-9600-4e42-addd-c6a1b0a0a99d None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:07.006639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6eb61-9600-4e42-addd-c6a1b0a0a99d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:07.006940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6eb61-9600-4e42-addd-c6a1b0a0a99d None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:07.007714 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6eb61-9600-4e42-addd-c6a1b0a0a99d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:07.013462 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6eb61-9600-4e42-addd-c6a1b0a0a99d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:07.086514 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 574/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Wed Jul 20 19:17:06 2022] POST /identity/v3/domains => generated 267 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:17:09.149831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa394a-97d2-49dd-9e83-1c3e7a1d0bf8 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:09.150368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa394a-97d2-49dd-9e83-1c3e7a1d0bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:09.150368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa394a-97d2-49dd-9e83-1c3e7a1d0bf8 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:09.151789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 596/1170] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:09.157064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3e55f-1ef8-4dca-9b40-22fed991c2b4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:09.157468 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3e55f-1ef8-4dca-9b40-22fed991c2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:09.157605 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3e55f-1ef8-4dca-9b40-22fed991c2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:09.174383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-dfb3e55f-1ef8-4dca-9b40-22fed991c2b4 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:09.175843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dfb3e55f-1ef8-4dca-9b40-22fed991c2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:09.240608 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 575/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:17:09.265219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa394a-97d2-49dd-9e83-1c3e7a1d0bf8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:09.370267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa394a-97d2-49dd-9e83-1c3e7a1d0bf8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:09.404507 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e287b5-67ba-4070-b239-7de714b0a074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:09.405289 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e287b5-67ba-4070-b239-7de714b0a074 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:09.405569 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e287b5-67ba-4070-b239-7de714b0a074 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:09.405841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e287b5-67ba-4070-b239-7de714b0a074 None admin] PATH_INFO: `/v3/domains/166938b7f3e84c8195690acc373126a5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:09.417392 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e287b5-67ba-4070-b239-7de714b0a074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=166938b7f3e84c8195690acc373126a5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:09.418875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e287b5-67ba-4070-b239-7de714b0a074 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:09.420557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 597/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Jul 20 19:17:09 2022] GET /identity/v3/domains/166938b7f3e84c8195690acc373126a5 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:09.427007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3e55f-1ef8-4dca-9b40-22fed991c2b4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:09.533716 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3e55f-1ef8-4dca-9b40-22fed991c2b4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:09.551919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:09.568195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789469f9-68c1-47d6-ba8c-c2d041f60ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:09.568847 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789469f9-68c1-47d6-ba8c-c2d041f60ac0 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:09.569137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789469f9-68c1-47d6-ba8c-c2d041f60ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:09.569413 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789469f9-68c1-47d6-ba8c-c2d041f60ac0 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:09.570134 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789469f9-68c1-47d6-ba8c-c2d041f60ac0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:09.571604 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789469f9-68c1-47d6-ba8c-c2d041f60ac0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:09.664164 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 576/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 20 19:17:09 2022] POST /identity/v3/projects => generated 361 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:17:11.750209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bf670-9224-456e-bcab-aea5eb9d6b93 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:11.750856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bf670-9224-456e-bcab-aea5eb9d6b93 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:11.750856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bf670-9224-456e-bcab-aea5eb9d6b93 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:11.752148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 598/1174] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:11.757328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb15130-f6c5-4768-8603-6e9144c42de3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:11.758364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb15130-f6c5-4768-8603-6e9144c42de3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:11.758520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb15130-f6c5-4768-8603-6e9144c42de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:11.775465 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0bb15130-f6c5-4768-8603-6e9144c42de3 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:11.776658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0bb15130-f6c5-4768-8603-6e9144c42de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:11.853463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 577/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:17:11.878639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bf670-9224-456e-bcab-aea5eb9d6b93 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:11.888725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:11.980760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bf670-9224-456e-bcab-aea5eb9d6b93 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:12.013857 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dbaad-df5b-4877-b09e-8c7496723de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:12.014645 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dbaad-df5b-4877-b09e-8c7496723de0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:12.015084 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dbaad-df5b-4877-b09e-8c7496723de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:12.015356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dbaad-df5b-4877-b09e-8c7496723de0 None admin] PATH_INFO: `/v3/domains/166938b7f3e84c8195690acc373126a5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:12.016543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dbaad-df5b-4877-b09e-8c7496723de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=166938b7f3e84c8195690acc373126a5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:12.017981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dbaad-df5b-4877-b09e-8c7496723de0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:12.019631 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 599/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Jul 20 19:17:11 2022] GET /identity/v3/domains/166938b7f3e84c8195690acc373126a5 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:12.025708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb15130-f6c5-4768-8603-6e9144c42de3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:12.120940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:12.123726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb15130-f6c5-4768-8603-6e9144c42de3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:12.157374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252ffcb-fb5d-4397-88ac-0e1d370b5e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:12.158034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252ffcb-fb5d-4397-88ac-0e1d370b5e95 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:12.158355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252ffcb-fb5d-4397-88ac-0e1d370b5e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:12.158627 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252ffcb-fb5d-4397-88ac-0e1d370b5e95 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:12.159374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252ffcb-fb5d-4397-88ac-0e1d370b5e95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:12.160897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252ffcb-fb5d-4397-88ac-0e1d370b5e95 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:12.262156 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 578/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:17:12 2022] POST /identity/v3/users => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:17:14.336412 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a337380-d9c6-4891-bd27-338573ab486b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:14.336943 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a337380-d9c6-4891-bd27-338573ab486b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:14.336943 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a337380-d9c6-4891-bd27-338573ab486b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:14.338338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 600/1178] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:14.343775 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ce003-b222-42be-831a-b5efaecf5874 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:14.344252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ce003-b222-42be-831a-b5efaecf5874 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:14.344353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ce003-b222-42be-831a-b5efaecf5874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:14.361802 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f29ce003-b222-42be-831a-b5efaecf5874 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:14.363040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f29ce003-b222-42be-831a-b5efaecf5874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:14.429497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 579/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:17:14.453225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a337380-d9c6-4891-bd27-338573ab486b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:14.528419 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:14.554041 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a337380-d9c6-4891-bd27-338573ab486b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:14.588570 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587e132-d52b-4fbb-a2ad-5ccefeb42d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:14.589347 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587e132-d52b-4fbb-a2ad-5ccefeb42d40 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:14.589626 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587e132-d52b-4fbb-a2ad-5ccefeb42d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:14.589896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587e132-d52b-4fbb-a2ad-5ccefeb42d40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:14.599963 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587e132-d52b-4fbb-a2ad-5ccefeb42d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2587e132-d52b-4fbb-a2ad-5ccefeb42d40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:17:14.607682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:17:14.608875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:17:14.609833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:17:14.609833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:17:14.609833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:17:14.609833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:17:14.609833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:17:14.609833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:17:14.609833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:17:14.609833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:17:14.609833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:17:14.609833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:17:14.609833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:17:14.609833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:17:14.609833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 601/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:17:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:17:14.614942 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ce003-b222-42be-831a-b5efaecf5874 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:14.703825 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:14.718057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ce003-b222-42be-831a-b5efaecf5874 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:14.751552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da7fb8-4f09-44ef-b647-852e5dae4099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:14.752218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da7fb8-4f09-44ef-b647-852e5dae4099 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:14.752501 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da7fb8-4f09-44ef-b647-852e5dae4099 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:14.752776 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da7fb8-4f09-44ef-b647-852e5dae4099 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:14.753521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da7fb8-4f09-44ef-b647-852e5dae4099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:17:14.753827 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da7fb8-4f09-44ef-b647-852e5dae4099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:14.755233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da7fb8-4f09-44ef-b647-852e5dae4099 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:14.766177 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 580/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:17:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:17:14.771756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587e132-d52b-4fbb-a2ad-5ccefeb42d40 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:14.876492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587e132-d52b-4fbb-a2ad-5ccefeb42d40 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:14.911954 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da0056-a0eb-47b3-829c-4492c3b32ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:14.912818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da0056-a0eb-47b3-829c-4492c3b32ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:14.913098 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da0056-a0eb-47b3-829c-4492c3b32ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:14.913373 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da0056-a0eb-47b3-829c-4492c3b32ad4 None admin] PATH_INFO: `/v3/users/b243d5a7bd6440e1a37d44638ceb517e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:14.916194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:14.928238 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da0056-a0eb-47b3-829c-4492c3b32ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=b243d5a7bd6440e1a37d44638ceb517e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:14.931110 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da0056-a0eb-47b3-829c-4492c3b32ad4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:14.932137 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 602/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:17:14 2022] GET /identity/v3/users/b243d5a7bd6440e1a37d44638ceb517e => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:14.937939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da7fb8-4f09-44ef-b647-852e5dae4099 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:15.034988 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da7fb8-4f09-44ef-b647-852e5dae4099 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:15.068456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc0d7e-ad12-4a03-b6bc-ac61593a15b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:15.069103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc0d7e-ad12-4a03-b6bc-ac61593a15b4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:15.069376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc0d7e-ad12-4a03-b6bc-ac61593a15b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:15.069649 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc0d7e-ad12-4a03-b6bc-ac61593a15b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:15.087411 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:15.136340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc0d7e-ad12-4a03-b6bc-ac61593a15b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:15.137712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc0d7e-ad12-4a03-b6bc-ac61593a15b4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:15.234552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 581/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:17:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:17:15.240478 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da0056-a0eb-47b3-829c-4492c3b32ad4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:15.341056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da0056-a0eb-47b3-829c-4492c3b32ad4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:15.374716 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02d472-7a9e-4fa3-a441-56bd93a7a135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:15.375576 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02d472-7a9e-4fa3-a441-56bd93a7a135 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:15.375858 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02d472-7a9e-4fa3-a441-56bd93a7a135 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:15.376132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02d472-7a9e-4fa3-a441-56bd93a7a135 None admin] PATH_INFO: `/v3/projects/9ac86a0d99f94ab89ebac49ed592ba56` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:15.377337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02d472-7a9e-4fa3-a441-56bd93a7a135 None admin] RBAC: Authorizing `identity:get_project(project_id=9ac86a0d99f94ab89ebac49ed592ba56)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:15.378821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02d472-7a9e-4fa3-a441-56bd93a7a135 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:15.380555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 603/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:17:15 2022] GET /identity/v3/projects/9ac86a0d99f94ab89ebac49ed592ba56 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:15.387269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc0d7e-ad12-4a03-b6bc-ac61593a15b4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:15.436074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:15.487342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc0d7e-ad12-4a03-b6bc-ac61593a15b4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:15.520770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77117a-3563-48b1-adb0-9e5b1ff88175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:15.521410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77117a-3563-48b1-adb0-9e5b1ff88175 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:15.521693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77117a-3563-48b1-adb0-9e5b1ff88175 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:15.521966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77117a-3563-48b1-adb0-9e5b1ff88175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:15.523388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77117a-3563-48b1-adb0-9e5b1ff88175 None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=9ac86a0d99f94ab89ebac49ed592ba56, user.id=b243d5a7bd6440e1a37d44638ceb517e) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:17:15.523702 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77117a-3563-48b1-adb0-9e5b1ff88175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:15.525199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77117a-3563-48b1-adb0-9e5b1ff88175 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:15.530570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 582/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:17:15 2022] GET /identity/v3/role_assignments?user.id=b243d5a7bd6440e1a37d44638ceb517e&scope.project.id=9ac86a0d99f94ab89ebac49ed592ba56&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:17.591915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377b249-c8e1-4f0b-857c-942391949d88 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:17.592432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377b249-c8e1-4f0b-857c-942391949d88 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:17.592432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377b249-c8e1-4f0b-857c-942391949d88 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:17.593728 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 604/1186] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:17.599021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c171b-cb8d-462c-a3f2-ed3bf72a34e0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:17.599464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c171b-cb8d-462c-a3f2-ed3bf72a34e0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:17.599563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c171b-cb8d-462c-a3f2-ed3bf72a34e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:17.617738 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d25c171b-cb8d-462c-a3f2-ed3bf72a34e0 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:17.618937 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d25c171b-cb8d-462c-a3f2-ed3bf72a34e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:17.683719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 583/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:17:17.706890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377b249-c8e1-4f0b-857c-942391949d88 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:17.766811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:17.807481 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377b249-c8e1-4f0b-857c-942391949d88 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:17.841065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7163b20-c83a-4dc9-a170-dc8715752ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:17.841841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7163b20-c83a-4dc9-a170-dc8715752ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:17.842174 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7163b20-c83a-4dc9-a170-dc8715752ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:17.842391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7163b20-c83a-4dc9-a170-dc8715752ca1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:17.852379 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7163b20-c83a-4dc9-a170-dc8715752ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d7163b20-c83a-4dc9-a170-dc8715752ca1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:17:17.860058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:17:17.861166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:17:17.862082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:17:17.862082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:17:17.862082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:17:17.862082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:17:17.862082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:17:17.862082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:17:17.862082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:17:17.862082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:17:17.862082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:17:17.862082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:17:17.862082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:17:17.862082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:17:17.862082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 605/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:17:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:17:17.867843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c171b-cb8d-462c-a3f2-ed3bf72a34e0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:17.917837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:17.974687 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c171b-cb8d-462c-a3f2-ed3bf72a34e0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:18.009771 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b5e89-0780-444c-8b4b-952e4691a069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:18.010438 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b5e89-0780-444c-8b4b-952e4691a069 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:18.010745 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b5e89-0780-444c-8b4b-952e4691a069 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:18.011015 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b5e89-0780-444c-8b4b-952e4691a069 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:18.011750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b5e89-0780-444c-8b4b-952e4691a069 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:17:18.012046 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b5e89-0780-444c-8b4b-952e4691a069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:18.013405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b5e89-0780-444c-8b4b-952e4691a069 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:18.021838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 584/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:18.027813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7163b20-c83a-4dc9-a170-dc8715752ca1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:18.130442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7163b20-c83a-4dc9-a170-dc8715752ca1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:18.149320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:18.162550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee719bf-31c6-428e-826e-449c44c2369f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:18.164070 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee719bf-31c6-428e-826e-449c44c2369f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:18.164344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee719bf-31c6-428e-826e-449c44c2369f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:18.164615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee719bf-31c6-428e-826e-449c44c2369f None admin] PATH_INFO: `/v3/users/b243d5a7bd6440e1a37d44638ceb517e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:18.165800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee719bf-31c6-428e-826e-449c44c2369f None admin] RBAC: Authorizing `identity:get_user(user_id=b243d5a7bd6440e1a37d44638ceb517e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:18.167282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee719bf-31c6-428e-826e-449c44c2369f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:18.168907 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 606/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:17:18 2022] GET /identity/v3/users/b243d5a7bd6440e1a37d44638ceb517e => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:18.175062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b5e89-0780-444c-8b4b-952e4691a069 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:18.273688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b5e89-0780-444c-8b4b-952e4691a069 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:18.275975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:18.307828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531b6b6-051d-46be-b54d-ff15fe996a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:18.308688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b6b6-051d-46be-b54d-ff15fe996a6b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:18.308963 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b6b6-051d-46be-b54d-ff15fe996a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:18.309240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b6b6-051d-46be-b54d-ff15fe996a6b None admin] PATH_INFO: `/v3/projects/9ac86a0d99f94ab89ebac49ed592ba56` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:18.310414 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531b6b6-051d-46be-b54d-ff15fe996a6b None admin] RBAC: Authorizing `identity:get_project(project_id=9ac86a0d99f94ab89ebac49ed592ba56)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:18.311887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531b6b6-051d-46be-b54d-ff15fe996a6b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:18.313586 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 585/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:17:18 2022] GET /identity/v3/projects/9ac86a0d99f94ab89ebac49ed592ba56 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:18.319739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee719bf-31c6-428e-826e-449c44c2369f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:18.420355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee719bf-31c6-428e-826e-449c44c2369f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:18.453155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c55eb-b73a-450a-9743-542ef43f3dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:18.454032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c55eb-b73a-450a-9743-542ef43f3dd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:18.454313 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c55eb-b73a-450a-9743-542ef43f3dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:18.454587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c55eb-b73a-450a-9743-542ef43f3dd1 None admin] PATH_INFO: `/v3/projects/9ac86a0d99f94ab89ebac49ed592ba56/users/b243d5a7bd6440e1a37d44638ceb517e/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:18.456579 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c55eb-b73a-450a-9743-542ef43f3dd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ac86a0d99f94ab89ebac49ed592ba56, user_id=b243d5a7bd6440e1a37d44638ceb517e, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:18.458022 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c55eb-b73a-450a-9743-542ef43f3dd1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:18.524542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 607/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:17:18 2022] PUT /identity/v3/projects/9ac86a0d99f94ab89ebac49ed592ba56/users/b243d5a7bd6440e1a37d44638ceb517e/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:17:20.567509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18286b9b-bb11-455b-bb24-8c0135b83554 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:20.568048 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18286b9b-bb11-455b-bb24-8c0135b83554 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:20.568048 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18286b9b-bb11-455b-bb24-8c0135b83554 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:20.570132 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 586/1193] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:17:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:20.575899 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94fda6-7dd4-40e9-8c7d-7c1c610cb653 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:20.576314 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94fda6-7dd4-40e9-8c7d-7c1c610cb653 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:20.576453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94fda6-7dd4-40e9-8c7d-7c1c610cb653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:20.593359 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-da94fda6-7dd4-40e9-8c7d-7c1c610cb653 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:20.594554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-da94fda6-7dd4-40e9-8c7d-7c1c610cb653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:20.637721 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:20.660133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 608/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:17:20.684979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18286b9b-bb11-455b-bb24-8c0135b83554 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:20.790286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18286b9b-bb11-455b-bb24-8c0135b83554 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:20.823430 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b39e37-d40d-44d5-96c0-b048583b96cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:20.824132 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b39e37-d40d-44d5-96c0-b048583b96cc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:20.824410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b39e37-d40d-44d5-96c0-b048583b96cc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:20.824683 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b39e37-d40d-44d5-96c0-b048583b96cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:20.835287 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b39e37-d40d-44d5-96c0-b048583b96cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-70b39e37-d40d-44d5-96c0-b048583b96cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:17:20.843011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:17:20.844081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:17:20.844933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:17:20.844933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:17:20.844933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:17:20.844933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:17:20.844933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:17:20.844933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:17:20.844933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:17:20.844933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:17:20.844933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:17:20.844933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:17:20.844933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:17:20.844933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:17:20.844933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 587/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:17:20.850276 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94fda6-7dd4-40e9-8c7d-7c1c610cb653 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:20.953420 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94fda6-7dd4-40e9-8c7d-7c1c610cb653 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:20.986850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b420d9-b778-4595-87de-718c0385eee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:20.987510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b420d9-b778-4595-87de-718c0385eee0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:20.987797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b420d9-b778-4595-87de-718c0385eee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:20.988076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b420d9-b778-4595-87de-718c0385eee0 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:20.988818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b420d9-b778-4595-87de-718c0385eee0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:17:20.989125 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b420d9-b778-4595-87de-718c0385eee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:20.990505 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b420d9-b778-4595-87de-718c0385eee0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:20.999289 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 609/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:17:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:21.005458 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b39e37-d40d-44d5-96c0-b048583b96cc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:21.035991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:21.103224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b39e37-d40d-44d5-96c0-b048583b96cc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:21.135968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca082e6e-48a3-4095-a81f-4bee5566e3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:21.136823 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca082e6e-48a3-4095-a81f-4bee5566e3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:21.137098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca082e6e-48a3-4095-a81f-4bee5566e3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:21.137366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca082e6e-48a3-4095-a81f-4bee5566e3e3 None admin] PATH_INFO: `/v3/users/b243d5a7bd6440e1a37d44638ceb517e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:21.138537 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca082e6e-48a3-4095-a81f-4bee5566e3e3 None admin] RBAC: Authorizing `identity:get_user(user_id=b243d5a7bd6440e1a37d44638ceb517e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:21.139991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca082e6e-48a3-4095-a81f-4bee5566e3e3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:21.141611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 588/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jul 20 19:17:21 2022] GET /identity/v3/users/b243d5a7bd6440e1a37d44638ceb517e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:21.147641 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b420d9-b778-4595-87de-718c0385eee0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:21.189845 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:21.246351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b420d9-b778-4595-87de-718c0385eee0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:21.280163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17d3be-e045-425b-9e71-543e1a5b84d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:21.280816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17d3be-e045-425b-9e71-543e1a5b84d2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:21.281096 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17d3be-e045-425b-9e71-543e1a5b84d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:21.281369 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17d3be-e045-425b-9e71-543e1a5b84d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:21.349556 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17d3be-e045-425b-9e71-543e1a5b84d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:21.351334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17d3be-e045-425b-9e71-543e1a5b84d2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:21.391406 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:21.449166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 610/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:17:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:17:21.455109 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca082e6e-48a3-4095-a81f-4bee5566e3e3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:21.551250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:21.554638 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca082e6e-48a3-4095-a81f-4bee5566e3e3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:21.590248 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180ca77-d529-41a1-a49d-adf195c5b0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:21.591171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180ca77-d529-41a1-a49d-adf195c5b0bf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:21.591452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180ca77-d529-41a1-a49d-adf195c5b0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:21.591722 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180ca77-d529-41a1-a49d-adf195c5b0bf None admin] PATH_INFO: `/v3/projects/9ac86a0d99f94ab89ebac49ed592ba56` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:21.592909 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180ca77-d529-41a1-a49d-adf195c5b0bf None admin] RBAC: Authorizing `identity:get_project(project_id=9ac86a0d99f94ab89ebac49ed592ba56)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:21.594338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180ca77-d529-41a1-a49d-adf195c5b0bf None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:21.596072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 589/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jul 20 19:17:21 2022] GET /identity/v3/projects/9ac86a0d99f94ab89ebac49ed592ba56 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:21.602248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17d3be-e045-425b-9e71-543e1a5b84d2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:21.699404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17d3be-e045-425b-9e71-543e1a5b84d2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:21.732649 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2dc1b-b4b1-499f-876b-da167a41308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:21.733301 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2dc1b-b4b1-499f-876b-da167a41308f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:21.733581 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2dc1b-b4b1-499f-876b-da167a41308f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:21.733853 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2dc1b-b4b1-499f-876b-da167a41308f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:21.734707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2dc1b-b4b1-499f-876b-da167a41308f None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=9ac86a0d99f94ab89ebac49ed592ba56, user.id=b243d5a7bd6440e1a37d44638ceb517e) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:17:21.735012 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2dc1b-b4b1-499f-876b-da167a41308f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:21.736444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2dc1b-b4b1-499f-876b-da167a41308f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:21.743088 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 611/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:17:21 2022] GET /identity/v3/role_assignments?user.id=b243d5a7bd6440e1a37d44638ceb517e&scope.project.id=9ac86a0d99f94ab89ebac49ed592ba56&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:17:31.587011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=16 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:31.740169 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:36.213115 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49fdd1-2270-4716-86a5-0e92958865ee None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:36.213747 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49fdd1-2270-4716-86a5-0e92958865ee None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:36.214017 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49fdd1-2270-4716-86a5-0e92958865ee None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:36.216082 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 590/1201] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:18:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:36.222442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e852d-9a98-47e0-849b-6fdf0c9ecc03 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:36.223075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e852d-9a98-47e0-849b-6fdf0c9ecc03 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:36.223075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e852d-9a98-47e0-849b-6fdf0c9ecc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:36.243962 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ce0e852d-9a98-47e0-849b-6fdf0c9ecc03 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:36.245338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ce0e852d-9a98-47e0-849b-6fdf0c9ecc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:36.332559 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 612/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:18:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:18:36.356900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49fdd1-2270-4716-86a5-0e92958865ee None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:36.463603 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49fdd1-2270-4716-86a5-0e92958865ee None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:36.497188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb32c95-1762-4e0e-85f4-48bc456c09e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:36.497974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb32c95-1762-4e0e-85f4-48bc456c09e1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:36.498252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb32c95-1762-4e0e-85f4-48bc456c09e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:36.498525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb32c95-1762-4e0e-85f4-48bc456c09e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:36.510421 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb32c95-1762-4e0e-85f4-48bc456c09e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:36.513593 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb32c95-1762-4e0e-85f4-48bc456c09e1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:36.530720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4bb32c95-1762-4e0e-85f4-48bc456c09e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:36.530720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:36.530720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:36.530720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:36.530720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:36.530720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:36.530720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:36.530720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:36.530720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:36.530720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:36.530720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:36.530720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:36.530720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:18:36.530720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:18:36.530720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:36.532339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:36.533505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:18:36.533505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:18:36.533505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:36.533505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:18:36.533505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 591/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:36.538852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e852d-9a98-47e0-849b-6fdf0c9ecc03 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:36.639530 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e852d-9a98-47e0-849b-6fdf0c9ecc03 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:36.670172 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:36.676749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239833c-0dbf-431b-977b-eef1580415f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:36.677409 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239833c-0dbf-431b-977b-eef1580415f5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:36.677690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239833c-0dbf-431b-977b-eef1580415f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:36.677963 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239833c-0dbf-431b-977b-eef1580415f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:36.678703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239833c-0dbf-431b-977b-eef1580415f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:36.679020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239833c-0dbf-431b-977b-eef1580415f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:36.680486 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239833c-0dbf-431b-977b-eef1580415f5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:36.692136 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 613/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:36.697982 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb32c95-1762-4e0e-85f4-48bc456c09e1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:36.752850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:36.800040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb32c95-1762-4e0e-85f4-48bc456c09e1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:36.838561 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1c94d-40fa-45e3-8fb9-f9f78f52cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:36.839256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1c94d-40fa-45e3-8fb9-f9f78f52cfcc None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:36.839538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1c94d-40fa-45e3-8fb9-f9f78f52cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:36.839811 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1c94d-40fa-45e3-8fb9-f9f78f52cfcc None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:36.840511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1c94d-40fa-45e3-8fb9-f9f78f52cfcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:36.841945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1c94d-40fa-45e3-8fb9-f9f78f52cfcc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:36.921849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 592/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jul 20 19:18:36 2022] POST /identity/v3/users => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:18:39.016568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed4f98-3187-4a0e-a7af-1a881802310c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:39.017133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed4f98-3187-4a0e-a7af-1a881802310c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:39.017133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed4f98-3187-4a0e-a7af-1a881802310c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:39.018524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 614/1206] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:39.024430 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d83bb9-a3e6-48b7-b8c3-3af827eb4239 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:39.024862 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d83bb9-a3e6-48b7-b8c3-3af827eb4239 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:39.024972 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d83bb9-a3e6-48b7-b8c3-3af827eb4239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:39.042534 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-30d83bb9-a3e6-48b7-b8c3-3af827eb4239 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:39.043760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-30d83bb9-a3e6-48b7-b8c3-3af827eb4239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:39.109262 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 593/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:18:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:18:39.133227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed4f98-3187-4a0e-a7af-1a881802310c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:39.236843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed4f98-3187-4a0e-a7af-1a881802310c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:39.270818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ed3e9-bbfb-4218-9a1b-42706de9d57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:39.271534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ed3e9-bbfb-4218-9a1b-42706de9d57d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:39.271811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ed3e9-bbfb-4218-9a1b-42706de9d57d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:39.272082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ed3e9-bbfb-4218-9a1b-42706de9d57d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:39.282317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ed3e9-bbfb-4218-9a1b-42706de9d57d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3e6ed3e9-bbfb-4218-9a1b-42706de9d57d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:18:39.290414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:39.291612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:39.292496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:39.292496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:39.292496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:39.292496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:39.292496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:18:39.292496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:18:39.292496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:18:39.292496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:18:39.292496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:18:39.292496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:18:39.292496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:18:39.292496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:18:39.292496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 615/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:18:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:39.298256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d83bb9-a3e6-48b7-b8c3-3af827eb4239 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:39.342153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:39.402151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d83bb9-a3e6-48b7-b8c3-3af827eb4239 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:39.436571 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cccd7-59ee-4467-b35e-3d8534b948ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:39.437240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cccd7-59ee-4467-b35e-3d8534b948ce None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:39.437515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cccd7-59ee-4467-b35e-3d8534b948ce None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:39.438478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cccd7-59ee-4467-b35e-3d8534b948ce None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:39.439364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cccd7-59ee-4467-b35e-3d8534b948ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:39.439664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cccd7-59ee-4467-b35e-3d8534b948ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:39.441047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cccd7-59ee-4467-b35e-3d8534b948ce None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:39.449009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 594/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:18:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:39.455013 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ed3e9-bbfb-4218-9a1b-42706de9d57d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:39.506186 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:39.556265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ed3e9-bbfb-4218-9a1b-42706de9d57d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:39.589097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cc0b6-809b-4345-952b-04846552d995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:39.589870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cc0b6-809b-4345-952b-04846552d995 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:39.590143 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cc0b6-809b-4345-952b-04846552d995 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:39.590404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cc0b6-809b-4345-952b-04846552d995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:39.601527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6cc0b6-809b-4345-952b-04846552d995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:39.602994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6cc0b6-809b-4345-952b-04846552d995 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:39.620596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1e6cc0b6-809b-4345-952b-04846552d995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:39.620596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:39.620596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:39.620596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:39.620596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:39.620596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:39.620596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:39.620596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:39.620596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:39.620596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:39.620596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:39.620596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:39.620596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:18:39.620596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:18:39.620596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:39.621598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:39.622722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:18:39.622722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:18:39.622722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:39.622722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:18:39.622722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 616/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:39.627778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cccd7-59ee-4467-b35e-3d8534b948ce None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:39.725610 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:39.728715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cccd7-59ee-4467-b35e-3d8534b948ce None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:39.762235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f5f5c-83c2-4fe3-a4b7-26b49098c526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:39.762917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f5f5c-83c2-4fe3-a4b7-26b49098c526 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:39.763200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f5f5c-83c2-4fe3-a4b7-26b49098c526 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:39.763473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f5f5c-83c2-4fe3-a4b7-26b49098c526 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:39.764192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f5f5c-83c2-4fe3-a4b7-26b49098c526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:39.764496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f5f5c-83c2-4fe3-a4b7-26b49098c526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:39.765929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f5f5c-83c2-4fe3-a4b7-26b49098c526 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:39.778422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 595/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:39.785001 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cc0b6-809b-4345-952b-04846552d995 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:39.885496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cc0b6-809b-4345-952b-04846552d995 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:39.886944 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:39.919714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffea422-7f81-4af5-87a7-02600d37d5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:39.920506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffea422-7f81-4af5-87a7-02600d37d5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:39.920785 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffea422-7f81-4af5-87a7-02600d37d5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:39.921055 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffea422-7f81-4af5-87a7-02600d37d5d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:39.928731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffea422-7f81-4af5-87a7-02600d37d5d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:39.930181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffea422-7f81-4af5-87a7-02600d37d5d8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2ffea422-7f81-4af5-87a7-02600d37d5d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:18:39.944792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:39.946465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:39.947690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:39.947690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:39.947690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:18:39.947690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:18:39.947690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:18:39.947690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:18:39.947690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:18:39.947690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:18:39.947690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:18:39.947690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:18:39.947690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 617/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:39.951854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f5f5c-83c2-4fe3-a4b7-26b49098c526 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:40.051299 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f5f5c-83c2-4fe3-a4b7-26b49098c526 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:40.086309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182f076-c06c-48d4-a5b6-374cf0c3836d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:40.086309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182f076-c06c-48d4-a5b6-374cf0c3836d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:40.086646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182f076-c06c-48d4-a5b6-374cf0c3836d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:40.086646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182f076-c06c-48d4-a5b6-374cf0c3836d None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:40.087487 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182f076-c06c-48d4-a5b6-374cf0c3836d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:40.087797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182f076-c06c-48d4-a5b6-374cf0c3836d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:40.089227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182f076-c06c-48d4-a5b6-374cf0c3836d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:40.106867 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 596/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jul 20 19:18:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:40.112739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffea422-7f81-4af5-87a7-02600d37d5d8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:40.213769 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffea422-7f81-4af5-87a7-02600d37d5d8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:40.250484 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824e440-d9a5-4331-9c30-fc717e438ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:40.251245 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824e440-d9a5-4331-9c30-fc717e438ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:40.251560 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824e440-d9a5-4331-9c30-fc717e438ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:40.251835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824e440-d9a5-4331-9c30-fc717e438ab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:40.288404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:40.327712 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824e440-d9a5-4331-9c30-fc717e438ab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:40.329808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824e440-d9a5-4331-9c30-fc717e438ab8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:40.428305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 618/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:18:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:18:40.434149 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182f076-c06c-48d4-a5b6-374cf0c3836d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:40.454215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:40.533692 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182f076-c06c-48d4-a5b6-374cf0c3836d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:40.569116 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d63d4-6907-476f-b65d-3683f3934c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:40.569904 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d63d4-6907-476f-b65d-3683f3934c7b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:40.570177 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d63d4-6907-476f-b65d-3683f3934c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:40.570474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d63d4-6907-476f-b65d-3683f3934c7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:40.581269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d63d4-6907-476f-b65d-3683f3934c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:40.587731 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d63d4-6907-476f-b65d-3683f3934c7b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:40.600424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c97d63d4-6907-476f-b65d-3683f3934c7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:40.600424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:40.600424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:40.600424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:40.600424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:40.600424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:40.600424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:40.600424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:40.600424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:40.600424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:40.600424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:40.600424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:40.600424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:18:40.600424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:18:40.600424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:40.601551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:40.602666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:18:40.602666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:18:40.602666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:40.602666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:18:40.602666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 597/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:40.607818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824e440-d9a5-4331-9c30-fc717e438ab8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:40.677601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:40.716652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824e440-d9a5-4331-9c30-fc717e438ab8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:40.751328 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4ec6a-4d02-4ffa-a775-a421802d8b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:40.751977 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4ec6a-4d02-4ffa-a775-a421802d8b5e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:40.752255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4ec6a-4d02-4ffa-a775-a421802d8b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:40.752527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4ec6a-4d02-4ffa-a775-a421802d8b5e None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:40.753246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4ec6a-4d02-4ffa-a775-a421802d8b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:40.753546 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4ec6a-4d02-4ffa-a775-a421802d8b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:40.754947 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4ec6a-4d02-4ffa-a775-a421802d8b5e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:40.767556 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 619/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:40.773404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d63d4-6907-476f-b65d-3683f3934c7b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:40.842135 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:40.874859 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d63d4-6907-476f-b65d-3683f3934c7b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:40.913905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181d5b8-cb9d-4fd1-ba16-19ba4e707734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:40.915167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181d5b8-cb9d-4fd1-ba16-19ba4e707734 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:40.915455 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181d5b8-cb9d-4fd1-ba16-19ba4e707734 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:40.915788 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181d5b8-cb9d-4fd1-ba16-19ba4e707734 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:40.923755 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181d5b8-cb9d-4fd1-ba16-19ba4e707734 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:40.925202 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181d5b8-cb9d-4fd1-ba16-19ba4e707734 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:40.939949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3181d5b8-cb9d-4fd1-ba16-19ba4e707734 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:18:40.939949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:40.939949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:40.939949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:40.939949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:40.939949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:40.939949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:40.939949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:40.939949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:40.939949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:40.939949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:40.939949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:40.939949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:18:40.939949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:18:40.939949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:40.941010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:40.941951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:18:40.941951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:18:40.941951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:18:40.941951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:18:40.941951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:18:40.941951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:18:40.941951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:18:40.941951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:18:40.941951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 598/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:18:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:40.947227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4ec6a-4d02-4ffa-a775-a421802d8b5e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:41.054782 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4ec6a-4d02-4ffa-a775-a421802d8b5e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:41.078026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:41.089418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43167e-68c4-4144-9b78-65951c10a3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:41.090075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43167e-68c4-4144-9b78-65951c10a3bf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:41.090353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43167e-68c4-4144-9b78-65951c10a3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:41.090628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43167e-68c4-4144-9b78-65951c10a3bf None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:41.091444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43167e-68c4-4144-9b78-65951c10a3bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:41.091749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43167e-68c4-4144-9b78-65951c10a3bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:41.093245 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43167e-68c4-4144-9b78-65951c10a3bf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:41.105251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 620/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:18:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:41.112037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181d5b8-cb9d-4fd1-ba16-19ba4e707734 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:41.213153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181d5b8-cb9d-4fd1-ba16-19ba4e707734 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:41.242327 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:41.248036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aea539-2ccc-47d4-bf87-013fad3448eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:41.252538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aea539-2ccc-47d4-bf87-013fad3448eb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:41.252538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aea539-2ccc-47d4-bf87-013fad3448eb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:41.252538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aea539-2ccc-47d4-bf87-013fad3448eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:41.252538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aea539-2ccc-47d4-bf87-013fad3448eb None admin] RBAC: Adding query filter params (role.id=33cbf420a4284279a9010e820bcece79, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=dbc616ed904d43d2b160b8d2766f7bc0) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:41.252538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aea539-2ccc-47d4-bf87-013fad3448eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:41.252538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aea539-2ccc-47d4-bf87-013fad3448eb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:41.257312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 599/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:18:41 2022] GET /identity/v3/role_assignments?user.id=dbc616ed904d43d2b160b8d2766f7bc0&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=33cbf420a4284279a9010e820bcece79 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:43.304510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b39ea5-efec-4633-9191-9f4598f7d36e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:43.313686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b39ea5-efec-4633-9191-9f4598f7d36e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:43.313686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b39ea5-efec-4633-9191-9f4598f7d36e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:43.313686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 621/1220] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:43.313975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcb649-2ad9-4948-83e4-1d1fe543d2b4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:43.313975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcb649-2ad9-4948-83e4-1d1fe543d2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:43.313975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcb649-2ad9-4948-83e4-1d1fe543d2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:43.330571 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-fbfcb649-2ad9-4948-83e4-1d1fe543d2b4 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:43.331784 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fbfcb649-2ad9-4948-83e4-1d1fe543d2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:43.399207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 600/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:18:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:18:43.423150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b39ea5-efec-4633-9191-9f4598f7d36e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:43.526696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b39ea5-efec-4633-9191-9f4598f7d36e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:43.562751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84686ff7-d8b4-4fc1-a110-765ceb75cf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:43.563579 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84686ff7-d8b4-4fc1-a110-765ceb75cf35 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:43.563861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84686ff7-d8b4-4fc1-a110-765ceb75cf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:43.564134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84686ff7-d8b4-4fc1-a110-765ceb75cf35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:43.575714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84686ff7-d8b4-4fc1-a110-765ceb75cf35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-84686ff7-d8b4-4fc1-a110-765ceb75cf35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:18:43.583856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:43.590872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:43.592052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:43.592052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:43.592052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:43.592052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:43.592052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:18:43.592052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:18:43.592052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:18:43.592052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:18:43.592052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:18:43.592052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:18:43.592052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:18:43.592052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:18:43.592052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 622/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:18:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:43.592974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcb649-2ad9-4948-83e4-1d1fe543d2b4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:43.699180 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcb649-2ad9-4948-83e4-1d1fe543d2b4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:43.724978 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:43.735842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf512fb6-de6a-4cb4-a693-1ab4df295b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:43.743146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf512fb6-de6a-4cb4-a693-1ab4df295b92 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:43.743146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf512fb6-de6a-4cb4-a693-1ab4df295b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:43.743146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf512fb6-de6a-4cb4-a693-1ab4df295b92 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:43.743146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf512fb6-de6a-4cb4-a693-1ab4df295b92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:43.743146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf512fb6-de6a-4cb4-a693-1ab4df295b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:43.743146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf512fb6-de6a-4cb4-a693-1ab4df295b92 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:43.747538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 601/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:18:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:18:43.753790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84686ff7-d8b4-4fc1-a110-765ceb75cf35 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:43.798440 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:43.855733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84686ff7-d8b4-4fc1-a110-765ceb75cf35 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:43.890856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce276f1-0414-46b8-9e18-2261b2063c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:43.891986 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce276f1-0414-46b8-9e18-2261b2063c3d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:43.892262 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce276f1-0414-46b8-9e18-2261b2063c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:43.892537 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce276f1-0414-46b8-9e18-2261b2063c3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:43.903156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce276f1-0414-46b8-9e18-2261b2063c3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:43.904614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce276f1-0414-46b8-9e18-2261b2063c3d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:43.922723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-6ce276f1-0414-46b8-9e18-2261b2063c3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:43.922723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:43.922723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:43.922723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:43.922723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:43.922723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:43.922723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:43.922723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:43.922723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:43.922723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:43.922723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:43.922723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:43.922723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:18:43.922723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:18:43.922723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:43.923870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:43.924983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:18:43.924983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:18:43.924983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:43.924983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:18:43.924983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 623/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:43.929912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf512fb6-de6a-4cb4-a693-1ab4df295b92 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:44.029188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf512fb6-de6a-4cb4-a693-1ab4df295b92 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:44.063471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751a029-c799-4391-8d61-ddfc86f7c380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:44.064124 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751a029-c799-4391-8d61-ddfc86f7c380 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:44.064406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751a029-c799-4391-8d61-ddfc86f7c380 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:44.064678 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751a029-c799-4391-8d61-ddfc86f7c380 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:44.065404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751a029-c799-4391-8d61-ddfc86f7c380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:44.065704 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751a029-c799-4391-8d61-ddfc86f7c380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:44.067099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751a029-c799-4391-8d61-ddfc86f7c380 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:44.080722 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 602/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:18:44.086817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce276f1-0414-46b8-9e18-2261b2063c3d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:44.185257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:44.193715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce276f1-0414-46b8-9e18-2261b2063c3d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:44.228315 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90ee51-bef9-49ba-8d09-e44f9b85b8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:44.229116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90ee51-bef9-49ba-8d09-e44f9b85b8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:44.229399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90ee51-bef9-49ba-8d09-e44f9b85b8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:44.229670 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90ee51-bef9-49ba-8d09-e44f9b85b8c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:44.237496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90ee51-bef9-49ba-8d09-e44f9b85b8c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:44.239009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90ee51-bef9-49ba-8d09-e44f9b85b8c1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-6e90ee51-bef9-49ba-8d09-e44f9b85b8c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:18:44.254121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:44.255826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:44.257410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:44.257410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:44.257410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:18:44.257410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:18:44.257410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:18:44.257410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:18:44.257410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:18:44.257410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:18:44.257410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:18:44.257410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:18:44.257410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 624/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:44.261633 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751a029-c799-4391-8d61-ddfc86f7c380 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:44.310110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:44.363689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751a029-c799-4391-8d61-ddfc86f7c380 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:44.398837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc550b3-86dc-475d-abc1-8fbfa49bf0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:44.399505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc550b3-86dc-475d-abc1-8fbfa49bf0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:44.399779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc550b3-86dc-475d-abc1-8fbfa49bf0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:44.400048 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc550b3-86dc-475d-abc1-8fbfa49bf0d5 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:44.400879 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc550b3-86dc-475d-abc1-8fbfa49bf0d5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:44.401182 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc550b3-86dc-475d-abc1-8fbfa49bf0d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:44.402599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc550b3-86dc-475d-abc1-8fbfa49bf0d5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:44.421195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 603/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jul 20 19:18:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:44.427682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90ee51-bef9-49ba-8d09-e44f9b85b8c1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:44.528147 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90ee51-bef9-49ba-8d09-e44f9b85b8c1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:44.562042 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c24cf8-ae23-43c3-b80f-95a399d1f3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:44.563433 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c24cf8-ae23-43c3-b80f-95a399d1f3dc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:44.563715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c24cf8-ae23-43c3-b80f-95a399d1f3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:44.563987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c24cf8-ae23-43c3-b80f-95a399d1f3dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:44.574735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c24cf8-ae23-43c3-b80f-95a399d1f3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:44.581316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c24cf8-ae23-43c3-b80f-95a399d1f3dc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:44.593493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-56c24cf8-ae23-43c3-b80f-95a399d1f3dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:44.593493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:44.593493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:44.593493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:44.593493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:44.593493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:44.593493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:44.593493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:44.593493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:44.593493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:44.593493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:44.593493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:44.593493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:18:44.593493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:18:44.593493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:44.594533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:44.595760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:18:44.595760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:18:44.595760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:44.595760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:18:44.595760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 625/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:44.600800 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc550b3-86dc-475d-abc1-8fbfa49bf0d5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:44.701770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc550b3-86dc-475d-abc1-8fbfa49bf0d5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:44.704169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:44.736799 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc0752-b9e2-4462-bcf8-f829e35308bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:44.737460 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc0752-b9e2-4462-bcf8-f829e35308bc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:44.737944 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc0752-b9e2-4462-bcf8-f829e35308bc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:44.738216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc0752-b9e2-4462-bcf8-f829e35308bc None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:44.739160 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc0752-b9e2-4462-bcf8-f829e35308bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:44.739477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc0752-b9e2-4462-bcf8-f829e35308bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:44.740856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc0752-b9e2-4462-bcf8-f829e35308bc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:44.753999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 604/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:44.759665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c24cf8-ae23-43c3-b80f-95a399d1f3dc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:44.769735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:44.861421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c24cf8-ae23-43c3-b80f-95a399d1f3dc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:44.894128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc884d8-f15a-4b97-8e7f-f1a184c81d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:44.894933 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc884d8-f15a-4b97-8e7f-f1a184c81d90 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:44.895214 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc884d8-f15a-4b97-8e7f-f1a184c81d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:44.895488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc884d8-f15a-4b97-8e7f-f1a184c81d90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:44.902141 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc884d8-f15a-4b97-8e7f-f1a184c81d90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:44.903619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc884d8-f15a-4b97-8e7f-f1a184c81d90 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:44.918770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-bdc884d8-f15a-4b97-8e7f-f1a184c81d90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:18:44.918770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:44.918770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:44.918770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:44.918770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:44.918770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:44.918770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:44.918770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:44.918770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:44.918770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:44.918770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:44.918770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:44.918770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:18:44.918770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:18:44.918770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:44.919884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:44.920965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:18:44.920965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:18:44.920965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:18:44.920965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:18:44.920965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:18:44.920965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:18:44.920965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:18:44.920965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:18:44.920965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 626/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:18:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:44.926637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc0752-b9e2-4462-bcf8-f829e35308bc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:45.038278 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc0752-b9e2-4462-bcf8-f829e35308bc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:45.072192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e358c9-3594-4d34-9613-0b7c0d4866e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:45.072841 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e358c9-3594-4d34-9613-0b7c0d4866e3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:45.073124 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e358c9-3594-4d34-9613-0b7c0d4866e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:45.073396 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e358c9-3594-4d34-9613-0b7c0d4866e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:45.074178 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e358c9-3594-4d34-9613-0b7c0d4866e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:45.074484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e358c9-3594-4d34-9613-0b7c0d4866e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:45.075944 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e358c9-3594-4d34-9613-0b7c0d4866e3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:45.088083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 605/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:18:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:45.094736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc884d8-f15a-4b97-8e7f-f1a184c81d90 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:45.160151 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:45.193909 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc884d8-f15a-4b97-8e7f-f1a184c81d90 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:45.229453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4751f-57c5-469e-929f-9b75405014c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:45.230329 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4751f-57c5-469e-929f-9b75405014c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:45.230601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4751f-57c5-469e-929f-9b75405014c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:45.230893 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4751f-57c5-469e-929f-9b75405014c0 None admin] PATH_INFO: `/v3/projects/50abbf0c38634795be669ec69da1f06d/users/dbc616ed904d43d2b160b8d2766f7bc0/roles/33cbf420a4284279a9010e820bcece79` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:45.245532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4751f-57c5-469e-929f-9b75405014c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=50abbf0c38634795be669ec69da1f06d, user_id=dbc616ed904d43d2b160b8d2766f7bc0, role_id=33cbf420a4284279a9010e820bcece79)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:45.247001 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4751f-57c5-469e-929f-9b75405014c0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:45.342063 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 627/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:18:45 2022] PUT /identity/v3/projects/50abbf0c38634795be669ec69da1f06d/users/dbc616ed904d43d2b160b8d2766f7bc0/roles/33cbf420a4284279a9010e820bcece79 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:18:47.437575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2e80f-67b8-4bce-9157-612a88b1174b None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:47.438168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2e80f-67b8-4bce-9157-612a88b1174b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:47.438319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2e80f-67b8-4bce-9157-612a88b1174b None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:47.439756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 606/1233] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:47.445222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5462530-1a16-46db-a4f9-2b7b35e70015 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:47.445663 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5462530-1a16-46db-a4f9-2b7b35e70015 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:47.445776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5462530-1a16-46db-a4f9-2b7b35e70015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:47.462507 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d5462530-1a16-46db-a4f9-2b7b35e70015 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:47.463725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d5462530-1a16-46db-a4f9-2b7b35e70015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:47.530880 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 628/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:18:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:18:47.556369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2e80f-67b8-4bce-9157-612a88b1174b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:47.582143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:47.656719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2e80f-67b8-4bce-9157-612a88b1174b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:47.692424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f45b7-a3f2-437e-a103-7b506b838352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:47.693218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f45b7-a3f2-437e-a103-7b506b838352 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:47.693495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f45b7-a3f2-437e-a103-7b506b838352 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:47.693765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f45b7-a3f2-437e-a103-7b506b838352 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:47.703804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f45b7-a3f2-437e-a103-7b506b838352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-218f45b7-a3f2-437e-a103-7b506b838352 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:18:47.711526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:47.712609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:47.713908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:47.713908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:47.713908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:47.713908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:47.713908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:18:47.713908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:18:47.713908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:18:47.713908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:18:47.713908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:18:47.713908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:18:47.713908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:18:47.713908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:18:47.713908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 607/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jul 20 19:18:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:47.724117 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5462530-1a16-46db-a4f9-2b7b35e70015 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:47.766660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:47.818437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5462530-1a16-46db-a4f9-2b7b35e70015 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:47.852090 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d69484-c771-4b83-89e1-64cbfe2778de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:47.852751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d69484-c771-4b83-89e1-64cbfe2778de None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:47.853029 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d69484-c771-4b83-89e1-64cbfe2778de None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:47.853299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d69484-c771-4b83-89e1-64cbfe2778de None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:47.854045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d69484-c771-4b83-89e1-64cbfe2778de None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:47.854350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d69484-c771-4b83-89e1-64cbfe2778de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:47.855765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d69484-c771-4b83-89e1-64cbfe2778de None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:47.864151 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 629/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jul 20 19:18:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:47.870232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f45b7-a3f2-437e-a103-7b506b838352 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:47.953292 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:47.969793 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f45b7-a3f2-437e-a103-7b506b838352 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:48.002421 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb942eb4-54e8-4914-aea2-1897cedc0b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:48.003239 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb942eb4-54e8-4914-aea2-1897cedc0b15 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:48.003516 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb942eb4-54e8-4914-aea2-1897cedc0b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:48.003783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb942eb4-54e8-4914-aea2-1897cedc0b15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:48.013919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb942eb4-54e8-4914-aea2-1897cedc0b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:48.015541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb942eb4-54e8-4914-aea2-1897cedc0b15 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:48.032746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-bb942eb4-54e8-4914-aea2-1897cedc0b15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:48.032746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:48.032746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:48.032746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:48.032746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:48.032746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:48.032746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:48.032746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:48.032746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:48.032746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:48.032746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:48.032746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:48.032746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:18:48.032746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:18:48.032746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:48.033869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:48.035018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:18:48.035018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:18:48.035018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:48.035018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:18:48.035018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 608/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:48.040319 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d69484-c771-4b83-89e1-64cbfe2778de None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:48.142238 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d69484-c771-4b83-89e1-64cbfe2778de None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:48.151133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:48.176860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b4c34-d896-401f-ba0e-bb7249c87c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:48.177517 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b4c34-d896-401f-ba0e-bb7249c87c1c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:48.177824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b4c34-d896-401f-ba0e-bb7249c87c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:48.178079 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b4c34-d896-401f-ba0e-bb7249c87c1c None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:48.178842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b4c34-d896-401f-ba0e-bb7249c87c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:48.179151 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b4c34-d896-401f-ba0e-bb7249c87c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:48.180526 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b4c34-d896-401f-ba0e-bb7249c87c1c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:48.192061 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 630/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:48.198108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb942eb4-54e8-4914-aea2-1897cedc0b15 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:48.301960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb942eb4-54e8-4914-aea2-1897cedc0b15 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:48.335317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc15b60-dd8f-42e9-aec2-415ab680baea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:48.336114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc15b60-dd8f-42e9-aec2-415ab680baea None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:48.336395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc15b60-dd8f-42e9-aec2-415ab680baea None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:48.336658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc15b60-dd8f-42e9-aec2-415ab680baea None admin] PATH_INFO: `/v3/users/placement` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:48.339352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:48.344906 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc15b60-dd8f-42e9-aec2-415ab680baea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:48.346363 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc15b60-dd8f-42e9-aec2-415ab680baea None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5dc15b60-dd8f-42e9-aec2-415ab680baea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:18:48.361085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:48.362480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:48.368873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:48.368873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:48.368873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:18:48.368873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:18:48.368873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:18:48.368873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:18:48.368873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:18:48.368873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:18:48.368873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:18:48.368873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:18:48.368873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 609/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:48.369616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b4c34-d896-401f-ba0e-bb7249c87c1c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:48.467759 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b4c34-d896-401f-ba0e-bb7249c87c1c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:48.501709 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c3db7-cec2-47d0-a6dd-5137c525e0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:48.502371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3db7-cec2-47d0-a6dd-5137c525e0fd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:48.502666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3db7-cec2-47d0-a6dd-5137c525e0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:48.502954 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3db7-cec2-47d0-a6dd-5137c525e0fd None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:48.503788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c3db7-cec2-47d0-a6dd-5137c525e0fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:48.504093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c3db7-cec2-47d0-a6dd-5137c525e0fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:48.505532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c3db7-cec2-47d0-a6dd-5137c525e0fd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:48.523333 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 631/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jul 20 19:18:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:48.529082 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc15b60-dd8f-42e9-aec2-415ab680baea None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:48.629476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc15b60-dd8f-42e9-aec2-415ab680baea None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:48.663033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e314ab-e887-48d6-ad2a-f052c031df6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:48.663672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e314ab-e887-48d6-ad2a-f052c031df6b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:48.664213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e314ab-e887-48d6-ad2a-f052c031df6b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:48.664485 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e314ab-e887-48d6-ad2a-f052c031df6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:48.728970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:48.736049 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e314ab-e887-48d6-ad2a-f052c031df6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:48.737512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e314ab-e887-48d6-ad2a-f052c031df6b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:48.835518 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 610/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:18:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:18:48.841107 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c3db7-cec2-47d0-a6dd-5137c525e0fd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:48.867991 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:48.941341 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c3db7-cec2-47d0-a6dd-5137c525e0fd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:48.980427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe472b4-90ef-4c26-9b9f-d746b13c6047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:48.981282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe472b4-90ef-4c26-9b9f-d746b13c6047 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:48.981617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe472b4-90ef-4c26-9b9f-d746b13c6047 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:48.981937 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe472b4-90ef-4c26-9b9f-d746b13c6047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:48.992738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe472b4-90ef-4c26-9b9f-d746b13c6047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:48.994197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe472b4-90ef-4c26-9b9f-d746b13c6047 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:49.011751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-dfe472b4-90ef-4c26-9b9f-d746b13c6047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:49.011751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:49.011751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:49.011751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:49.011751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:49.011751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:49.011751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:49.011751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:49.011751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:49.011751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:49.011751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:49.011751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:49.011751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:18:49.011751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:18:49.011751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:49.014080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:49.016155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:18:49.016155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:18:49.016155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:49.016155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:18:49.016155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 632/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:49.019320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e314ab-e887-48d6-ad2a-f052c031df6b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:49.113131 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:49.118595 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e314ab-e887-48d6-ad2a-f052c031df6b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:49.151481 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3c3c4-b653-4597-8948-732090455639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:49.152143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3c3c4-b653-4597-8948-732090455639 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:49.152424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3c3c4-b653-4597-8948-732090455639 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:49.152698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3c3c4-b653-4597-8948-732090455639 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:49.153415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3c3c4-b653-4597-8948-732090455639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:49.153718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3c3c4-b653-4597-8948-732090455639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:49.155121 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3c3c4-b653-4597-8948-732090455639 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:49.167048 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 611/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:49.172792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe472b4-90ef-4c26-9b9f-d746b13c6047 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:49.251926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:49.274059 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe472b4-90ef-4c26-9b9f-d746b13c6047 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:49.308485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dde6ec-77e6-45ae-a3b7-146e43ebd4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:49.309271 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dde6ec-77e6-45ae-a3b7-146e43ebd4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:49.309546 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dde6ec-77e6-45ae-a3b7-146e43ebd4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:49.309813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dde6ec-77e6-45ae-a3b7-146e43ebd4b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:49.318061 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dde6ec-77e6-45ae-a3b7-146e43ebd4b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:49.319567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dde6ec-77e6-45ae-a3b7-146e43ebd4b8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:49.334305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-81dde6ec-77e6-45ae-a3b7-146e43ebd4b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:18:49.334305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:49.334305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:49.334305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:49.334305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:49.334305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:49.334305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:49.334305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:49.334305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:49.334305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:49.334305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:49.334305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:49.334305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:18:49.334305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:18:49.334305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:49.335413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:49.336482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:18:49.336482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:18:49.336482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:18:49.336482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:18:49.336482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:18:49.336482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:18:49.336482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:18:49.336482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:18:49.336482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 633/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:18:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:49.341521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3c3c4-b653-4597-8948-732090455639 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:49.441656 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3c3c4-b653-4597-8948-732090455639 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:49.474701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f991d5-52e0-4704-86f4-a3fb24c08fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:49.475352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f991d5-52e0-4704-86f4-a3fb24c08fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:49.475633 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f991d5-52e0-4704-86f4-a3fb24c08fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:49.475902 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f991d5-52e0-4704-86f4-a3fb24c08fb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:49.476686 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f991d5-52e0-4704-86f4-a3fb24c08fb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:49.477004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f991d5-52e0-4704-86f4-a3fb24c08fb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:49.478462 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f991d5-52e0-4704-86f4-a3fb24c08fb3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:49.490436 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 612/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:18:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:49.496623 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dde6ec-77e6-45ae-a3b7-146e43ebd4b8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:49.597553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dde6ec-77e6-45ae-a3b7-146e43ebd4b8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:49.630987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a4241-8799-47dd-a536-f01b2bb7498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:49.631632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a4241-8799-47dd-a536-f01b2bb7498d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:49.631914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a4241-8799-47dd-a536-f01b2bb7498d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:49.632182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a4241-8799-47dd-a536-f01b2bb7498d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:49.633009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a4241-8799-47dd-a536-f01b2bb7498d None admin] RBAC: Adding query filter params (role.id=33cbf420a4284279a9010e820bcece79, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=dbc616ed904d43d2b160b8d2766f7bc0) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:49.633317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a4241-8799-47dd-a536-f01b2bb7498d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:49.634774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a4241-8799-47dd-a536-f01b2bb7498d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:49.641291 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 634/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:18:49 2022] GET /identity/v3/role_assignments?user.id=dbc616ed904d43d2b160b8d2766f7bc0&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=33cbf420a4284279a9010e820bcece79 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:51.776095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f3e96-73c4-434f-8bfb-00798f584385 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:51.776665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f3e96-73c4-434f-8bfb-00798f584385 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:51.776665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f3e96-73c4-434f-8bfb-00798f584385 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:51.778030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 613/1247] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:51.783934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e5d95-1f8c-4643-877b-c7fff66fb339 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:51.784388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e5d95-1f8c-4643-877b-c7fff66fb339 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:51.786004 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e5d95-1f8c-4643-877b-c7fff66fb339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:51.789791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:51.807862 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-313e5d95-1f8c-4643-877b-c7fff66fb339 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:51.807862 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-313e5d95-1f8c-4643-877b-c7fff66fb339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:51.871048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 635/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:18:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:18:51.894911 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f3e96-73c4-434f-8bfb-00798f584385 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:51.913279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:51.993619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f3e96-73c4-434f-8bfb-00798f584385 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:52.033419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bab545-dfce-44cc-9f08-2dd6c7575010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:52.033419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bab545-dfce-44cc-9f08-2dd6c7575010 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:52.033419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bab545-dfce-44cc-9f08-2dd6c7575010 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:52.033419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bab545-dfce-44cc-9f08-2dd6c7575010 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:52.040770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bab545-dfce-44cc-9f08-2dd6c7575010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f6bab545-dfce-44cc-9f08-2dd6c7575010 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:18:52.048787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:52.049844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:52.050890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:52.050890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:52.050890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:52.050890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:52.050890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:18:52.050890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:18:52.050890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:18:52.050890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:18:52.050890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:18:52.050890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:18:52.050890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:18:52.050890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:18:52.050890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 614/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:18:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:52.056216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e5d95-1f8c-4643-877b-c7fff66fb339 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:52.153155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e5d95-1f8c-4643-877b-c7fff66fb339 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:52.182402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:52.187413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aaf66-0d96-4e2a-84b8-c83ea8ff7caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:52.188070 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aaf66-0d96-4e2a-84b8-c83ea8ff7caa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:52.188343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aaf66-0d96-4e2a-84b8-c83ea8ff7caa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:52.188612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aaf66-0d96-4e2a-84b8-c83ea8ff7caa None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:52.189351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5aaf66-0d96-4e2a-84b8-c83ea8ff7caa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:52.189650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5aaf66-0d96-4e2a-84b8-c83ea8ff7caa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:52.191051 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5aaf66-0d96-4e2a-84b8-c83ea8ff7caa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:52.199032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 636/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:18:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:52.205621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bab545-dfce-44cc-9f08-2dd6c7575010 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:52.286042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:52.307601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bab545-dfce-44cc-9f08-2dd6c7575010 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:52.340912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc497a2-04fc-422f-8c10-3a543d737aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:52.341688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc497a2-04fc-422f-8c10-3a543d737aab None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:52.341966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc497a2-04fc-422f-8c10-3a543d737aab None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:52.342272 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc497a2-04fc-422f-8c10-3a543d737aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:52.354098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc497a2-04fc-422f-8c10-3a543d737aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:52.355701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc497a2-04fc-422f-8c10-3a543d737aab None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:52.374286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7bc497a2-04fc-422f-8c10-3a543d737aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:52.374286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:52.374286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:52.374286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:52.374286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:52.374286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:52.374286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:52.374286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:52.374286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:52.374286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:52.374286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:52.374286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:52.374286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:18:52.374286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:18:52.374286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:52.375406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:52.376395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:18:52.376395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:18:52.376395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:52.376395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:18:52.376395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 615/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:52.381578 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aaf66-0d96-4e2a-84b8-c83ea8ff7caa None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:52.480547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aaf66-0d96-4e2a-84b8-c83ea8ff7caa None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:52.515687 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff6531-e178-4319-9592-6221fa524318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:52.516345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff6531-e178-4319-9592-6221fa524318 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:52.516626 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff6531-e178-4319-9592-6221fa524318 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:52.516899 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff6531-e178-4319-9592-6221fa524318 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:52.517617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff6531-e178-4319-9592-6221fa524318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:52.517922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff6531-e178-4319-9592-6221fa524318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:52.519407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff6531-e178-4319-9592-6221fa524318 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:52.531502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 637/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:52.537565 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc497a2-04fc-422f-8c10-3a543d737aab None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:52.637653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc497a2-04fc-422f-8c10-3a543d737aab None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:52.663686 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:52.671926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b4a28-427f-4660-b01d-120651556d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:52.672634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b4a28-427f-4660-b01d-120651556d56 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:52.672906 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b4a28-427f-4660-b01d-120651556d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:52.673172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b4a28-427f-4660-b01d-120651556d56 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:52.680825 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b4a28-427f-4660-b01d-120651556d56 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:52.682249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b4a28-427f-4660-b01d-120651556d56 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-732b4a28-427f-4660-b01d-120651556d56 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:18:52.696954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:52.701497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:52.702689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:52.702689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:52.702689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:18:52.702689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:18:52.702689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:18:52.702689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:18:52.702689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:18:52.702689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:18:52.702689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:18:52.702689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:18:52.702689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 616/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:52.704665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff6531-e178-4319-9592-6221fa524318 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:52.762612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:52.806779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff6531-e178-4319-9592-6221fa524318 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:52.842689 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573cabc-fd69-4d8a-a101-fea217839f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:52.843355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573cabc-fd69-4d8a-a101-fea217839f22 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:52.843631 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573cabc-fd69-4d8a-a101-fea217839f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:52.843899 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573cabc-fd69-4d8a-a101-fea217839f22 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:52.844736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573cabc-fd69-4d8a-a101-fea217839f22 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:52.845032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573cabc-fd69-4d8a-a101-fea217839f22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:52.846450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573cabc-fd69-4d8a-a101-fea217839f22 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:52.863848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 638/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jul 20 19:18:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:52.869963 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b4a28-427f-4660-b01d-120651556d56 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:52.969284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b4a28-427f-4660-b01d-120651556d56 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:53.004210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56017609-13a1-44f1-9b90-eeb1cd59b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:53.004901 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56017609-13a1-44f1-9b90-eeb1cd59b075 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:53.005222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56017609-13a1-44f1-9b90-eeb1cd59b075 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:53.005554 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56017609-13a1-44f1-9b90-eeb1cd59b075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:53.062289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:53.073892 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56017609-13a1-44f1-9b90-eeb1cd59b075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:53.075371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56017609-13a1-44f1-9b90-eeb1cd59b075 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:53.174627 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 617/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:18:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:18:53.180515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573cabc-fd69-4d8a-a101-fea217839f22 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:53.277789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573cabc-fd69-4d8a-a101-fea217839f22 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:53.296314 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:53.316643 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ba38d-2915-40f0-9492-f173dfaa34e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:53.317355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ba38d-2915-40f0-9492-f173dfaa34e3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:53.317629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ba38d-2915-40f0-9492-f173dfaa34e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:53.317900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ba38d-2915-40f0-9492-f173dfaa34e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:53.328051 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ba38d-2915-40f0-9492-f173dfaa34e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:53.329501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ba38d-2915-40f0-9492-f173dfaa34e3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:53.347030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a18ba38d-2915-40f0-9492-f173dfaa34e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:53.347030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:53.347030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:53.347030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:53.347030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:53.347030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:53.347030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:53.347030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:53.347030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:53.347030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:53.347030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:53.347030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:53.347030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:18:53.347030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:18:53.347030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:53.348164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:53.349138 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:18:53.349138 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:18:53.349138 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:53.349138 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:18:53.349138 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 639/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:53.354213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56017609-13a1-44f1-9b90-eeb1cd59b075 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:53.441840 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:53.453865 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56017609-13a1-44f1-9b90-eeb1cd59b075 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:53.487733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc837de-a0d0-4985-9ca1-4636995826ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:53.488401 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc837de-a0d0-4985-9ca1-4636995826ee None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:53.488681 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc837de-a0d0-4985-9ca1-4636995826ee None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:53.488953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc837de-a0d0-4985-9ca1-4636995826ee None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:53.489732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc837de-a0d0-4985-9ca1-4636995826ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:53.490032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc837de-a0d0-4985-9ca1-4636995826ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:53.491426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc837de-a0d0-4985-9ca1-4636995826ee None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:53.502790 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 618/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:18:53.508860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ba38d-2915-40f0-9492-f173dfaa34e3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:53.610827 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ba38d-2915-40f0-9492-f173dfaa34e3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:53.646328 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828e942-3f3d-4f35-93b2-472b5f40aa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:53.647159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828e942-3f3d-4f35-93b2-472b5f40aa23 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:53.647443 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828e942-3f3d-4f35-93b2-472b5f40aa23 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:53.647717 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828e942-3f3d-4f35-93b2-472b5f40aa23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:53.654489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828e942-3f3d-4f35-93b2-472b5f40aa23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:53.661429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828e942-3f3d-4f35-93b2-472b5f40aa23 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:53.671388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2828e942-3f3d-4f35-93b2-472b5f40aa23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:18:53.671388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:53.671388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:53.671388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:53.671388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:53.671388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:53.671388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:53.671388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:53.671388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:53.671388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:53.671388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:53.671388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:53.671388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:18:53.671388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:18:53.671388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:53.672436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:53.673391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:18:53.673391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:18:53.673391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:18:53.673391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:18:53.673391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:18:53.673391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:18:53.673391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:18:53.673391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:18:53.673391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 640/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:18:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:53.678542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc837de-a0d0-4985-9ca1-4636995826ee None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:53.782776 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc837de-a0d0-4985-9ca1-4636995826ee None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:53.817100 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ec8ee-ac0f-4739-b499-b8e9bf7c84fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:53.817761 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ec8ee-ac0f-4739-b499-b8e9bf7c84fe None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:53.818040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ec8ee-ac0f-4739-b499-b8e9bf7c84fe None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:53.818309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ec8ee-ac0f-4739-b499-b8e9bf7c84fe None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:53.819123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ec8ee-ac0f-4739-b499-b8e9bf7c84fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:53.819431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ec8ee-ac0f-4739-b499-b8e9bf7c84fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:53.820872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ec8ee-ac0f-4739-b499-b8e9bf7c84fe None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:53.834050 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 619/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:18:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:53.840194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828e942-3f3d-4f35-93b2-472b5f40aa23 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:53.866609 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:53.941443 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828e942-3f3d-4f35-93b2-472b5f40aa23 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:53.976742 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23291b3-9933-4118-968a-e6df0bfec4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:53.977406 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23291b3-9933-4118-968a-e6df0bfec4ff None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:53.977680 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23291b3-9933-4118-968a-e6df0bfec4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:53.977946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23291b3-9933-4118-968a-e6df0bfec4ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:53.978798 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23291b3-9933-4118-968a-e6df0bfec4ff None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=dbc616ed904d43d2b160b8d2766f7bc0) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:53.979103 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23291b3-9933-4118-968a-e6df0bfec4ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:53.980609 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23291b3-9933-4118-968a-e6df0bfec4ff None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:53.986028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 641/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:18:53 2022] GET /identity/v3/role_assignments?user.id=dbc616ed904d43d2b160b8d2766f7bc0&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:56.020383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b1862-8a88-4fda-a823-3b8abe98151b None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:56.020945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b1862-8a88-4fda-a823-3b8abe98151b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:56.020945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b1862-8a88-4fda-a823-3b8abe98151b None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:56.022327 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 620/1261] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:56.027544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf578a-94e9-4075-800e-9b2178399c41 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:56.027971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf578a-94e9-4075-800e-9b2178399c41 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:56.028078 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf578a-94e9-4075-800e-9b2178399c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:56.046389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-88bf578a-94e9-4075-800e-9b2178399c41 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:56.047598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-88bf578a-94e9-4075-800e-9b2178399c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:56.117930 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 642/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:18:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:18:56.149142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b1862-8a88-4fda-a823-3b8abe98151b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:56.160242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:56.251044 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b1862-8a88-4fda-a823-3b8abe98151b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:56.285916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce4858-5d41-4a4d-9b56-515daaee70d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:56.286746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce4858-5d41-4a4d-9b56-515daaee70d7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:56.287029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce4858-5d41-4a4d-9b56-515daaee70d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:56.287298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce4858-5d41-4a4d-9b56-515daaee70d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:56.298551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce4858-5d41-4a4d-9b56-515daaee70d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3cce4858-5d41-4a4d-9b56-515daaee70d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:18:56.306246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:56.307466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:56.308467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:56.308467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:56.308467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:56.308467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:56.308467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:18:56.308467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:18:56.308467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:18:56.308467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:18:56.308467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:18:56.308467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:18:56.308467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:18:56.308467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:18:56.308467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 621/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:18:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:56.313603 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf578a-94e9-4075-800e-9b2178399c41 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:56.331907 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:56.415475 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf578a-94e9-4075-800e-9b2178399c41 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:56.448800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ae73c-f16c-4152-9a1b-737b2f0f6bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:56.449473 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ae73c-f16c-4152-9a1b-737b2f0f6bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:56.449747 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ae73c-f16c-4152-9a1b-737b2f0f6bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:56.449990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ae73c-f16c-4152-9a1b-737b2f0f6bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:56.450750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ae73c-f16c-4152-9a1b-737b2f0f6bb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:56.451047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ae73c-f16c-4152-9a1b-737b2f0f6bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:56.452941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ae73c-f16c-4152-9a1b-737b2f0f6bb6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:56.461350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 643/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:18:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:56.467512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce4858-5d41-4a4d-9b56-515daaee70d7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:56.548458 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:56.583621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce4858-5d41-4a4d-9b56-515daaee70d7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:56.616206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7a922-e7d8-4773-9920-68489a630a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:56.617005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7a922-e7d8-4773-9920-68489a630a01 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:56.617278 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7a922-e7d8-4773-9920-68489a630a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:56.617548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7a922-e7d8-4773-9920-68489a630a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:56.628629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7a922-e7d8-4773-9920-68489a630a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:56.630065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7a922-e7d8-4773-9920-68489a630a01 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:56.647230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-fed7a922-e7d8-4773-9920-68489a630a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:56.647230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:56.647230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:56.647230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:56.647230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:56.647230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:56.647230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:56.647230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:56.647230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:56.647230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:56.647230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:56.647230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:56.647230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:18:56.647230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:18:56.647230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:56.648320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:56.649515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:18:56.649515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:18:56.649515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:56.649515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:18:56.649515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 622/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:56.655642 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ae73c-f16c-4152-9a1b-737b2f0f6bb6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:56.738534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:56.756885 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ae73c-f16c-4152-9a1b-737b2f0f6bb6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:56.790286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a96a54-457f-4e7e-9cba-32ce7697b012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:56.790965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a96a54-457f-4e7e-9cba-32ce7697b012 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:56.791241 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a96a54-457f-4e7e-9cba-32ce7697b012 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:56.791509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a96a54-457f-4e7e-9cba-32ce7697b012 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:56.792220 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a96a54-457f-4e7e-9cba-32ce7697b012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:56.792519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a96a54-457f-4e7e-9cba-32ce7697b012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:56.793884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a96a54-457f-4e7e-9cba-32ce7697b012 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:56.815302 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 644/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:56.815626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7a922-e7d8-4773-9920-68489a630a01 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:56.914388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7a922-e7d8-4773-9920-68489a630a01 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:56.934140 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:56.948502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d8dbc-0e37-41ec-9d0e-b33c044ac105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:56.949298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d8dbc-0e37-41ec-9d0e-b33c044ac105 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:56.949575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d8dbc-0e37-41ec-9d0e-b33c044ac105 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:56.949846 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d8dbc-0e37-41ec-9d0e-b33c044ac105 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:56.957916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d8dbc-0e37-41ec-9d0e-b33c044ac105 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:56.959382 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d8dbc-0e37-41ec-9d0e-b33c044ac105 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-221d8dbc-0e37-41ec-9d0e-b33c044ac105 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:18:56.973320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:56.974416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:56.975838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:56.975838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:56.975838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:18:56.975838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:18:56.975838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:18:56.975838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:18:56.975838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:18:56.975838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:18:56.975838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:18:56.975838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:18:56.975838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 623/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:56.980482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a96a54-457f-4e7e-9cba-32ce7697b012 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:57.087924 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a96a54-457f-4e7e-9cba-32ce7697b012 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:57.122102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e0e15-453d-4966-91d1-e916a848a00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:57.122780 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e0e15-453d-4966-91d1-e916a848a00f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:57.123579 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e0e15-453d-4966-91d1-e916a848a00f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:57.123845 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e0e15-453d-4966-91d1-e916a848a00f None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:57.124782 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e0e15-453d-4966-91d1-e916a848a00f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:57.125088 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e0e15-453d-4966-91d1-e916a848a00f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:57.126555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e0e15-453d-4966-91d1-e916a848a00f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:57.135965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:57.144966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 645/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jul 20 19:18:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:57.151301 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d8dbc-0e37-41ec-9d0e-b33c044ac105 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:57.251836 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d8dbc-0e37-41ec-9d0e-b33c044ac105 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:57.285070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d186149-bb88-476e-b54c-8ac57c21800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:57.285978 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d186149-bb88-476e-b54c-8ac57c21800c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:57.379151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d186149-bb88-476e-b54c-8ac57c21800c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:57.379151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d186149-bb88-476e-b54c-8ac57c21800c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:57.379151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d186149-bb88-476e-b54c-8ac57c21800c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:57.379151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d186149-bb88-476e-b54c-8ac57c21800c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:57.379151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-1d186149-bb88-476e-b54c-8ac57c21800c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:57.379151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:57.379151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:57.379151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:57.379151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:57.379816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:57.380829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:57.380829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:57.380829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:57.380829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:57.380829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:57.380829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:57.380829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:57.380829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:57.380829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:57.380829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:57.380829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:18:57.380829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:18:57.380829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:18:57.380829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:18:57.380829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 624/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:57.381707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e0e15-453d-4966-91d1-e916a848a00f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:57.429783 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e0e15-453d-4966-91d1-e916a848a00f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:57.463110 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d325ab-4bb6-47c7-90cd-3fcd9800e8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:57.463762 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d325ab-4bb6-47c7-90cd-3fcd9800e8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:57.464032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d325ab-4bb6-47c7-90cd-3fcd9800e8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:57.464300 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d325ab-4bb6-47c7-90cd-3fcd9800e8f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:57.465010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d325ab-4bb6-47c7-90cd-3fcd9800e8f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:57.465305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d325ab-4bb6-47c7-90cd-3fcd9800e8f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:57.467292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d325ab-4bb6-47c7-90cd-3fcd9800e8f1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:57.478393 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 646/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:57.484190 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d186149-bb88-476e-b54c-8ac57c21800c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:57.516742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:57.584904 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d186149-bb88-476e-b54c-8ac57c21800c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:57.617037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b90925-9dcc-424f-8d73-fbb1db450e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:57.617818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b90925-9dcc-424f-8d73-fbb1db450e5f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:57.618098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b90925-9dcc-424f-8d73-fbb1db450e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:57.618368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b90925-9dcc-424f-8d73-fbb1db450e5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:57.626913 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b90925-9dcc-424f-8d73-fbb1db450e5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:57.628367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b90925-9dcc-424f-8d73-fbb1db450e5f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:57.643673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c8b90925-9dcc-424f-8d73-fbb1db450e5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:18:57.643673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:18:57.643673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:18:57.643673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:18:57.643673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:18:57.643673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:18:57.643673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:18:57.643673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:18:57.643673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:18:57.643673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:18:57.643673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:18:57.643673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:18:57.643673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:18:57.643673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:18:57.643673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:18:57.644804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:18:57.645779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:18:57.645779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:18:57.645779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:18:57.645779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:18:57.645779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:18:57.645779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:18:57.645779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:18:57.645779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:18:57.645779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 625/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:18:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:18:57.650852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d325ab-4bb6-47c7-90cd-3fcd9800e8f1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:57.709867 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:57.751609 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d325ab-4bb6-47c7-90cd-3fcd9800e8f1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:57.785410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7ed7d-7101-407d-a1f9-0355a1c3fb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:57.786062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7ed7d-7101-407d-a1f9-0355a1c3fb9c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:57.786484 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7ed7d-7101-407d-a1f9-0355a1c3fb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:57.786796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7ed7d-7101-407d-a1f9-0355a1c3fb9c None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:57.788065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7ed7d-7101-407d-a1f9-0355a1c3fb9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:18:57.788385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7ed7d-7101-407d-a1f9-0355a1c3fb9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:57.790059 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7ed7d-7101-407d-a1f9-0355a1c3fb9c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:57.803785 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 647/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:18:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:18:57.809841 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b90925-9dcc-424f-8d73-fbb1db450e5f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:57.905259 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:57.914907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b90925-9dcc-424f-8d73-fbb1db450e5f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:57.949448 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd33fc-299e-4704-992d-ff42f26eadff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:57.950361 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd33fc-299e-4704-992d-ff42f26eadff None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:57.950643 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd33fc-299e-4704-992d-ff42f26eadff None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:57.951041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd33fc-299e-4704-992d-ff42f26eadff None admin] PATH_INFO: `/v3/projects/50abbf0c38634795be669ec69da1f06d/users/dbc616ed904d43d2b160b8d2766f7bc0/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:57.953144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd33fc-299e-4704-992d-ff42f26eadff None admin] RBAC: Authorizing `identity:create_grant(project_id=50abbf0c38634795be669ec69da1f06d, user_id=dbc616ed904d43d2b160b8d2766f7bc0, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:57.954582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd33fc-299e-4704-992d-ff42f26eadff None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:58.088698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 626/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jul 20 19:18:57 2022] PUT /identity/v3/projects/50abbf0c38634795be669ec69da1f06d/users/dbc616ed904d43d2b160b8d2766f7bc0/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:19:00.172960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f6c97-636e-453f-a094-3d6190529c08 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:00.173489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f6c97-636e-453f-a094-3d6190529c08 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:00.173489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f6c97-636e-453f-a094-3d6190529c08 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:00.174892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 648/1274] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:19:00.180071 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3be53-f04c-4bc2-a803-58cd1cda5281 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:00.180473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3be53-f04c-4bc2-a803-58cd1cda5281 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:00.180623 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3be53-f04c-4bc2-a803-58cd1cda5281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:00.197641 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6bb3be53-f04c-4bc2-a803-58cd1cda5281 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:19:00.198864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6bb3be53-f04c-4bc2-a803-58cd1cda5281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:00.266375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 627/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:19:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:19:00.290225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f6c97-636e-453f-a094-3d6190529c08 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:00.393354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f6c97-636e-453f-a094-3d6190529c08 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:00.410653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:00.427743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0cf8f-e947-43fb-a33e-b53f49e8fbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:00.428465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0cf8f-e947-43fb-a33e-b53f49e8fbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:00.428747 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0cf8f-e947-43fb-a33e-b53f49e8fbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:00.429017 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0cf8f-e947-43fb-a33e-b53f49e8fbe1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:00.439797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0cf8f-e947-43fb-a33e-b53f49e8fbe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d0a0cf8f-e947-43fb-a33e-b53f49e8fbe1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:19:00.447493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:19:00.448640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:19:00.449881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:19:00.449881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:19:00.449881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:19:00.449881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:19:00.449881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:19:00.449881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:19:00.449881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:19:00.449881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:19:00.449881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:19:00.449881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:19:00.449881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:19:00.449881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:19:00.449881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 649/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jul 20 19:19:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:19:00.454998 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3be53-f04c-4bc2-a803-58cd1cda5281 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:00.538245 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:00.556594 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3be53-f04c-4bc2-a803-58cd1cda5281 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:00.589606 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655266e-804a-4acc-8dce-a39d7a8ce046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:00.590263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655266e-804a-4acc-8dce-a39d7a8ce046 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:00.590542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655266e-804a-4acc-8dce-a39d7a8ce046 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:00.590850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655266e-804a-4acc-8dce-a39d7a8ce046 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:00.592093 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655266e-804a-4acc-8dce-a39d7a8ce046 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:19:00.592394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655266e-804a-4acc-8dce-a39d7a8ce046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:00.593757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655266e-804a-4acc-8dce-a39d7a8ce046 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:00.601671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 628/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jul 20 19:19:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:19:00.607999 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0cf8f-e947-43fb-a33e-b53f49e8fbe1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:00.709255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0cf8f-e947-43fb-a33e-b53f49e8fbe1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:00.744219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1150e4-4273-432e-9407-57b5863665e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:00.745162 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1150e4-4273-432e-9407-57b5863665e6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:00.745433 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1150e4-4273-432e-9407-57b5863665e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:00.745713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1150e4-4273-432e-9407-57b5863665e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:00.756804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1150e4-4273-432e-9407-57b5863665e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:00.758343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1150e4-4273-432e-9407-57b5863665e6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:00.775987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3d1150e4-4273-432e-9407-57b5863665e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:19:00.775987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:19:00.775987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:19:00.775987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:19:00.775987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:19:00.775987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:19:00.775987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:19:00.775987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:19:00.775987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:19:00.775987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:19:00.775987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:19:00.775987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:19:00.775987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:19:00.775987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:19:00.775987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:19:00.782693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:19:00.783821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:19:00.783821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:19:00.783821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:19:00.783821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:19:00.783821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 650/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:19:00.784182 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655266e-804a-4acc-8dce-a39d7a8ce046 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:00.886034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655266e-804a-4acc-8dce-a39d7a8ce046 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:00.920611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7cd7d-907c-4886-a5fc-db150a0ef125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:00.921276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7cd7d-907c-4886-a5fc-db150a0ef125 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:00.921555 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7cd7d-907c-4886-a5fc-db150a0ef125 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:00.921830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7cd7d-907c-4886-a5fc-db150a0ef125 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:00.922553 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7cd7d-907c-4886-a5fc-db150a0ef125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:19:00.922886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7cd7d-907c-4886-a5fc-db150a0ef125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:00.924336 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7cd7d-907c-4886-a5fc-db150a0ef125 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:00.936960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 629/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:19:00.942872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1150e4-4273-432e-9407-57b5863665e6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:00.975974 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:01.044631 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1150e4-4273-432e-9407-57b5863665e6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:01.078932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427af13-ce4b-487d-9697-a69d1e47c57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:01.079725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427af13-ce4b-487d-9697-a69d1e47c57d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:01.080000 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427af13-ce4b-487d-9697-a69d1e47c57d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:01.080269 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427af13-ce4b-487d-9697-a69d1e47c57d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:01.087213 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427af13-ce4b-487d-9697-a69d1e47c57d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:01.088651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427af13-ce4b-487d-9697-a69d1e47c57d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2427af13-ce4b-487d-9697-a69d1e47c57d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:19:01.103538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:19:01.104686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:19:01.105891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:19:01.105891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:19:01.105891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:19:01.105891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:19:01.105891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:19:01.105891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:19:01.105891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:19:01.105891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:19:01.105891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:19:01.105891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:19:01.105891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 651/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:19:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:19:01.110498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7cd7d-907c-4886-a5fc-db150a0ef125 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:01.114309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:01.215775 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7cd7d-907c-4886-a5fc-db150a0ef125 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:01.250211 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94549b-73f1-4ac0-9a42-c95aa19aae98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:01.250833 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94549b-73f1-4ac0-9a42-c95aa19aae98 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:01.251112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94549b-73f1-4ac0-9a42-c95aa19aae98 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:01.251381 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94549b-73f1-4ac0-9a42-c95aa19aae98 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:01.252222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94549b-73f1-4ac0-9a42-c95aa19aae98 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:19:01.252521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94549b-73f1-4ac0-9a42-c95aa19aae98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:01.253946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94549b-73f1-4ac0-9a42-c95aa19aae98 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:01.271306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 630/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jul 20 19:19:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:19:01.277106 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427af13-ce4b-487d-9697-a69d1e47c57d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:01.371447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:01.381226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427af13-ce4b-487d-9697-a69d1e47c57d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:01.415750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19f0f8-ac8e-4b6c-af18-8632078817b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:01.416388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19f0f8-ac8e-4b6c-af18-8632078817b4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:01.416668 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19f0f8-ac8e-4b6c-af18-8632078817b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:01.416941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19f0f8-ac8e-4b6c-af18-8632078817b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:01.484331 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19f0f8-ac8e-4b6c-af18-8632078817b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:01.485806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19f0f8-ac8e-4b6c-af18-8632078817b4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:01.574831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:01.585187 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 652/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jul 20 19:19:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:19:01.591694 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94549b-73f1-4ac0-9a42-c95aa19aae98 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:01.656178 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:01.694052 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94549b-73f1-4ac0-9a42-c95aa19aae98 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:01.727076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce1194-f006-44b9-8932-3de60c39866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:01.727854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce1194-f006-44b9-8932-3de60c39866d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:01.728129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce1194-f006-44b9-8932-3de60c39866d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:01.728439 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce1194-f006-44b9-8932-3de60c39866d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:01.738097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce1194-f006-44b9-8932-3de60c39866d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:01.739561 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce1194-f006-44b9-8932-3de60c39866d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:01.756628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-14ce1194-f006-44b9-8932-3de60c39866d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:19:01.756628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:19:01.756628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:19:01.756628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:19:01.756628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:19:01.756628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:19:01.756628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:19:01.756628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:19:01.756628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:19:01.756628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:19:01.756628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:19:01.756628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:19:01.756628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:19:01.756628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:19:01.756628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:19:01.757723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:19:01.758908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:19:01.758908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:19:01.758908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:19:01.758908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:19:01.758908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 631/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:19:01.764460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19f0f8-ac8e-4b6c-af18-8632078817b4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:01.865498 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19f0f8-ac8e-4b6c-af18-8632078817b4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:01.899327 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2db086-121e-4131-8477-b7f49d23aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:01.899984 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2db086-121e-4131-8477-b7f49d23aed4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:01.900266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2db086-121e-4131-8477-b7f49d23aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:01.900534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2db086-121e-4131-8477-b7f49d23aed4 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:01.901252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2db086-121e-4131-8477-b7f49d23aed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:19:01.901554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2db086-121e-4131-8477-b7f49d23aed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:01.902954 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2db086-121e-4131-8477-b7f49d23aed4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:01.915292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 653/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jul 20 19:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:19:01.921702 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce1194-f006-44b9-8932-3de60c39866d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:02.026615 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce1194-f006-44b9-8932-3de60c39866d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:02.041793 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:02.061905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49b71e-53d3-4b9f-8285-b908d468f312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:02.062709 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49b71e-53d3-4b9f-8285-b908d468f312 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:02.062988 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49b71e-53d3-4b9f-8285-b908d468f312 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:02.063255 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49b71e-53d3-4b9f-8285-b908d468f312 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:02.069824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49b71e-53d3-4b9f-8285-b908d468f312 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:02.071309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49b71e-53d3-4b9f-8285-b908d468f312 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:02.085712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5c49b71e-53d3-4b9f-8285-b908d468f312 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:19:02.085712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:19:02.085712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:19:02.085712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:19:02.085712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:19:02.085712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:19:02.085712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:19:02.085712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:19:02.085712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:19:02.085712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:19:02.085712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:19:02.085712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:19:02.085712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:19:02.085712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:19:02.085712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:19:02.088171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:19:02.089328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:19:02.089328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:19:02.089328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:19:02.089328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:19:02.089328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:19:02.089328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:19:02.089328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:19:02.089328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Jul 20 19:19:02.089328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 632/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jul 20 19:19:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:19:02.093429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2db086-121e-4131-8477-b7f49d23aed4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:02.144369 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:02.196410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2db086-121e-4131-8477-b7f49d23aed4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:02.230071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a827818-aa31-46a2-9cbb-ab375b2812d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:02.230749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a827818-aa31-46a2-9cbb-ab375b2812d6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:02.231030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a827818-aa31-46a2-9cbb-ab375b2812d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:02.231300 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a827818-aa31-46a2-9cbb-ab375b2812d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:02.232961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a827818-aa31-46a2-9cbb-ab375b2812d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:19:02.233270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a827818-aa31-46a2-9cbb-ab375b2812d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:02.234732 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a827818-aa31-46a2-9cbb-ab375b2812d6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:02.246720 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 654/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jul 20 19:19:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:19:02.253247 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49b71e-53d3-4b9f-8285-b908d468f312 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:02.358392 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49b71e-53d3-4b9f-8285-b908d468f312 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:02.392227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398b3f2-06ef-48db-bb1e-123c3274dbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:02.396210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398b3f2-06ef-48db-bb1e-123c3274dbed None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:02.396210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398b3f2-06ef-48db-bb1e-123c3274dbed None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:02.396210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398b3f2-06ef-48db-bb1e-123c3274dbed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:02.396210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398b3f2-06ef-48db-bb1e-123c3274dbed None admin] RBAC: Adding query filter params (role.id=ca62bd2769af4a27b40a9368b3b11406, scope.project.id=50abbf0c38634795be669ec69da1f06d, user.id=dbc616ed904d43d2b160b8d2766f7bc0) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:19:02.396210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398b3f2-06ef-48db-bb1e-123c3274dbed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:02.396210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398b3f2-06ef-48db-bb1e-123c3274dbed None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:02.401730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 633/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jul 20 19:19:02 2022] GET /identity/v3/role_assignments?user.id=dbc616ed904d43d2b160b8d2766f7bc0&scope.project.id=50abbf0c38634795be669ec69da1f06d&role.id=ca62bd2769af4a27b40a9368b3b11406 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:19:04.472654 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513fb43-760d-4f86-9e5a-bd711256d90f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:04.473182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513fb43-760d-4f86-9e5a-bd711256d90f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:04.473182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513fb43-760d-4f86-9e5a-bd711256d90f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:04.474573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 655/1288] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:19:04.479796 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c0c76-db7b-4b9a-82d7-63726f6a7d16 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:04.480185 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c0c76-db7b-4b9a-82d7-63726f6a7d16 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:04.484800 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c0c76-db7b-4b9a-82d7-63726f6a7d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:04.498821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-212c0c76-db7b-4b9a-82d7-63726f6a7d16 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:19:04.500012 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-212c0c76-db7b-4b9a-82d7-63726f6a7d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:04.532198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:04.569984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 634/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:19:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:19:04.593660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513fb43-760d-4f86-9e5a-bd711256d90f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:04.698945 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513fb43-760d-4f86-9e5a-bd711256d90f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:04.710145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:04.734135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55347913-ea77-4e03-b6df-c84173fe725e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:04.734969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55347913-ea77-4e03-b6df-c84173fe725e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:04.735248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55347913-ea77-4e03-b6df-c84173fe725e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:04.735523 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55347913-ea77-4e03-b6df-c84173fe725e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:04.736181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55347913-ea77-4e03-b6df-c84173fe725e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:04.737607 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55347913-ea77-4e03-b6df-c84173fe725e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-55347913-ea77-4e03-b6df-c84173fe725e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:19:04.750267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:19:04.751536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:19:04.752688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:19:04.752688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:19:04.752688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:19:04.752688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:19:04.752688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:19:04.752688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:19:04.752688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:19:04.752688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:19:04.752688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:19:04.752688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:19:04.752688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:19:04.752688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:19:04.752688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:19:04.752688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:19:04.752688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 656/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jul 20 19:19:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:19:04.757719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c0c76-db7b-4b9a-82d7-63726f6a7d16 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:04.859179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c0c76-db7b-4b9a-82d7-63726f6a7d16 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:04.893913 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e8327-ac9e-43cb-8597-2384367e3fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:04.894573 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e8327-ac9e-43cb-8597-2384367e3fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:04.894879 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e8327-ac9e-43cb-8597-2384367e3fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:04.895155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e8327-ac9e-43cb-8597-2384367e3fc7 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:04.895852 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e8327-ac9e-43cb-8597-2384367e3fc7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:19:04.896152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e8327-ac9e-43cb-8597-2384367e3fc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:04.897515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e8327-ac9e-43cb-8597-2384367e3fc7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:04.902315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 635/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jul 20 19:19:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:19:04.908736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55347913-ea77-4e03-b6df-c84173fe725e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:05.009780 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55347913-ea77-4e03-b6df-c84173fe725e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:05.044425 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948d345-c32a-467d-9359-d6af3a0efceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:05.045254 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948d345-c32a-467d-9359-d6af3a0efceb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:05.045531 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948d345-c32a-467d-9359-d6af3a0efceb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:05.045799 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948d345-c32a-467d-9359-d6af3a0efceb None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:05.046528 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948d345-c32a-467d-9359-d6af3a0efceb None admin] RBAC: Adding query filter params (type=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:19:05.046861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948d345-c32a-467d-9359-d6af3a0efceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:05.048240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948d345-c32a-467d-9359-d6af3a0efceb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:05.052655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 657/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jul 20 19:19:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:19:07.134180 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b3257-cfa9-43be-a8b9-13ea36750511 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:07.134760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b3257-cfa9-43be-a8b9-13ea36750511 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:07.134760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b3257-cfa9-43be-a8b9-13ea36750511 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:07.136143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 636/1293] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:19:07.142371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e310-b749-4d31-9845-0338c0c0e081 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:07.143074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e310-b749-4d31-9845-0338c0c0e081 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:07.143074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e310-b749-4d31-9845-0338c0c0e081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:07.162382 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-78e2e310-b749-4d31-9845-0338c0c0e081 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:19:07.163631 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-78e2e310-b749-4d31-9845-0338c0c0e081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:07.197317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:07.236898 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 658/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:19:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:19:07.260569 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b3257-cfa9-43be-a8b9-13ea36750511 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:07.296894 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:07.370381 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b3257-cfa9-43be-a8b9-13ea36750511 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:07.403936 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dac281-8615-4cbb-ba92-2621ea8fc00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:07.404589 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dac281-8615-4cbb-ba92-2621ea8fc00d None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:07.404864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dac281-8615-4cbb-ba92-2621ea8fc00d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:07.405127 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dac281-8615-4cbb-ba92-2621ea8fc00d None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:07.405841 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dac281-8615-4cbb-ba92-2621ea8fc00d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:07.407269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dac281-8615-4cbb-ba92-2621ea8fc00d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:07.536358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 637/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jul 20 19:19:07 2022] POST /identity/v3/services => generated 246 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:19:09.584392 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d606b0-4219-4af7-9ad9-fce129c02340 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:09.584894 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d606b0-4219-4af7-9ad9-fce129c02340 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:09.584894 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d606b0-4219-4af7-9ad9-fce129c02340 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:09.586371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 659/1296] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:19:09.591681 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86b29-56b1-47b7-b0b8-f92568552452 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:09.592264 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86b29-56b1-47b7-b0b8-f92568552452 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:09.592264 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86b29-56b1-47b7-b0b8-f92568552452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:09.608906 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e6d86b29-56b1-47b7-b0b8-f92568552452 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:19:09.610090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e6d86b29-56b1-47b7-b0b8-f92568552452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:09.683046 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 638/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:19:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:19:09.707112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d606b0-4219-4af7-9ad9-fce129c02340 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:09.808183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d606b0-4219-4af7-9ad9-fce129c02340 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:09.842753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0ff0b-55e4-4aa1-ab6a-447986189725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:09.843489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0ff0b-55e4-4aa1-ab6a-447986189725 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:09.843765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0ff0b-55e4-4aa1-ab6a-447986189725 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:09.844034 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0ff0b-55e4-4aa1-ab6a-447986189725 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:09.844682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0ff0b-55e4-4aa1-ab6a-447986189725 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:09.846069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0ff0b-55e4-4aa1-ab6a-447986189725 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-fef0ff0b-55e4-4aa1-ab6a-447986189725 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:19:09.857789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:19:09.861349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:19:09.862442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:19:09.862442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:19:09.862442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:19:09.862442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:19:09.862442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:19:09.862442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:19:09.862442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:19:09.862442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:19:09.862442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:19:09.862442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:19:09.862442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:19:09.862442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:19:09.862442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:19:09.862442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:19:09.862442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 660/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jul 20 19:19:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:19:09.865108 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d86b29-56b1-47b7-b0b8-f92568552452 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:09.884057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:09.964671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d86b29-56b1-47b7-b0b8-f92568552452 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:09.998779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98286a9e-8d42-4891-9033-9ff494c8ae63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:09.999441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98286a9e-8d42-4891-9033-9ff494c8ae63 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:09.999770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98286a9e-8d42-4891-9033-9ff494c8ae63 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:10.000081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98286a9e-8d42-4891-9033-9ff494c8ae63 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:10.000764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98286a9e-8d42-4891-9033-9ff494c8ae63 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:19:10.001066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98286a9e-8d42-4891-9033-9ff494c8ae63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:10.002434 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98286a9e-8d42-4891-9033-9ff494c8ae63 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:10.007694 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 639/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jul 20 19:19:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:19:10.013695 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0ff0b-55e4-4aa1-ab6a-447986189725 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:10.046235 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:10.114719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0ff0b-55e4-4aa1-ab6a-447986189725 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:10.148838 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8481b86-f782-4692-8f0b-a62b5ebfba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:10.149482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8481b86-f782-4692-8f0b-a62b5ebfba29 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:10.149759 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8481b86-f782-4692-8f0b-a62b5ebfba29 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:10.150028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8481b86-f782-4692-8f0b-a62b5ebfba29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:10.150846 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8481b86-f782-4692-8f0b-a62b5ebfba29 None admin] RBAC: Adding query filter params (interface=public, service_id=e04db45ed8d346ecafdf6f46a28654af, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:19:10.151152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8481b86-f782-4692-8f0b-a62b5ebfba29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:10.152711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8481b86-f782-4692-8f0b-a62b5ebfba29 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:10.157646 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 661/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jul 20 19:19:10 2022] GET /identity/v3/endpoints?service_id=e04db45ed8d346ecafdf6f46a28654af&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:19:10.163733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98286a9e-8d42-4891-9033-9ff494c8ae63 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:10.244683 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:10.262373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98286a9e-8d42-4891-9033-9ff494c8ae63 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:10.297447 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6d0d9-00bb-4cfc-82f9-8a64711e2edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:10.298110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6d0d9-00bb-4cfc-82f9-8a64711e2edd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:10.298387 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6d0d9-00bb-4cfc-82f9-8a64711e2edd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:10.298659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6d0d9-00bb-4cfc-82f9-8a64711e2edd None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:10.299424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6d0d9-00bb-4cfc-82f9-8a64711e2edd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:10.300784 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6d0d9-00bb-4cfc-82f9-8a64711e2edd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:10.307495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 640/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jul 20 19:19:10 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:19:12.383447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66902fcc-ee23-447a-8fda-c1a75b5ca00f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:12.384024 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66902fcc-ee23-447a-8fda-c1a75b5ca00f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:12.384024 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66902fcc-ee23-447a-8fda-c1a75b5ca00f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:12.385359 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 662/1302] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:19:12.390905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a873e-76ea-45f1-85ba-cac24c40b160 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:12.393067 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a873e-76ea-45f1-85ba-cac24c40b160 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:12.393067 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a873e-76ea-45f1-85ba-cac24c40b160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:12.407287 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-290a873e-76ea-45f1-85ba-cac24c40b160 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:19:12.408464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-290a873e-76ea-45f1-85ba-cac24c40b160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:19:12.474624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 641/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:19:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:19:12.498963 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66902fcc-ee23-447a-8fda-c1a75b5ca00f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:12.595760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:12.602770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66902fcc-ee23-447a-8fda-c1a75b5ca00f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:12.636756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa97c-20b2-40ca-a7ab-8b65308f8887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:12.637556 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa97c-20b2-40ca-a7ab-8b65308f8887 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:12.637833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa97c-20b2-40ca-a7ab-8b65308f8887 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:12.638105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa97c-20b2-40ca-a7ab-8b65308f8887 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:12.638786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfa97c-20b2-40ca-a7ab-8b65308f8887 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:12.640169 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfa97c-20b2-40ca-a7ab-8b65308f8887 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7fbfa97c-20b2-40ca-a7ab-8b65308f8887 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:19:12.651961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:19:12.653669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:19:12.654575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:19:12.654575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Jul 20 19:19:12.654575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:19:12.654575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:19:12.654575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:19:12.654575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:19:12.654575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:19:12.654575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:19:12.654575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:19:12.654575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:19:12.654575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:19:12.654575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:19:12.654575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:19:12.654575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Jul 20 19:19:12.654575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 663/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jul 20 19:19:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:19:12.659878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a873e-76ea-45f1-85ba-cac24c40b160 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:12.738376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:12.761348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a873e-76ea-45f1-85ba-cac24c40b160 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:12.796213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe08277-c05a-40a6-89f6-b14653a5c6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:12.796871 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe08277-c05a-40a6-89f6-b14653a5c6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:12.797150 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe08277-c05a-40a6-89f6-b14653a5c6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:12.797423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe08277-c05a-40a6-89f6-b14653a5c6f6 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:12.798126 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe08277-c05a-40a6-89f6-b14653a5c6f6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:19:12.798427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe08277-c05a-40a6-89f6-b14653a5c6f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:12.799833 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe08277-c05a-40a6-89f6-b14653a5c6f6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:12.805028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 642/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jul 20 19:19:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:19:12.811604 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa97c-20b2-40ca-a7ab-8b65308f8887 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:19:12.913962 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa97c-20b2-40ca-a7ab-8b65308f8887 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:19:12.947698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15957548-ab5a-481a-8a7e-02cdb285f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:19:12.950327 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15957548-ab5a-481a-8a7e-02cdb285f187 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:19:12.950327 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15957548-ab5a-481a-8a7e-02cdb285f187 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:19:12.950327 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15957548-ab5a-481a-8a7e-02cdb285f187 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:19:12.950603 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15957548-ab5a-481a-8a7e-02cdb285f187 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:19:12.951951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15957548-ab5a-481a-8a7e-02cdb285f187 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:19:13.070109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 664/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jul 20 19:19:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:19:22.889267 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=30 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:23.065291 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:40.964358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436ee94-ae38-4641-bd21-0b3c3a52f442 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:40.964975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436ee94-ae38-4641-bd21-0b3c3a52f442 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:40.964975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436ee94-ae38-4641-bd21-0b3c3a52f442 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:40.978047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e3829-0c44-488e-ba20-4ba8cba7a839 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:40.978047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e3829-0c44-488e-ba20-4ba8cba7a839 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:40.978047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e3829-0c44-488e-ba20-4ba8cba7a839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:40.978858 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 643/1307] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:26:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:26:41.050192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c14e3829-0c44-488e-ba20-4ba8cba7a839 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:41.052035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c14e3829-0c44-488e-ba20-4ba8cba7a839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:41.234699 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 665/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:26:41.284120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18980c7-b5da-4df1-822b-f0da3b76cbf5 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:41.284318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18980c7-b5da-4df1-822b-f0da3b76cbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:41.284595 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18980c7-b5da-4df1-822b-f0da3b76cbf5 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:41.286027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 644/1309] 10.222.0.16 () {54 vars in 965 bytes} [Wed Jul 20 19:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:26:41.292708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e961abf-2c9c-4395-89d4-a3ef8f1ff8f7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:41.293097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e961abf-2c9c-4395-89d4-a3ef8f1ff8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:41.293260 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e961abf-2c9c-4395-89d4-a3ef8f1ff8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:41.425897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6e961abf-2c9c-4395-89d4-a3ef8f1ff8f7 None None] MFA Rules not processed for user `454b9259519c4332a8a36131c8273786`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:41.427449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6e961abf-2c9c-4395-89d4-a3ef8f1ff8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:41.453108 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:41.527646 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 666/1310] 10.222.0.16 () {58 vars in 1062 bytes} [Wed Jul 20 19:26:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:41.536683 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18980c7-b5da-4df1-822b-f0da3b76cbf5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:41.539171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e18980c7-b5da-4df1-822b-f0da3b76cbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:41.660449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18980c7-b5da-4df1-822b-f0da3b76cbf5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:41.745896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e958dc8-b30f-41c6-9192-8fca988a6e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:41.746478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e958dc8-b30f-41c6-9192-8fca988a6e29 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:41.746795 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e958dc8-b30f-41c6-9192-8fca988a6e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:41.747073 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e958dc8-b30f-41c6-9192-8fca988a6e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:41.748748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8e958dc8-b30f-41c6-9192-8fca988a6e29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:41.809457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:41.870748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e958dc8-b30f-41c6-9192-8fca988a6e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:41.872454 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e958dc8-b30f-41c6-9192-8fca988a6e29 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:41.894243 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 645/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:44.420608 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7c3af-d6ac-42f3-ae04-470dc7dc5a8d None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:44.421181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7c3af-d6ac-42f3-ae04-470dc7dc5a8d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:44.421299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7c3af-d6ac-42f3-ae04-470dc7dc5a8d None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:44.422624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 667/1312] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:26:44.428166 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c7363-b868-4fe4-b191-be63eab66fef None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:44.428645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c7363-b868-4fe4-b191-be63eab66fef None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:44.428738 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c7363-b868-4fe4-b191-be63eab66fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:44.526170 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ac9c7363-b868-4fe4-b191-be63eab66fef None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:44.527451 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ac9c7363-b868-4fe4-b191-be63eab66fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:44.635577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 646/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:44.676094 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7c3af-d6ac-42f3-ae04-470dc7dc5a8d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:44.677773 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-62e7c3af-d6ac-42f3-ae04-470dc7dc5a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:44.782017 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7c3af-d6ac-42f3-ae04-470dc7dc5a8d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:44.857330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:44.860038 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05119f4-7aff-492f-97ef-3bb77f6bca40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:44.860694 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05119f4-7aff-492f-97ef-3bb77f6bca40 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:44.860970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05119f4-7aff-492f-97ef-3bb77f6bca40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:44.861235 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05119f4-7aff-492f-97ef-3bb77f6bca40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:44.862921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a05119f4-7aff-492f-97ef-3bb77f6bca40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:44.983521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05119f4-7aff-492f-97ef-3bb77f6bca40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:44.984962 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05119f4-7aff-492f-97ef-3bb77f6bca40 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:45.002543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 668/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:47.627793 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e8ddd-278b-4cf0-bf13-bee042d79e73 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:47.628338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e8ddd-278b-4cf0-bf13-bee042d79e73 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:47.628338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e8ddd-278b-4cf0-bf13-bee042d79e73 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:47.629919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 647/1315] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:26:47.635474 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f0808-c626-4a75-be97-e342b2d935d1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:47.635910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f0808-c626-4a75-be97-e342b2d935d1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:47.636067 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f0808-c626-4a75-be97-e342b2d935d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:47.702076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-345f0808-c626-4a75-be97-e342b2d935d1 None None] MFA Rules not processed for user `fd100c82cfbd4bfaaffc9eee00a66751`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:47.703321 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-345f0808-c626-4a75-be97-e342b2d935d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:47.756020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:47.800601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 669/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:47.841383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e8ddd-278b-4cf0-bf13-bee042d79e73 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:47.842980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cd5e8ddd-278b-4cf0-bf13-bee042d79e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:47.852809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:47.944895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e8ddd-278b-4cf0-bf13-bee042d79e73 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:48.018368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9c536-1bd6-4cb5-9c0c-32cbbc814f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:48.019118 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c536-1bd6-4cb5-9c0c-32cbbc814f41 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:48.019889 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c536-1bd6-4cb5-9c0c-32cbbc814f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:48.020160 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c536-1bd6-4cb5-9c0c-32cbbc814f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:48.021812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fff9c536-1bd6-4cb5-9c0c-32cbbc814f41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:48.082495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:48.131152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9c536-1bd6-4cb5-9c0c-32cbbc814f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:48.132530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9c536-1bd6-4cb5-9c0c-32cbbc814f41 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:48.150831 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 648/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:47 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:50.989606 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76938bf2-fef4-41ae-aa54-03cdb4dac7d3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:50.990154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76938bf2-fef4-41ae-aa54-03cdb4dac7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:50.990154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76938bf2-fef4-41ae-aa54-03cdb4dac7d3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:50.991662 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 670/1318] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:26:50.996715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8df0f-c596-4d12-a87a-f91a20b37a98 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:50.997133 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8df0f-c596-4d12-a87a-f91a20b37a98 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:50.997262 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8df0f-c596-4d12-a87a-f91a20b37a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:51.061844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-34c8df0f-c596-4d12-a87a-f91a20b37a98 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:51.063101 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-34c8df0f-c596-4d12-a87a-f91a20b37a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:51.160091 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 649/1319] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:26:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:51.200324 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76938bf2-fef4-41ae-aa54-03cdb4dac7d3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:51.201658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-76938bf2-fef4-41ae-aa54-03cdb4dac7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:51.313653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76938bf2-fef4-41ae-aa54-03cdb4dac7d3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:51.387672 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ebb17-f127-4195-9aef-1b174c3db6a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:51.388309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ebb17-f127-4195-9aef-1b174c3db6a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:51.388585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ebb17-f127-4195-9aef-1b174c3db6a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:51.388854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ebb17-f127-4195-9aef-1b174c3db6a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:51.390476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a41ebb17-f127-4195-9aef-1b174c3db6a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:51.398002 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:51.498909 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ebb17-f127-4195-9aef-1b174c3db6a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:51.500263 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ebb17-f127-4195-9aef-1b174c3db6a6 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:51.518183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 671/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:54.676254 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c3f97-5bef-48ab-ad9a-ae8c1e9d4023 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:54.677473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c3f97-5bef-48ab-ad9a-ae8c1e9d4023 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:54.677671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c3f97-5bef-48ab-ad9a-ae8c1e9d4023 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:54.679232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 650/1321] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:26:54.684569 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749954e-f729-4ff9-9297-c49e4e7a551b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:54.685975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749954e-f729-4ff9-9297-c49e4e7a551b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:54.685975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749954e-f729-4ff9-9297-c49e4e7a551b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:54.752608 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9749954e-f729-4ff9-9297-c49e4e7a551b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:54.753829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9749954e-f729-4ff9-9297-c49e4e7a551b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:54.813824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:54.855648 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 672/1322] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:54.893770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c3f97-5bef-48ab-ad9a-ae8c1e9d4023 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:54.896463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d66c3f97-5bef-48ab-ad9a-ae8c1e9d4023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:54.917693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:55.011602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c3f97-5bef-48ab-ad9a-ae8c1e9d4023 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:55.090921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160367f9-64eb-465e-89c8-5ee6b0e845fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:55.091580 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160367f9-64eb-465e-89c8-5ee6b0e845fe service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:55.091853 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160367f9-64eb-465e-89c8-5ee6b0e845fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:55.092120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160367f9-64eb-465e-89c8-5ee6b0e845fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:55.093851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-160367f9-64eb-465e-89c8-5ee6b0e845fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:55.169304 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:55.208172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160367f9-64eb-465e-89c8-5ee6b0e845fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:55.209645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160367f9-64eb-465e-89c8-5ee6b0e845fe service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:55.230135 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 651/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:57.425915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0834a62-310a-4338-99ec-b31a86d81c8c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:57.426437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0834a62-310a-4338-99ec-b31a86d81c8c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:57.426540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0834a62-310a-4338-99ec-b31a86d81c8c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:57.427962 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 673/1324] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:26:57.433346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cef62-38f9-4eb7-aaeb-55611f9e76a6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:57.433831 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cef62-38f9-4eb7-aaeb-55611f9e76a6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:57.433925 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cef62-38f9-4eb7-aaeb-55611f9e76a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:57.500759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-418cef62-38f9-4eb7-aaeb-55611f9e76a6 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:57.501984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-418cef62-38f9-4eb7-aaeb-55611f9e76a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:57.606392 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 652/1325] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:57.637252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0834a62-310a-4338-99ec-b31a86d81c8c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:57.638919 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d0834a62-310a-4338-99ec-b31a86d81c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:57.747758 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0834a62-310a-4338-99ec-b31a86d81c8c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:57.824728 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10bf58-d10d-43f0-8152-bfe37a8eaf8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:57.825381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10bf58-d10d-43f0-8152-bfe37a8eaf8a service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:57.825664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10bf58-d10d-43f0-8152-bfe37a8eaf8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:57.825936 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10bf58-d10d-43f0-8152-bfe37a8eaf8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:57.827661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9f10bf58-d10d-43f0-8152-bfe37a8eaf8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:57.848989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:57.946470 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10bf58-d10d-43f0-8152-bfe37a8eaf8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:57.947959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10bf58-d10d-43f0-8152-bfe37a8eaf8a service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:57.966089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 674/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:00.142041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3193b12-b869-43d6-8b59-c8ac4c1fe3a4 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:00.142568 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3193b12-b869-43d6-8b59-c8ac4c1fe3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:00.142813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3193b12-b869-43d6-8b59-c8ac4c1fe3a4 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:00.144022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 653/1327] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:00.149847 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd1c4-cc1d-437b-b428-fea42089aba0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:00.150302 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd1c4-cc1d-437b-b428-fea42089aba0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:00.150548 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd1c4-cc1d-437b-b428-fea42089aba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:00.220828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2effd1c4-cc1d-437b-b428-fea42089aba0 None None] MFA Rules not processed for user `fd100c82cfbd4bfaaffc9eee00a66751`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:00.221996 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2effd1c4-cc1d-437b-b428-fea42089aba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:00.297149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:00.333731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 675/1328] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:27:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:00.372210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3193b12-b869-43d6-8b59-c8ac4c1fe3a4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:00.373758 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a3193b12-b869-43d6-8b59-c8ac4c1fe3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:00.404579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:00.478176 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3193b12-b869-43d6-8b59-c8ac4c1fe3a4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:00.554057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46292f34-c428-4bf3-a98f-64a2c0972a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:00.554737 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46292f34-c428-4bf3-a98f-64a2c0972a2c service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:00.555020 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46292f34-c428-4bf3-a98f-64a2c0972a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:00.555295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46292f34-c428-4bf3-a98f-64a2c0972a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:00.556938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-46292f34-c428-4bf3-a98f-64a2c0972a2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:00.637678 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:00.680096 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46292f34-c428-4bf3-a98f-64a2c0972a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:00.680716 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46292f34-c428-4bf3-a98f-64a2c0972a2c service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:00.708874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 654/1329] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:03.273704 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec72e-f7fc-435b-8a80-a47ab90e83e3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:03.274215 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec72e-f7fc-435b-8a80-a47ab90e83e3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:03.274215 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec72e-f7fc-435b-8a80-a47ab90e83e3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:03.275583 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 676/1330] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:03.281149 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05b7f8-c788-4cf6-8de0-b6573047bd8d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:03.281592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05b7f8-c788-4cf6-8de0-b6573047bd8d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:03.281709 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05b7f8-c788-4cf6-8de0-b6573047bd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:03.348131 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ee05b7f8-c788-4cf6-8de0-b6573047bd8d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:03.349455 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ee05b7f8-c788-4cf6-8de0-b6573047bd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:03.448988 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 655/1331] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:03.486221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec72e-f7fc-435b-8a80-a47ab90e83e3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:03.488239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9b4ec72e-f7fc-435b-8a80-a47ab90e83e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:03.591499 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec72e-f7fc-435b-8a80-a47ab90e83e3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:03.665020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2174a-55b0-4c8c-bf1b-6b8c9d5ff35a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:03.665663 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2174a-55b0-4c8c-bf1b-6b8c9d5ff35a service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:03.665946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2174a-55b0-4c8c-bf1b-6b8c9d5ff35a service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:03.666221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2174a-55b0-4c8c-bf1b-6b8c9d5ff35a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:03.667915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-aeb2174a-55b0-4c8c-bf1b-6b8c9d5ff35a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:03.695368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:03.782101 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2174a-55b0-4c8c-bf1b-6b8c9d5ff35a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:03.783624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2174a-55b0-4c8c-bf1b-6b8c9d5ff35a service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:03.801990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 677/1332] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:05.923892 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f111f4-00df-4eff-ad9d-b1f710b76bcd None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:05.924438 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f111f4-00df-4eff-ad9d-b1f710b76bcd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:05.924438 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f111f4-00df-4eff-ad9d-b1f710b76bcd None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:05.925862 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 656/1333] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:05.931277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bba3c3-ab6a-413f-ad86-eeef2d7617f6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:05.931699 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bba3c3-ab6a-413f-ad86-eeef2d7617f6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:05.931808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bba3c3-ab6a-413f-ad86-eeef2d7617f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:05.999121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-79bba3c3-ab6a-413f-ad86-eeef2d7617f6 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:06.000324 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-79bba3c3-ab6a-413f-ad86-eeef2d7617f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:06.074068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:06.096668 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 678/1334] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:06.145506 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f111f4-00df-4eff-ad9d-b1f710b76bcd None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:06.147161 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-07f111f4-00df-4eff-ad9d-b1f710b76bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:06.188996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:06.252545 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f111f4-00df-4eff-ad9d-b1f710b76bcd None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:06.327650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab41a4d-f9b8-4c4c-804d-d5a0dc095613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:06.328299 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab41a4d-f9b8-4c4c-804d-d5a0dc095613 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:06.328582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab41a4d-f9b8-4c4c-804d-d5a0dc095613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:06.328846 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab41a4d-f9b8-4c4c-804d-d5a0dc095613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:06.330529 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dab41a4d-f9b8-4c4c-804d-d5a0dc095613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:06.418059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:06.445678 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab41a4d-f9b8-4c4c-804d-d5a0dc095613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:06.447252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab41a4d-f9b8-4c4c-804d-d5a0dc095613 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:06.466404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 657/1335] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:09.151612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35bf7f-e6ca-468b-bed0-cf5eb01dc3e1 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:09.152263 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35bf7f-e6ca-468b-bed0-cf5eb01dc3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:09.152263 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35bf7f-e6ca-468b-bed0-cf5eb01dc3e1 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:09.153608 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 679/1336] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:09.159144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d0ef3-8347-4565-910d-5fa9f5f8db0d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:09.159701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d0ef3-8347-4565-910d-5fa9f5f8db0d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:09.159972 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d0ef3-8347-4565-910d-5fa9f5f8db0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:09.224995 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-881d0ef3-8347-4565-910d-5fa9f5f8db0d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:09.226106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-881d0ef3-8347-4565-910d-5fa9f5f8db0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:09.327833 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 658/1337] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:27:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:09.380150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d0913-d62d-469a-8278-479b827f2e1c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:09.380430 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d0913-d62d-469a-8278-479b827f2e1c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:09.380707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d0913-d62d-469a-8278-479b827f2e1c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:09.382096 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 680/1338] 10.222.0.16 () {54 vars in 965 bytes} [Wed Jul 20 19:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:09.388098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb3b95-c6d4-4c03-94ab-dae0b447635c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:09.388382 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb3b95-c6d4-4c03-94ab-dae0b447635c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:09.388654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb3b95-c6d4-4c03-94ab-dae0b447635c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:09.453173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:09.476682 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1fbb3b95-c6d4-4c03-94ab-dae0b447635c None None] MFA Rules not processed for user `454b9259519c4332a8a36131c8273786`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:09.478122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1fbb3b95-c6d4-4c03-94ab-dae0b447635c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:09.553812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 659/1339] 10.222.0.16 () {58 vars in 1062 bytes} [Wed Jul 20 19:27:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:27:09.562767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d0913-d62d-469a-8278-479b827f2e1c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:09.564374 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c74d0913-d62d-469a-8278-479b827f2e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:09.670801 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d0913-d62d-469a-8278-479b827f2e1c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:09.760818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52637c-2514-46cd-b1fc-a5c879b5233c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:09.761380 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52637c-2514-46cd-b1fc-a5c879b5233c service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:09.761656 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52637c-2514-46cd-b1fc-a5c879b5233c service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:09.761926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52637c-2514-46cd-b1fc-a5c879b5233c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:09.763679 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bf52637c-2514-46cd-b1fc-a5c879b5233c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:09.801790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:09.885629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52637c-2514-46cd-b1fc-a5c879b5233c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:09.887154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52637c-2514-46cd-b1fc-a5c879b5233c service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:09.908669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 681/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:14.895004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aebce-4403-4d61-908e-66b21e80b4f6 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:14.895584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aebce-4403-4d61-908e-66b21e80b4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:14.895941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aebce-4403-4d61-908e-66b21e80b4f6 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:14.901355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 660/1341] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:27:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:14.904192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39d8c4-03f8-4347-b084-5ad9669e81f3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:14.904677 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39d8c4-03f8-4347-b084-5ad9669e81f3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:14.904797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39d8c4-03f8-4347-b084-5ad9669e81f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:14.976172 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bd39d8c4-03f8-4347-b084-5ad9669e81f3 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:14.977896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bd39d8c4-03f8-4347-b084-5ad9669e81f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:15.083067 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:15.094105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 682/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:15.135483 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6aebce-4403-4d61-908e-66b21e80b4f6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:15.137110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1a6aebce-4403-4d61-908e-66b21e80b4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:15.246297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6aebce-4403-4d61-908e-66b21e80b4f6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:15.287595 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:15.328843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d94469-c567-40c9-a12f-0c6d523e1fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:15.329508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d94469-c567-40c9-a12f-0c6d523e1fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:15.329844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d94469-c567-40c9-a12f-0c6d523e1fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:15.330025 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d94469-c567-40c9-a12f-0c6d523e1fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:15.332508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e9d94469-c567-40c9-a12f-0c6d523e1fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:15.445227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d94469-c567-40c9-a12f-0c6d523e1fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:15.446825 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d94469-c567-40c9-a12f-0c6d523e1fc4 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:15.466837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 661/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:18.529142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdd4a8-8781-4ae2-8c94-e0bb0f9cc496 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:18.529705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdd4a8-8781-4ae2-8c94-e0bb0f9cc496 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:18.529705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdd4a8-8781-4ae2-8c94-e0bb0f9cc496 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:18.531145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 683/1344] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:18.537298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e83e1-5886-4634-b8cc-54291623e269 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:18.537816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e83e1-5886-4634-b8cc-54291623e269 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:18.537816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e83e1-5886-4634-b8cc-54291623e269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:18.603207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c05e83e1-5886-4634-b8cc-54291623e269 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:18.604413 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c05e83e1-5886-4634-b8cc-54291623e269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:18.623537 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:18.705301 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 662/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:27:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:18.744084 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdd4a8-8781-4ae2-8c94-e0bb0f9cc496 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:18.745837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-07cdd4a8-8781-4ae2-8c94-e0bb0f9cc496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:18.862396 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdd4a8-8781-4ae2-8c94-e0bb0f9cc496 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:18.940294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ecbf4-420e-4bad-87c6-61e852f73050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:18.941132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ecbf4-420e-4bad-87c6-61e852f73050 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:18.941417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ecbf4-420e-4bad-87c6-61e852f73050 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:18.941693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ecbf4-420e-4bad-87c6-61e852f73050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:18.943399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-665ecbf4-420e-4bad-87c6-61e852f73050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:18.989483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:19.062127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ecbf4-420e-4bad-87c6-61e852f73050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:19.063682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ecbf4-420e-4bad-87c6-61e852f73050 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:19.086339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 684/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:23.445422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a5913-90f2-4370-b504-822be3303b96 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:23.445940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a5913-90f2-4370-b504-822be3303b96 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:23.446045 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a5913-90f2-4370-b504-822be3303b96 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:23.447435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 663/1347] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:23.453061 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9515826-e21a-4fa8-bbcf-459274efbb79 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:23.453552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9515826-e21a-4fa8-bbcf-459274efbb79 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:23.453662 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9515826-e21a-4fa8-bbcf-459274efbb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:23.527826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e9515826-e21a-4fa8-bbcf-459274efbb79 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:23.529060 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e9515826-e21a-4fa8-bbcf-459274efbb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:23.635923 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:23.638816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 685/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:23.678263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a5913-90f2-4370-b504-822be3303b96 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:23.679917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-922a5913-90f2-4370-b504-822be3303b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:23.795529 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a5913-90f2-4370-b504-822be3303b96 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:23.844303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:23.876406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c4dce-186e-4edd-b370-b9d737b454d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:23.877106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c4dce-186e-4edd-b370-b9d737b454d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:23.877388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c4dce-186e-4edd-b370-b9d737b454d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:23.877668 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c4dce-186e-4edd-b370-b9d737b454d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:23.879408 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ca1c4dce-186e-4edd-b370-b9d737b454d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:24.000756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c4dce-186e-4edd-b370-b9d737b454d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:24.003478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c4dce-186e-4edd-b370-b9d737b454d3 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:24.023959 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 664/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:29.045301 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755f935-f267-4347-921f-46ae900d1fea None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:29.045776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755f935-f267-4347-921f-46ae900d1fea None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:29.045864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755f935-f267-4347-921f-46ae900d1fea None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:29.047621 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 686/1350] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 20 19:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:29.055896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eeaf32-8240-4665-af30-05bedfb4a08f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:29.056741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eeaf32-8240-4665-af30-05bedfb4a08f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:29.057226 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eeaf32-8240-4665-af30-05bedfb4a08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:29.207297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-10eeaf32-8240-4665-af30-05bedfb4a08f None None] MFA Rules not processed for user `dbc616ed904d43d2b160b8d2766f7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:29.208625 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-10eeaf32-8240-4665-af30-05bedfb4a08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:29.231843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:29.364229 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 665/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 20 19:27:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:33.509140 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704806b8-95d1-424a-845b-ffe40cc23d7b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:33.509995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704806b8-95d1-424a-845b-ffe40cc23d7b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:33.510430 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704806b8-95d1-424a-845b-ffe40cc23d7b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:33.511851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 687/1352] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 20 19:27:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:33.517103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07b4cf-6a1a-4fcc-a3d4-e22db13de454 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:33.517553 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07b4cf-6a1a-4fcc-a3d4-e22db13de454 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:33.517662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07b4cf-6a1a-4fcc-a3d4-e22db13de454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:33.595802 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ba07b4cf-6a1a-4fcc-a3d4-e22db13de454 None None] MFA Rules not processed for user `dbc616ed904d43d2b160b8d2766f7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:33.596944 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ba07b4cf-6a1a-4fcc-a3d4-e22db13de454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:33.680279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:33.720050 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 666/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 20 19:27:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:35.099543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc646402-c5da-4369-9472-bb137744c9f9 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:35.100065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc646402-c5da-4369-9472-bb137744c9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:35.100237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc646402-c5da-4369-9472-bb137744c9f9 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:35.101660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 688/1354] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 20 19:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:35.107062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95149e2b-7861-4601-931a-0e829df4ddbe None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:35.115922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95149e2b-7861-4601-931a-0e829df4ddbe None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:35.115922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95149e2b-7861-4601-931a-0e829df4ddbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:35.185630 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-95149e2b-7861-4601-931a-0e829df4ddbe None None] MFA Rules not processed for user `dbc616ed904d43d2b160b8d2766f7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:35.186857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-95149e2b-7861-4601-931a-0e829df4ddbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:35.302324 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 667/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 20 19:27:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:38.886130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea41de-f970-499d-8d99-6eb33849bc81 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:38.886658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea41de-f970-499d-8d99-6eb33849bc81 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:38.886658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea41de-f970-499d-8d99-6eb33849bc81 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:38.888094 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 689/1356] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:38.894134 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417e6a5-6b26-41ea-985f-132e38358100 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:38.894579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417e6a5-6b26-41ea-985f-132e38358100 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:38.894717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417e6a5-6b26-41ea-985f-132e38358100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:38.949181 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:38.991419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4417e6a5-6b26-41ea-985f-132e38358100 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:38.992945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4417e6a5-6b26-41ea-985f-132e38358100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:39.111542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 668/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:39.166407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c977d-4034-4c00-9302-ee3b281a61fb None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:39.166606 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c977d-4034-4c00-9302-ee3b281a61fb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:39.167084 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c977d-4034-4c00-9302-ee3b281a61fb None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:39.168469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 690/1358] 10.222.0.16 () {54 vars in 962 bytes} [Wed Jul 20 19:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:39.179010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76f2b8-4756-41e7-ac2c-dbad2122b2c0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:39.179871 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76f2b8-4756-41e7-ac2c-dbad2122b2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:39.180253 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76f2b8-4756-41e7-ac2c-dbad2122b2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:39.268836 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9b76f2b8-4756-41e7-ac2c-dbad2122b2c0 None None] MFA Rules not processed for user `e3fd38ebb5514af686204d0b02a91edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:39.270246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9b76f2b8-4756-41e7-ac2c-dbad2122b2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:39.346648 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:39.427368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 669/1359] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Jul 20 19:27:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:39.435613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c977d-4034-4c00-9302-ee3b281a61fb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:39.438297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-947c977d-4034-4c00-9302-ee3b281a61fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:39.604911 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c977d-4034-4c00-9302-ee3b281a61fb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:39.689226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:39.733815 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec6363-80a0-4271-9636-b2f3ee778cb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:39.734578 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec6363-80a0-4271-9636-b2f3ee778cb8 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:39.734889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec6363-80a0-4271-9636-b2f3ee778cb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:39.735160 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec6363-80a0-4271-9636-b2f3ee778cb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:39.736944 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8eec6363-80a0-4271-9636-b2f3ee778cb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:39.843993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec6363-80a0-4271-9636-b2f3ee778cb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:39.845737 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec6363-80a0-4271-9636-b2f3ee778cb8 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:39.868197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 691/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:42.183213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0bfb0-c408-48de-900e-91ad6ee3d151 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:42.183781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0bfb0-c408-48de-900e-91ad6ee3d151 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:42.183781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0bfb0-c408-48de-900e-91ad6ee3d151 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:42.185297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 670/1361] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:42.191176 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa53b82-b7db-4aa0-80fc-0dd87a276ebe None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:42.191663 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa53b82-b7db-4aa0-80fc-0dd87a276ebe None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:42.191766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa53b82-b7db-4aa0-80fc-0dd87a276ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:42.268288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8aa53b82-b7db-4aa0-80fc-0dd87a276ebe None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:42.269502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8aa53b82-b7db-4aa0-80fc-0dd87a276ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:42.319193 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:42.392345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 692/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:42.438615 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0bfb0-c408-48de-900e-91ad6ee3d151 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:42.440429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-adc0bfb0-c408-48de-900e-91ad6ee3d151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:42.651936 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0bfb0-c408-48de-900e-91ad6ee3d151 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:42.668908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:42.815360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73337f75-c620-41a7-9125-7fe9a17a5e4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:42.816332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73337f75-c620-41a7-9125-7fe9a17a5e4e service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:42.816332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73337f75-c620-41a7-9125-7fe9a17a5e4e service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:42.818349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73337f75-c620-41a7-9125-7fe9a17a5e4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:42.819077 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-73337f75-c620-41a7-9125-7fe9a17a5e4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:42.963354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73337f75-c620-41a7-9125-7fe9a17a5e4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:42.968398 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73337f75-c620-41a7-9125-7fe9a17a5e4e service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:42.990205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 671/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:45.619367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2450b33-65ae-4ec3-9b23-f2cb2b447392 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:45.620230 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2450b33-65ae-4ec3-9b23-f2cb2b447392 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:45.620661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2450b33-65ae-4ec3-9b23-f2cb2b447392 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:45.622493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 693/1364] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:45.629294 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c6709-b870-48d8-999a-156446674b68 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:45.630036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c6709-b870-48d8-999a-156446674b68 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:45.630036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c6709-b870-48d8-999a-156446674b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:45.646163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:45.712101 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-595c6709-b870-48d8-999a-156446674b68 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:45.713329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-595c6709-b870-48d8-999a-156446674b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:45.838719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 672/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:45.882572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e480228-ce6b-4831-a285-f5725f1dd0dd None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:45.883016 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e480228-ce6b-4831-a285-f5725f1dd0dd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:45.883418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e480228-ce6b-4831-a285-f5725f1dd0dd None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:45.885254 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 694/1366] 10.222.0.16 () {54 vars in 962 bytes} [Wed Jul 20 19:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:45.891749 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8452c-db72-4de4-a41b-76b913badec6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:45.891931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8452c-db72-4de4-a41b-76b913badec6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:45.892223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8452c-db72-4de4-a41b-76b913badec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:45.978040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-35c8452c-db72-4de4-a41b-76b913badec6 None None] MFA Rules not processed for user `e3fd38ebb5514af686204d0b02a91edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:45.979412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-35c8452c-db72-4de4-a41b-76b913badec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:46.017822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:46.106932 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 673/1367] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Jul 20 19:27:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:27:46.114827 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e480228-ce6b-4831-a285-f5725f1dd0dd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:46.116549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3e480228-ce6b-4831-a285-f5725f1dd0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:46.292265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e480228-ce6b-4831-a285-f5725f1dd0dd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:46.316736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:46.418794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba004c-8c39-48be-b8d9-261cb4b6ef8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:46.419449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba004c-8c39-48be-b8d9-261cb4b6ef8d service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:46.419735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba004c-8c39-48be-b8d9-261cb4b6ef8d service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:46.420069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba004c-8c39-48be-b8d9-261cb4b6ef8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:46.421749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d3ba004c-8c39-48be-b8d9-261cb4b6ef8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:46.519639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba004c-8c39-48be-b8d9-261cb4b6ef8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:46.521293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba004c-8c39-48be-b8d9-261cb4b6ef8d service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:46.541233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 695/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:47.606463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e0b86-0915-4214-9720-6f79ee524a85 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:47.607005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e0b86-0915-4214-9720-6f79ee524a85 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:47.607005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e0b86-0915-4214-9720-6f79ee524a85 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:47.609055 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 674/1369] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:47.614619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a72e0-ec2d-40f6-8912-9b1926a593cc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:47.615122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a72e0-ec2d-40f6-8912-9b1926a593cc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:47.615122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a72e0-ec2d-40f6-8912-9b1926a593cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:47.648343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:47.686288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8d4a72e0-ec2d-40f6-8912-9b1926a593cc None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:47.688115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8d4a72e0-ec2d-40f6-8912-9b1926a593cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:47.799015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 696/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:48.149041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c923a5a-e9b4-482e-ac32-d7a99e5e4515 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:48.149425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c923a5a-e9b4-482e-ac32-d7a99e5e4515 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:48.149808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c923a5a-e9b4-482e-ac32-d7a99e5e4515 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:48.154898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 675/1371] 10.222.0.16 () {54 vars in 964 bytes} [Wed Jul 20 19:27:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:48.158181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49c37e-a2f8-4c76-ac61-81ad0646149d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:48.158467 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49c37e-a2f8-4c76-ac61-81ad0646149d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:48.158800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49c37e-a2f8-4c76-ac61-81ad0646149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:48.245037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9d49c37e-a2f8-4c76-ac61-81ad0646149d None None] MFA Rules not processed for user `f2fcf925f9ec45b3b2cbea7e6acc0522`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:48.246243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9d49c37e-a2f8-4c76-ac61-81ad0646149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:48.303033 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:48.338259 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 697/1372] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Jul 20 19:27:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:48.346122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c923a5a-e9b4-482e-ac32-d7a99e5e4515 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:48.347913 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0c923a5a-e9b4-482e-ac32-d7a99e5e4515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:48.472424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c923a5a-e9b4-482e-ac32-d7a99e5e4515 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:48.517646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:48.553584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b0d47-792e-4ea4-93d9-e31306899e29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:48.554524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b0d47-792e-4ea4-93d9-e31306899e29 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:48.554954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b0d47-792e-4ea4-93d9-e31306899e29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:48.555324 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b0d47-792e-4ea4-93d9-e31306899e29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:48.557072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fe6b0d47-792e-4ea4-93d9-e31306899e29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:48.683548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b0d47-792e-4ea4-93d9-e31306899e29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:48.685011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b0d47-792e-4ea4-93d9-e31306899e29 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:48.704423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 676/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:49.027681 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2a383-ee01-4129-975e-9b12c385d4a5 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:49.028201 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2a383-ee01-4129-975e-9b12c385d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:49.028201 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2a383-ee01-4129-975e-9b12c385d4a5 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:49.030407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 698/1374] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:49.035601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedca66-d261-4ba7-8ff4-425539dc8ce8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:49.035947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedca66-d261-4ba7-8ff4-425539dc8ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:49.036375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedca66-d261-4ba7-8ff4-425539dc8ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:49.136836 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4dedca66-d261-4ba7-8ff4-425539dc8ce8 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:49.138117 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4dedca66-d261-4ba7-8ff4-425539dc8ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:49.160388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:49.249303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 677/1375] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:49.294952 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2a383-ee01-4129-975e-9b12c385d4a5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:49.296589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-60a2a383-ee01-4129-975e-9b12c385d4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:49.454739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2a383-ee01-4129-975e-9b12c385d4a5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:49.508356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:49.570054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6300eab-c14f-46f7-a542-08172faff065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:49.570721 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6300eab-c14f-46f7-a542-08172faff065 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:49.570999 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6300eab-c14f-46f7-a542-08172faff065 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:49.571266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6300eab-c14f-46f7-a542-08172faff065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:49.572903 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d6300eab-c14f-46f7-a542-08172faff065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:49.664518 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6300eab-c14f-46f7-a542-08172faff065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:49.666389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6300eab-c14f-46f7-a542-08172faff065 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:49.684658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 699/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:52.024532 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b12e61-e960-4949-b26a-9347b3b7cfbc None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:52.025034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b12e61-e960-4949-b26a-9347b3b7cfbc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:52.025034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b12e61-e960-4949-b26a-9347b3b7cfbc None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:52.026379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 678/1377] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:52.032418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810baec-d15e-4480-b9dc-2b1332b2a201 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:52.032907 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810baec-d15e-4480-b9dc-2b1332b2a201 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:52.033075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810baec-d15e-4480-b9dc-2b1332b2a201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:52.099166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e810baec-d15e-4480-b9dc-2b1332b2a201 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:52.100371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e810baec-d15e-4480-b9dc-2b1332b2a201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:52.107776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:52.209197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 700/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:52.259313 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b12e61-e960-4949-b26a-9347b3b7cfbc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:52.261550 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-71b12e61-e960-4949-b26a-9347b3b7cfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:52.461715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b12e61-e960-4949-b26a-9347b3b7cfbc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:52.467622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:52.594735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42c3a1-5ca9-412a-8e2c-d37661e3e146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:52.595456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42c3a1-5ca9-412a-8e2c-d37661e3e146 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:52.595853 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42c3a1-5ca9-412a-8e2c-d37661e3e146 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:52.596228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42c3a1-5ca9-412a-8e2c-d37661e3e146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:52.599381 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-df42c3a1-5ca9-412a-8e2c-d37661e3e146 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:52.709411 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42c3a1-5ca9-412a-8e2c-d37661e3e146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:52.711259 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42c3a1-5ca9-412a-8e2c-d37661e3e146 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:52.734217 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 679/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:54.971610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21232ab-4546-46f1-bcf4-f38cdf130ce7 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:54.972472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21232ab-4546-46f1-bcf4-f38cdf130ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:54.972472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21232ab-4546-46f1-bcf4-f38cdf130ce7 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:54.973568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 701/1380] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:27:54.979127 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d28b-7aea-42f1-8be7-375a0afdb2b3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:54.979557 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d28b-7aea-42f1-8be7-375a0afdb2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:54.979639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d28b-7aea-42f1-8be7-375a0afdb2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:54.990764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:55.049269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-fea7d28b-7aea-42f1-8be7-375a0afdb2b3 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:55.050512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fea7d28b-7aea-42f1-8be7-375a0afdb2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:55.155142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 680/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:55.202886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21232ab-4546-46f1-bcf4-f38cdf130ce7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:55.205287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d21232ab-4546-46f1-bcf4-f38cdf130ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:55.477820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:55.477820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21232ab-4546-46f1-bcf4-f38cdf130ce7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:55.622952 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c40e1a-818c-44f9-9741-95a81f8e14b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:55.629615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c40e1a-818c-44f9-9741-95a81f8e14b8 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:55.629615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c40e1a-818c-44f9-9741-95a81f8e14b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:55.629615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c40e1a-818c-44f9-9741-95a81f8e14b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:55.629615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-43c40e1a-818c-44f9-9741-95a81f8e14b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:55.731667 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c40e1a-818c-44f9-9741-95a81f8e14b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:55.733601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c40e1a-818c-44f9-9741-95a81f8e14b8 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:55.745734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:55.755275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 702/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:58.292390 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851d647-c3de-45a5-bffd-35d0d2e948c0 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:58.292923 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851d647-c3de-45a5-bffd-35d0d2e948c0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:58.292923 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851d647-c3de-45a5-bffd-35d0d2e948c0 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:58.294419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 681/1383] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:27:58.300068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb3b85-392f-4363-a9c5-2865eb8fa841 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:58.300988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb3b85-392f-4363-a9c5-2865eb8fa841 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:58.300988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb3b85-392f-4363-a9c5-2865eb8fa841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:58.370604 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-decb3b85-392f-4363-a9c5-2865eb8fa841 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:58.372537 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-decb3b85-392f-4363-a9c5-2865eb8fa841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:58.484175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 703/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:27:58.529474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851d647-c3de-45a5-bffd-35d0d2e948c0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:58.531043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6851d647-c3de-45a5-bffd-35d0d2e948c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:58.618597 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:58.686916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851d647-c3de-45a5-bffd-35d0d2e948c0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:58.807672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c1d70-1d3e-4d2e-8c18-ba19a4d55ee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:58.808468 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c1d70-1d3e-4d2e-8c18-ba19a4d55ee1 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:58.809653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c1d70-1d3e-4d2e-8c18-ba19a4d55ee1 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:58.810114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c1d70-1d3e-4d2e-8c18-ba19a4d55ee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:58.812376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ce1c1d70-1d3e-4d2e-8c18-ba19a4d55ee1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:58.871352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:58.914029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c1d70-1d3e-4d2e-8c18-ba19a4d55ee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:58.915668 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c1d70-1d3e-4d2e-8c18-ba19a4d55ee1 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:58.935890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 682/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:01.089712 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3633e7-2f01-4731-b962-1eb10b93e38a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:01.090957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3633e7-2f01-4731-b962-1eb10b93e38a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:01.091326 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3633e7-2f01-4731-b962-1eb10b93e38a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:01.093195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 704/1386] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:28:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:01.099460 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fc7a7-d2d0-4395-9f81-2edf38df3071 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:01.099920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fc7a7-d2d0-4395-9f81-2edf38df3071 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:01.100168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fc7a7-d2d0-4395-9f81-2edf38df3071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:01.173632 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6e7fc7a7-d2d0-4395-9f81-2edf38df3071 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:01.174878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6e7fc7a7-d2d0-4395-9f81-2edf38df3071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:01.283087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 683/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:01.329429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3633e7-2f01-4731-b962-1eb10b93e38a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:01.331534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cd3633e7-2f01-4731-b962-1eb10b93e38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:01.435023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:01.511214 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3633e7-2f01-4731-b962-1eb10b93e38a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:01.640729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e83813-d465-468b-88f7-c55bd50e45d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:01.641373 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e83813-d465-468b-88f7-c55bd50e45d0 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:01.641654 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e83813-d465-468b-88f7-c55bd50e45d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:01.642136 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e83813-d465-468b-88f7-c55bd50e45d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:01.643498 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-40e83813-d465-468b-88f7-c55bd50e45d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:01.684584 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:01.741660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e83813-d465-468b-88f7-c55bd50e45d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:01.743283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e83813-d465-468b-88f7-c55bd50e45d0 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:01.763404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 705/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:04.023712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142f606-087c-4f27-b701-1f5bd7b8cd45 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:04.024271 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142f606-087c-4f27-b701-1f5bd7b8cd45 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:04.024271 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142f606-087c-4f27-b701-1f5bd7b8cd45 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:04.025919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 684/1389] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:04.031958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedea998-fa06-4f95-aff9-23f9b7e62de1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:04.032420 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedea998-fa06-4f95-aff9-23f9b7e62de1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:04.032520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedea998-fa06-4f95-aff9-23f9b7e62de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:04.108756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-eedea998-fa06-4f95-aff9-23f9b7e62de1 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:04.109965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eedea998-fa06-4f95-aff9-23f9b7e62de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:04.225173 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 706/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:04.273446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142f606-087c-4f27-b701-1f5bd7b8cd45 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:04.275241 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b142f606-087c-4f27-b701-1f5bd7b8cd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:04.309472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5be6e-282c-459a-86a9-29f08f1075eb None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:04.309822 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5be6e-282c-459a-86a9-29f08f1075eb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:04.310019 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5be6e-282c-459a-86a9-29f08f1075eb None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:04.311488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 707/1391] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:28:04.312072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:04.316999 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fd376-1b00-4cfc-baf2-3d0dff9e7f4d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:04.323801 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fd376-1b00-4cfc-baf2-3d0dff9e7f4d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:04.323801 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fd376-1b00-4cfc-baf2-3d0dff9e7f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:04.333156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:04.389945 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cf1fd376-1b00-4cfc-baf2-3d0dff9e7f4d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:04.391202 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cf1fd376-1b00-4cfc-baf2-3d0dff9e7f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:04.440943 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142f606-087c-4f27-b701-1f5bd7b8cd45 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:04.495555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 708/1392] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:28:04.547805 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:04.553183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f64096-8109-4ecb-8af2-1eb0a2d73640 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:04.558152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f64096-8109-4ecb-8af2-1eb0a2d73640 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:04.558152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f64096-8109-4ecb-8af2-1eb0a2d73640 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:04.558152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 709/1393] 10.222.0.16 () {54 vars in 966 bytes} [Wed Jul 20 19:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:28:04.560140 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824b6a8-6cc6-4ce9-b92e-75d86a7326cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:04.560733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb5f50-93e6-4a7f-bc5f-850613656845 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:04.560896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824b6a8-6cc6-4ce9-b92e-75d86a7326cc service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:04.561039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb5f50-93e6-4a7f-bc5f-850613656845 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:04.561213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824b6a8-6cc6-4ce9-b92e-75d86a7326cc service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:04.561358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb5f50-93e6-4a7f-bc5f-850613656845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:04.561455 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824b6a8-6cc6-4ce9-b92e-75d86a7326cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:04.563189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2824b6a8-6cc6-4ce9-b92e-75d86a7326cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:04.640033 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-11eb5f50-93e6-4a7f-bc5f-850613656845 None None] MFA Rules not processed for user `dbc7e1bc2eb943eba57a0009635de70d`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:04.641273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-11eb5f50-93e6-4a7f-bc5f-850613656845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:04.660712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824b6a8-6cc6-4ce9-b92e-75d86a7326cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:04.662600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824b6a8-6cc6-4ce9-b92e-75d86a7326cc service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:04.678549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:04.686030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 685/1394] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:04.723945 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 710/1395] 10.222.0.16 () {58 vars in 1063 bytes} [Wed Jul 20 19:28:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:04.732192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824b6a8-6cc6-4ce9-b92e-75d86a7326cc service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:04.733384 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2824b6a8-6cc6-4ce9-b92e-75d86a7326cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:04.812827 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824b6a8-6cc6-4ce9-b92e-75d86a7326cc service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:04.854299 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:04.888345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647674d-ad09-4c72-8b39-bc5915d2c64f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc7e1bc2eb943eba57a0009635de70d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:04.889006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647674d-ad09-4c72-8b39-bc5915d2c64f service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:04.889282 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647674d-ad09-4c72-8b39-bc5915d2c64f service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:04.889550 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647674d-ad09-4c72-8b39-bc5915d2c64f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:04.891398 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8647674d-ad09-4c72-8b39-bc5915d2c64f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:05.023566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647674d-ad09-4c72-8b39-bc5915d2c64f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:05.025044 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647674d-ad09-4c72-8b39-bc5915d2c64f service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:05.047760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 686/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:28:06.176628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9430989-3af5-40d0-b7b0-b2ceb665df3a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:06.177200 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9430989-3af5-40d0-b7b0-b2ceb665df3a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:06.177200 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9430989-3af5-40d0-b7b0-b2ceb665df3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:06.245019 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c9430989-3af5-40d0-b7b0-b2ceb665df3a None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:06.246888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c9430989-3af5-40d0-b7b0-b2ceb665df3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:06.347187 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 711/1397] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 20 19:28:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:06.392109 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6224fbb-11ba-4516-b4e1-73246daefe3c None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:06.392651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6224fbb-11ba-4516-b4e1-73246daefe3c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:06.392651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6224fbb-11ba-4516-b4e1-73246daefe3c None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:06.394123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 687/1398] 10.222.0.16 () {54 vars in 943 bytes} [Wed Jul 20 19:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:06.400587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9720420-5396-4ba4-bb58-7de6ebb22413 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:06.400885 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9720420-5396-4ba4-bb58-7de6ebb22413 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:06.401167 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9720420-5396-4ba4-bb58-7de6ebb22413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:06.461343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:06.480382 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a9720420-5396-4ba4-bb58-7de6ebb22413 None None] MFA Rules not processed for user `fde62f4ce7af42eca1fe5a7b6807d1ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:06.481587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a9720420-5396-4ba4-bb58-7de6ebb22413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:06.590159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 712/1399] 10.222.0.16 () {58 vars in 1040 bytes} [Wed Jul 20 19:28:06 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:06.599962 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6224fbb-11ba-4516-b4e1-73246daefe3c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:06.601591 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f6224fbb-11ba-4516-b4e1-73246daefe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:06.680339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:06.744366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6224fbb-11ba-4516-b4e1-73246daefe3c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:06.852655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4bd00-8a87-436c-a7e5-51991f603af0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:06.853339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4bd00-8a87-436c-a7e5-51991f603af0 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:06.853666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4bd00-8a87-436c-a7e5-51991f603af0 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:06.853942 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4bd00-8a87-436c-a7e5-51991f603af0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:06.856260 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e5b4bd00-8a87-436c-a7e5-51991f603af0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:06.916526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:06.936478 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0c4bf-2bec-4fa0-b7a7-1a8e1eee24c3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:06.936754 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0c4bf-2bec-4fa0-b7a7-1a8e1eee24c3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:06.937022 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0c4bf-2bec-4fa0-b7a7-1a8e1eee24c3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:06.938401 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 713/1400] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:28:06.942559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4bd00-8a87-436c-a7e5-51991f603af0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:06.943601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75913f9-c2f1-4bdb-90bf-b992ede5e865 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:06.943882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75913f9-c2f1-4bdb-90bf-b992ede5e865 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:06.944160 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75913f9-c2f1-4bdb-90bf-b992ede5e865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:06.944263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4bd00-8a87-436c-a7e5-51991f603af0 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:06.952687 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 688/1401] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:28:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:28:07.015082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b75913f9-c2f1-4bdb-90bf-b992ede5e865 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:07.016212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b75913f9-c2f1-4bdb-90bf-b992ede5e865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:07.074282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:07.117378 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 714/1402] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:28:07.165607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4bd00-8a87-436c-a7e5-51991f603af0 service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:07.166850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e5b4bd00-8a87-436c-a7e5-51991f603af0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:07.267959 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4bd00-8a87-436c-a7e5-51991f603af0 service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:07.373539 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:07.384935 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a0ed3-cfa6-4476-adf6-19bee54f45fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:07.385586 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a0ed3-cfa6-4476-adf6-19bee54f45fb service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:07.385869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a0ed3-cfa6-4476-adf6-19bee54f45fb service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:07.386751 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a0ed3-cfa6-4476-adf6-19bee54f45fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:07.388408 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-780a0ed3-cfa6-4476-adf6-19bee54f45fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:07.485511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a0ed3-cfa6-4476-adf6-19bee54f45fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:07.486629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a0ed3-cfa6-4476-adf6-19bee54f45fb service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:07.506367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 689/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:10.033567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aeed8c-d6cd-4acc-82d5-52633f29766b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:10.034142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aeed8c-d6cd-4acc-82d5-52633f29766b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:10.034142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aeed8c-d6cd-4acc-82d5-52633f29766b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:10.035930 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 715/1404] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:10.042214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28236ed6-53fa-4495-bd34-b3fa0bd4ee2b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:10.042718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28236ed6-53fa-4495-bd34-b3fa0bd4ee2b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:10.043170 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28236ed6-53fa-4495-bd34-b3fa0bd4ee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:10.117532 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-28236ed6-53fa-4495-bd34-b3fa0bd4ee2b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:10.120904 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-28236ed6-53fa-4495-bd34-b3fa0bd4ee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:10.194003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:10.242803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 690/1405] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:10.289267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aeed8c-d6cd-4acc-82d5-52633f29766b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:10.290851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c4aeed8c-d6cd-4acc-82d5-52633f29766b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:10.469342 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aeed8c-d6cd-4acc-82d5-52633f29766b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:10.520300 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:10.607350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d027be-719f-40f8-b2e1-0b535814b78e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:10.607911 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d027be-719f-40f8-b2e1-0b535814b78e service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:10.608191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d027be-719f-40f8-b2e1-0b535814b78e service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:10.609438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d027be-719f-40f8-b2e1-0b535814b78e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:10.612981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a6d027be-719f-40f8-b2e1-0b535814b78e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:10.717303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d027be-719f-40f8-b2e1-0b535814b78e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:10.719387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d027be-719f-40f8-b2e1-0b535814b78e service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:10.743444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 716/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:14.214961 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc5b9f-d9d5-473f-be38-97b5368f38cf None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:14.215525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc5b9f-d9d5-473f-be38-97b5368f38cf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:14.215525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc5b9f-d9d5-473f-be38-97b5368f38cf None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:14.217011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 691/1407] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:14.222859 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185094a-9970-42c9-9fc7-372851a570a7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:14.223624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185094a-9970-42c9-9fc7-372851a570a7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:14.224118 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185094a-9970-42c9-9fc7-372851a570a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:14.292349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:14.300041 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3185094a-9970-42c9-9fc7-372851a570a7 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:14.305471 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3185094a-9970-42c9-9fc7-372851a570a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:14.422240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 717/1408] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:14.472741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc5b9f-d9d5-473f-be38-97b5368f38cf None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:14.474178 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-67bc5b9f-d9d5-473f-be38-97b5368f38cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:14.642815 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc5b9f-d9d5-473f-be38-97b5368f38cf None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:14.695452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:14.772101 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ea386-2a2f-49c1-9e3c-1ae07d106817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:14.772730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ea386-2a2f-49c1-9e3c-1ae07d106817 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:14.773012 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ea386-2a2f-49c1-9e3c-1ae07d106817 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:14.773282 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ea386-2a2f-49c1-9e3c-1ae07d106817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:14.775009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f64ea386-2a2f-49c1-9e3c-1ae07d106817 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:14.882128 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ea386-2a2f-49c1-9e3c-1ae07d106817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:14.883899 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ea386-2a2f-49c1-9e3c-1ae07d106817 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:14.904338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 692/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:24.420435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=44 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:24.901982 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=77 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:31.335400 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03175b-2c9b-4589-a16e-fb634ea89afd None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:31.335934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03175b-2c9b-4589-a16e-fb634ea89afd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:31.336838 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03175b-2c9b-4589-a16e-fb634ea89afd None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:31.338258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 718/1410] 10.222.0.16 () {54 vars in 918 bytes} [Wed Jul 20 19:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:31.344142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e408-2266-41b7-8719-b2ba662a7b2b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:31.344632 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e408-2266-41b7-8719-b2ba662a7b2b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:31.344731 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e408-2266-41b7-8719-b2ba662a7b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:31.421617 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-56d0e408-2266-41b7-8719-b2ba662a7b2b None None] MFA Rules not processed for user `dbc616ed904d43d2b160b8d2766f7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:31.422877 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-56d0e408-2266-41b7-8719-b2ba662a7b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:31.532878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 693/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Jul 20 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:31.547270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da23a0-2465-4c05-b3b5-b0336cc6f397 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:31.547558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da23a0-2465-4c05-b3b5-b0336cc6f397 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:31.547837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da23a0-2465-4c05-b3b5-b0336cc6f397 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:31.549210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 719/1412] 10.222.0.16 () {54 vars in 918 bytes} [Wed Jul 20 19:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:31.553912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2456ecb-5ca2-4f71-b051-460ee5bae10a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:31.554202 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2456ecb-5ca2-4f71-b051-460ee5bae10a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:31.554494 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2456ecb-5ca2-4f71-b051-460ee5bae10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:31.625646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:31.628774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a2456ecb-5ca2-4f71-b051-460ee5bae10a None None] MFA Rules not processed for user `e3fd38ebb5514af686204d0b02a91edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:31.630035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a2456ecb-5ca2-4f71-b051-460ee5bae10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:31.757298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 694/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Jul 20 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:28:34.317949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b7e44-37b0-4932-af5a-9d1d18e915d4 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:34.318547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b7e44-37b0-4932-af5a-9d1d18e915d4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:34.318547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b7e44-37b0-4932-af5a-9d1d18e915d4 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:34.320566 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 720/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:34.326534 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a17dfa-09c3-47d5-95eb-5c79f8b1f419 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:34.327171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a17dfa-09c3-47d5-95eb-5c79f8b1f419 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:34.327171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a17dfa-09c3-47d5-95eb-5c79f8b1f419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:34.394738 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-83a17dfa-09c3-47d5-95eb-5c79f8b1f419 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:34.395957 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-83a17dfa-09c3-47d5-95eb-5c79f8b1f419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:34.452526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:34.494915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 695/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:28:34.539744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b7e44-37b0-4932-af5a-9d1d18e915d4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:34.541187 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-517b7e44-37b0-4932-af5a-9d1d18e915d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:34.689408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b7e44-37b0-4932-af5a-9d1d18e915d4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:34.762659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:34.805299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d6263-53f7-46b8-9ddc-1627eeafb692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:34.805875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d6263-53f7-46b8-9ddc-1627eeafb692 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:34.806152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d6263-53f7-46b8-9ddc-1627eeafb692 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:34.806454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d6263-53f7-46b8-9ddc-1627eeafb692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:34.808211 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cb3d6263-53f7-46b8-9ddc-1627eeafb692 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:34.898793 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d6263-53f7-46b8-9ddc-1627eeafb692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:34.900571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d6263-53f7-46b8-9ddc-1627eeafb692 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:34.918963 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 721/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:35.832923 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb5db-62e5-46df-a75e-09d06fe26b8a None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:35.833466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb5db-62e5-46df-a75e-09d06fe26b8a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:35.833466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb5db-62e5-46df-a75e-09d06fe26b8a None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:35.834915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 696/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:35.840136 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5c1f4-07f5-4fa6-b5d1-30e54251c0bc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:35.840591 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5c1f4-07f5-4fa6-b5d1-30e54251c0bc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:35.840698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5c1f4-07f5-4fa6-b5d1-30e54251c0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:35.917293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-77a5c1f4-07f5-4fa6-b5d1-30e54251c0bc None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:35.918531 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-77a5c1f4-07f5-4fa6-b5d1-30e54251c0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:35.946355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:36.017213 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 722/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:36.169859 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cb5db-62e5-46df-a75e-09d06fe26b8a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:36.171622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6a7cb5db-62e5-46df-a75e-09d06fe26b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:36.319452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cb5db-62e5-46df-a75e-09d06fe26b8a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:36.361513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:36.435208 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63f75e-b535-4ca7-89ad-0c363ce9d4ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:36.435868 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63f75e-b535-4ca7-89ad-0c363ce9d4ec service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:36.436151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63f75e-b535-4ca7-89ad-0c363ce9d4ec service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:36.436623 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63f75e-b535-4ca7-89ad-0c363ce9d4ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:36.438302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fd63f75e-b535-4ca7-89ad-0c363ce9d4ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:36.529594 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63f75e-b535-4ca7-89ad-0c363ce9d4ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:36.531225 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63f75e-b535-4ca7-89ad-0c363ce9d4ec service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:36.549781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 697/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:37.440469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ced072-23df-4699-94d6-8ca71d911022 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:37.441066 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ced072-23df-4699-94d6-8ca71d911022 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:37.441066 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ced072-23df-4699-94d6-8ca71d911022 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:37.442389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 723/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:37.448083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b248c-b98f-4c14-8cde-c703b748e389 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:37.448552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b248c-b98f-4c14-8cde-c703b748e389 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:37.448672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b248c-b98f-4c14-8cde-c703b748e389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:37.502423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:37.525293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ea8b248c-b98f-4c14-8cde-c703b748e389 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:37.526519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ea8b248c-b98f-4c14-8cde-c703b748e389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:37.628204 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 698/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:37.777149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ced072-23df-4699-94d6-8ca71d911022 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:37.778681 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-99ced072-23df-4699-94d6-8ca71d911022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:37.932768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ced072-23df-4699-94d6-8ca71d911022 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:37.945640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:38.048990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07507453-add3-48b2-9bd4-af37dba00feb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:38.049643 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507453-add3-48b2-9bd4-af37dba00feb service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:38.049927 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507453-add3-48b2-9bd4-af37dba00feb service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:38.050210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507453-add3-48b2-9bd4-af37dba00feb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:38.051919 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-07507453-add3-48b2-9bd4-af37dba00feb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:38.141102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07507453-add3-48b2-9bd4-af37dba00feb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:38.142750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07507453-add3-48b2-9bd4-af37dba00feb service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:38.161424 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 724/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:39.046604 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffcdbe-7b22-405c-9986-49917b7d8bd0 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:39.047215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffcdbe-7b22-405c-9986-49917b7d8bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:39.047215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffcdbe-7b22-405c-9986-49917b7d8bd0 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:39.048565 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 699/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:39.053459 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e60d0-4fab-437f-b138-c9ac83ba7cd8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:39.054439 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e60d0-4fab-437f-b138-c9ac83ba7cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:39.054550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e60d0-4fab-437f-b138-c9ac83ba7cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:39.073692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:39.129806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ca7e60d0-4fab-437f-b138-c9ac83ba7cd8 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:39.131092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ca7e60d0-4fab-437f-b138-c9ac83ba7cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:39.229036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 725/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:39.383301 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffcdbe-7b22-405c-9986-49917b7d8bd0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:39.384927 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bbffcdbe-7b22-405c-9986-49917b7d8bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:39.503958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:39.540820 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffcdbe-7b22-405c-9986-49917b7d8bd0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:39.654221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2007d-ef9e-44b3-a5fe-f1fb645ba2f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:39.654905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2007d-ef9e-44b3-a5fe-f1fb645ba2f1 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:39.655181 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2007d-ef9e-44b3-a5fe-f1fb645ba2f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:39.655454 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2007d-ef9e-44b3-a5fe-f1fb645ba2f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:39.657143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-08e2007d-ef9e-44b3-a5fe-f1fb645ba2f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:39.734507 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:39.747856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2007d-ef9e-44b3-a5fe-f1fb645ba2f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:39.749428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2007d-ef9e-44b3-a5fe-f1fb645ba2f1 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:39.767941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 700/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:40.641164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdcf12-9299-40b7-8b17-8eb49387713e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:40.641737 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdcf12-9299-40b7-8b17-8eb49387713e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:40.641737 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdcf12-9299-40b7-8b17-8eb49387713e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:40.643150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 726/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:28:40.648188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80baf0-f90d-4c18-91fa-0b49b48fd3c1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:40.648625 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80baf0-f90d-4c18-91fa-0b49b48fd3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:40.648731 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80baf0-f90d-4c18-91fa-0b49b48fd3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:40.723794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ab80baf0-f90d-4c18-91fa-0b49b48fd3c1 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:40.725012 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ab80baf0-f90d-4c18-91fa-0b49b48fd3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:40.823556 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 701/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:40.978658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdcf12-9299-40b7-8b17-8eb49387713e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:40.980260 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9acdcf12-9299-40b7-8b17-8eb49387713e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:41.064595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:41.126077 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdcf12-9299-40b7-8b17-8eb49387713e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:41.254581 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09d0c2-fb58-4818-a6f9-24de0fa5bde2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:41.255263 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d0c2-fb58-4818-a6f9-24de0fa5bde2 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:41.255546 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d0c2-fb58-4818-a6f9-24de0fa5bde2 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:41.255816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d0c2-fb58-4818-a6f9-24de0fa5bde2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:41.257841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bf09d0c2-fb58-4818-a6f9-24de0fa5bde2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:41.313150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:41.356289 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09d0c2-fb58-4818-a6f9-24de0fa5bde2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:41.358652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09d0c2-fb58-4818-a6f9-24de0fa5bde2 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:41.376954 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 727/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:42.254315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdba01-58c8-4987-81b5-1476bb4f26f8 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:42.254927 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdba01-58c8-4987-81b5-1476bb4f26f8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:42.254927 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdba01-58c8-4987-81b5-1476bb4f26f8 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:42.256279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 702/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:42.262384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dacc3-bfcc-4979-9073-669668719400 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:42.262888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dacc3-bfcc-4979-9073-669668719400 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:42.263012 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dacc3-bfcc-4979-9073-669668719400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:42.343354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-235dacc3-bfcc-4979-9073-669668719400 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:42.344594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-235dacc3-bfcc-4979-9073-669668719400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:42.440703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 728/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:42.599528 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdba01-58c8-4987-81b5-1476bb4f26f8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:42.601647 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-60fdba01-58c8-4987-81b5-1476bb4f26f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:42.651047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:42.748601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdba01-58c8-4987-81b5-1476bb4f26f8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:42.862002 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e2512-c447-4d34-92fa-2cd79ddd3fe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:42.862575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e2512-c447-4d34-92fa-2cd79ddd3fe1 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:42.862883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e2512-c447-4d34-92fa-2cd79ddd3fe1 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:42.863154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e2512-c447-4d34-92fa-2cd79ddd3fe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:42.864804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-138e2512-c447-4d34-92fa-2cd79ddd3fe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:42.871966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:42.954945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e2512-c447-4d34-92fa-2cd79ddd3fe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:42.956635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e2512-c447-4d34-92fa-2cd79ddd3fe1 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:42.976142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 703/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:43.921845 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde76c5-23fa-419f-91c1-161ad96114c1 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:43.922427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde76c5-23fa-419f-91c1-161ad96114c1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:43.922536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde76c5-23fa-419f-91c1-161ad96114c1 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:43.924632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 729/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:28:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:43.930105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7c7d5-9633-440f-8f4c-58f5d4fa7daf None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:43.930593 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7c7d5-9633-440f-8f4c-58f5d4fa7daf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:43.930732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7c7d5-9633-440f-8f4c-58f5d4fa7daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:44.031909 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-57d7c7d5-9633-440f-8f4c-58f5d4fa7daf None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:44.033345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-57d7c7d5-9633-440f-8f4c-58f5d4fa7daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:44.116464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:44.156197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 704/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:44.325673 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde76c5-23fa-419f-91c1-161ad96114c1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:44.327336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8cde76c5-23fa-419f-91c1-161ad96114c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:44.349329 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:44.505655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde76c5-23fa-419f-91c1-161ad96114c1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:44.602562 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:44.628429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4515fd-ec43-4b92-9af9-01df6b9c32c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:44.629080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4515fd-ec43-4b92-9af9-01df6b9c32c3 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:44.629360 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4515fd-ec43-4b92-9af9-01df6b9c32c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:44.629634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4515fd-ec43-4b92-9af9-01df6b9c32c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:44.631887 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bd4515fd-ec43-4b92-9af9-01df6b9c32c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:44.723051 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4515fd-ec43-4b92-9af9-01df6b9c32c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:44.724680 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4515fd-ec43-4b92-9af9-01df6b9c32c3 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:44.743667 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 730/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:45.622989 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08556ee8-cf46-4d02-b619-f22c7be99979 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:45.623522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08556ee8-cf46-4d02-b619-f22c7be99979 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:45.623522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08556ee8-cf46-4d02-b619-f22c7be99979 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:45.624828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 705/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:45.629784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1edb5-a6d1-4779-b3b9-c13f96d767a5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:45.633427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1edb5-a6d1-4779-b3b9-c13f96d767a5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:45.633427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1edb5-a6d1-4779-b3b9-c13f96d767a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:45.711092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b3f1edb5-a6d1-4779-b3b9-c13f96d767a5 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:45.712312 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b3f1edb5-a6d1-4779-b3b9-c13f96d767a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:45.753513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:45.809470 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 731/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:45.965647 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08556ee8-cf46-4d02-b619-f22c7be99979 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:45.967221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-08556ee8-cf46-4d02-b619-f22c7be99979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:46.114268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08556ee8-cf46-4d02-b619-f22c7be99979 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:46.169269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:46.228832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65321ef-c316-4f04-bc1e-445a77b961b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:46.229401 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65321ef-c316-4f04-bc1e-445a77b961b7 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:46.229681 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65321ef-c316-4f04-bc1e-445a77b961b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:46.229953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65321ef-c316-4f04-bc1e-445a77b961b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:46.231646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c65321ef-c316-4f04-bc1e-445a77b961b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:46.323767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65321ef-c316-4f04-bc1e-445a77b961b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:46.325396 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65321ef-c316-4f04-bc1e-445a77b961b7 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:46.344622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 706/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:47.246292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452db34-383b-4a4a-a4f9-cdd70f651d03 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:47.246879 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452db34-383b-4a4a-a4f9-cdd70f651d03 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:47.246879 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452db34-383b-4a4a-a4f9-cdd70f651d03 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:47.248196 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 732/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:47.253530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c80a5-0cf5-4f72-be31-3df9a9f3c119 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:47.254042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c80a5-0cf5-4f72-be31-3df9a9f3c119 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:47.254151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c80a5-0cf5-4f72-be31-3df9a9f3c119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:47.338981 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1d3c80a5-0cf5-4f72-be31-3df9a9f3c119 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:47.340511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1d3c80a5-0cf5-4f72-be31-3df9a9f3c119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:47.342648 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:47.440605 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 707/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:47.591516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452db34-383b-4a4a-a4f9-cdd70f651d03 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:47.593166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9452db34-383b-4a4a-a4f9-cdd70f651d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:47.747074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452db34-383b-4a4a-a4f9-cdd70f651d03 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:47.774257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:47.861735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129c616-1508-4a00-abc9-00c6e79945c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:47.862283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129c616-1508-4a00-abc9-00c6e79945c7 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:47.862557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129c616-1508-4a00-abc9-00c6e79945c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:47.862861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129c616-1508-4a00-abc9-00c6e79945c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:47.864489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d129c616-1508-4a00-abc9-00c6e79945c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:47.955541 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129c616-1508-4a00-abc9-00c6e79945c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:47.957143 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129c616-1508-4a00-abc9-00c6e79945c7 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:47.975475 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 733/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:49.934720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b4477-d223-4014-a503-6ad4b54d1b49 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:49.935268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b4477-d223-4014-a503-6ad4b54d1b49 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:49.935268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b4477-d223-4014-a503-6ad4b54d1b49 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:49.936655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 708/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:49.942744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cc32d-7261-41bb-a299-76abf38b5d3a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:49.943233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cc32d-7261-41bb-a299-76abf38b5d3a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:49.943350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cc32d-7261-41bb-a299-76abf38b5d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:49.986407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:50.011802 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ec3cc32d-7261-41bb-a299-76abf38b5d3a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:50.013015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ec3cc32d-7261-41bb-a299-76abf38b5d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:50.109630 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 734/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:50.148848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b4477-d223-4014-a503-6ad4b54d1b49 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:50.150375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-198b4477-d223-4014-a503-6ad4b54d1b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:50.254972 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b4477-d223-4014-a503-6ad4b54d1b49 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:50.288177 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:50.331829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2771e39-70e4-4496-b96f-c98e8e7b8dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:50.332485 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2771e39-70e4-4496-b96f-c98e8e7b8dfb service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:50.332779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2771e39-70e4-4496-b96f-c98e8e7b8dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:50.333047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2771e39-70e4-4496-b96f-c98e8e7b8dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:50.334739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f2771e39-70e4-4496-b96f-c98e8e7b8dfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:50.443566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2771e39-70e4-4496-b96f-c98e8e7b8dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:50.445669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2771e39-70e4-4496-b96f-c98e8e7b8dfb service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:50.464216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 709/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:52.670258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11674b78-f243-4c3c-bad1-b9a22abb8728 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:52.670878 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11674b78-f243-4c3c-bad1-b9a22abb8728 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:52.670878 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11674b78-f243-4c3c-bad1-b9a22abb8728 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:52.674360 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 735/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:52.677588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9560eff-63b8-4c34-89ea-914c8340b670 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:52.678026 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9560eff-63b8-4c34-89ea-914c8340b670 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:52.678143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9560eff-63b8-4c34-89ea-914c8340b670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:52.743915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c9560eff-63b8-4c34-89ea-914c8340b670 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:52.745130 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c9560eff-63b8-4c34-89ea-914c8340b670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:52.757961 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:52.842586 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 710/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:52.880931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11674b78-f243-4c3c-bad1-b9a22abb8728 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:52.883054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-11674b78-f243-4c3c-bad1-b9a22abb8728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:52.988747 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11674b78-f243-4c3c-bad1-b9a22abb8728 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:53.001278 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:53.062783 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca5794-b2bc-430e-9916-6c6e4fafe7e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:53.063429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca5794-b2bc-430e-9916-6c6e4fafe7e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:53.063713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca5794-b2bc-430e-9916-6c6e4fafe7e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:53.063987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca5794-b2bc-430e-9916-6c6e4fafe7e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:53.065637 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e7ca5794-b2bc-430e-9916-6c6e4fafe7e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:53.175357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca5794-b2bc-430e-9916-6c6e4fafe7e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:53.176807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca5794-b2bc-430e-9916-6c6e4fafe7e1 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:53.196179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 736/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:55.711836 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e82f6-30b8-42f1-b69f-ae38aee02e19 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:55.712411 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e82f6-30b8-42f1-b69f-ae38aee02e19 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:55.712411 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e82f6-30b8-42f1-b69f-ae38aee02e19 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:55.713753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 711/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:28:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:55.719343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ca785-1646-4c47-9493-a5d9f5b8552c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:55.719750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ca785-1646-4c47-9493-a5d9f5b8552c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:55.719906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ca785-1646-4c47-9493-a5d9f5b8552c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:55.766763 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:55.789932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5d9ca785-1646-4c47-9493-a5d9f5b8552c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:55.791198 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5d9ca785-1646-4c47-9493-a5d9f5b8552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:55.888167 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 737/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:55.927100 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e82f6-30b8-42f1-b69f-ae38aee02e19 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:55.928648 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6d3e82f6-30b8-42f1-b69f-ae38aee02e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:56.037104 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e82f6-30b8-42f1-b69f-ae38aee02e19 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:56.080345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:56.117878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5ea65-0960-451d-ac64-124d73379c09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:56.118562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5ea65-0960-451d-ac64-124d73379c09 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:56.118866 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5ea65-0960-451d-ac64-124d73379c09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:56.119136 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5ea65-0960-451d-ac64-124d73379c09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:56.120838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-42a5ea65-0960-451d-ac64-124d73379c09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:56.237184 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5ea65-0960-451d-ac64-124d73379c09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:56.238634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5ea65-0960-451d-ac64-124d73379c09 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:56.257574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 712/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:58.439291 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a22359-3bef-46d8-a65e-481ecb4fdbc4 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:58.439823 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a22359-3bef-46d8-a65e-481ecb4fdbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:58.439823 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a22359-3bef-46d8-a65e-481ecb4fdbc4 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:58.441258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 738/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:58.447355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b0e98-30b7-4306-9017-64d9dcc49d87 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:58.447763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b0e98-30b7-4306-9017-64d9dcc49d87 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:58.447896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b0e98-30b7-4306-9017-64d9dcc49d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:58.513116 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1c9b0e98-30b7-4306-9017-64d9dcc49d87 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:58.514322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1c9b0e98-30b7-4306-9017-64d9dcc49d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:58.534609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:58.609854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 713/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:58.649753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a22359-3bef-46d8-a65e-481ecb4fdbc4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:58.651390 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-13a22359-3bef-46d8-a65e-481ecb4fdbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:58.760670 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a22359-3bef-46d8-a65e-481ecb4fdbc4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:58.781320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:58.837688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c2718-254b-4f0e-86da-e9e4b940241c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:58.838338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c2718-254b-4f0e-86da-e9e4b940241c service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:58.838620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c2718-254b-4f0e-86da-e9e4b940241c service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:58.839211 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c2718-254b-4f0e-86da-e9e4b940241c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:58.840900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ef2c2718-254b-4f0e-86da-e9e4b940241c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:58.948807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c2718-254b-4f0e-86da-e9e4b940241c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:58.950254 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c2718-254b-4f0e-86da-e9e4b940241c service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:58.968872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 739/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:01.095766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04968aeb-7809-4ee2-a3d1-2fe0149c2fd2 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:01.096363 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04968aeb-7809-4ee2-a3d1-2fe0149c2fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:01.096363 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04968aeb-7809-4ee2-a3d1-2fe0149c2fd2 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:01.097713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 714/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:29:01.103555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e56ea-d96d-4acf-91d6-6a8f0b737ba3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:01.103991 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e56ea-d96d-4acf-91d6-6a8f0b737ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:01.104145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e56ea-d96d-4acf-91d6-6a8f0b737ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:01.192384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:01.195817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-630e56ea-d96d-4acf-91d6-6a8f0b737ba3 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:01.197085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-630e56ea-d96d-4acf-91d6-6a8f0b737ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:01.296984 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 740/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:01.336745 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04968aeb-7809-4ee2-a3d1-2fe0149c2fd2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:01.338343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-04968aeb-7809-4ee2-a3d1-2fe0149c2fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:01.447142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04968aeb-7809-4ee2-a3d1-2fe0149c2fd2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:01.496976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:01.522083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3e13f-15ef-45c1-ba6f-65d82bd60f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:01.522763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3e13f-15ef-45c1-ba6f-65d82bd60f08 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:01.523051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3e13f-15ef-45c1-ba6f-65d82bd60f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:01.523323 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3e13f-15ef-45c1-ba6f-65d82bd60f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:01.525405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0ce3e13f-15ef-45c1-ba6f-65d82bd60f08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:01.635983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3e13f-15ef-45c1-ba6f-65d82bd60f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:01.635983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3e13f-15ef-45c1-ba6f-65d82bd60f08 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:01.652925 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 715/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:03.788367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef1dd-57bb-467f-aeef-c5aabb087842 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:03.789202 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef1dd-57bb-467f-aeef-c5aabb087842 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:03.789396 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef1dd-57bb-467f-aeef-c5aabb087842 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:03.790873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 741/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:29:03.796166 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d9490-e9cf-4ff8-87ef-b644c91d0e8b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:03.796612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d9490-e9cf-4ff8-87ef-b644c91d0e8b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:03.796733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d9490-e9cf-4ff8-87ef-b644c91d0e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:03.862435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-536d9490-e9cf-4ff8-87ef-b644c91d0e8b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:03.863839 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-536d9490-e9cf-4ff8-87ef-b644c91d0e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:03.894455 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:03.962374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 716/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:04.001742 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef1dd-57bb-467f-aeef-c5aabb087842 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:04.003362 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-457ef1dd-57bb-467f-aeef-c5aabb087842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:04.112023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef1dd-57bb-467f-aeef-c5aabb087842 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:04.141981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:04.189871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2718f26-cd4d-4ceb-9d11-e7f85d3775ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:04.199509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2718f26-cd4d-4ceb-9d11-e7f85d3775ae service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:04.199509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2718f26-cd4d-4ceb-9d11-e7f85d3775ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:04.199509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2718f26-cd4d-4ceb-9d11-e7f85d3775ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:04.199509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f2718f26-cd4d-4ceb-9d11-e7f85d3775ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:04.315763 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2718f26-cd4d-4ceb-9d11-e7f85d3775ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:04.316929 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2718f26-cd4d-4ceb-9d11-e7f85d3775ae service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:04.337792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 742/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:06.490134 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a2d1d-70ff-4313-896c-9271928da1b0 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:06.490750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a2d1d-70ff-4313-896c-9271928da1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:06.490750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a2d1d-70ff-4313-896c-9271928da1b0 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:06.492946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 717/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:29:06.498250 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98538e63-6b66-4b57-ad5d-f00918ccda3c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:06.498711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98538e63-6b66-4b57-ad5d-f00918ccda3c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:06.498844 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98538e63-6b66-4b57-ad5d-f00918ccda3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:06.564205 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-98538e63-6b66-4b57-ad5d-f00918ccda3c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:06.565353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-98538e63-6b66-4b57-ad5d-f00918ccda3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:06.573852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:06.664669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 743/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:06.704318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a2d1d-70ff-4313-896c-9271928da1b0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:06.705872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b19a2d1d-70ff-4313-896c-9271928da1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:06.810346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a2d1d-70ff-4313-896c-9271928da1b0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:06.867688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:06.885908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470dfda-9caf-4b26-9f55-46612dfde9ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:06.886567 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470dfda-9caf-4b26-9f55-46612dfde9ee service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:06.886873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470dfda-9caf-4b26-9f55-46612dfde9ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:06.887149 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470dfda-9caf-4b26-9f55-46612dfde9ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:06.888813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c470dfda-9caf-4b26-9f55-46612dfde9ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:07.000038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470dfda-9caf-4b26-9f55-46612dfde9ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:07.001525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470dfda-9caf-4b26-9f55-46612dfde9ee service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:07.019916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 718/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:09.167194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd0c5c-2ef7-4b96-a1a9-4d253cc17c1f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:09.167971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd0c5c-2ef7-4b96-a1a9-4d253cc17c1f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:09.167971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd0c5c-2ef7-4b96-a1a9-4d253cc17c1f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:09.169051 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 744/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:29:09.174420 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cebb2e-b148-4f49-856c-c7de552d2236 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:09.174941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cebb2e-b148-4f49-856c-c7de552d2236 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:09.175053 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cebb2e-b148-4f49-856c-c7de552d2236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:09.240997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f2cebb2e-b148-4f49-856c-c7de552d2236 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:09.242823 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f2cebb2e-b148-4f49-856c-c7de552d2236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:09.283185 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:09.345627 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 719/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:09.385320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd0c5c-2ef7-4b96-a1a9-4d253cc17c1f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:09.386926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ecfd0c5c-2ef7-4b96-a1a9-4d253cc17c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:09.495319 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd0c5c-2ef7-4b96-a1a9-4d253cc17c1f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:09.533618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:09.571091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b35b37-eac5-42d8-a9d8-64d0665f966e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:09.571839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b35b37-eac5-42d8-a9d8-64d0665f966e service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:09.572121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b35b37-eac5-42d8-a9d8-64d0665f966e service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:09.572393 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b35b37-eac5-42d8-a9d8-64d0665f966e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:09.574053 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-64b35b37-eac5-42d8-a9d8-64d0665f966e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:09.702848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b35b37-eac5-42d8-a9d8-64d0665f966e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:09.704336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b35b37-eac5-42d8-a9d8-64d0665f966e service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:09.725136 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 745/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:11.841091 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb4afe-38a2-4d49-a6f2-929d173a3e7b None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:11.841682 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb4afe-38a2-4d49-a6f2-929d173a3e7b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:11.841682 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb4afe-38a2-4d49-a6f2-929d173a3e7b None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:11.843300 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 720/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:29:11.848911 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fc395-2a05-4692-bed4-7d45f1aa0f14 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:11.849399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fc395-2a05-4692-bed4-7d45f1aa0f14 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:11.849505 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fc395-2a05-4692-bed4-7d45f1aa0f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:11.917873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-663fc395-2a05-4692-bed4-7d45f1aa0f14 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:11.919126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-663fc395-2a05-4692-bed4-7d45f1aa0f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:11.936876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:12.029037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 746/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:12.067471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb4afe-38a2-4d49-a6f2-929d173a3e7b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:12.069702 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5edb4afe-38a2-4d49-a6f2-929d173a3e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:12.173601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb4afe-38a2-4d49-a6f2-929d173a3e7b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:12.242695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:12.249492 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de502c39-1681-4856-b3dd-6a9eadcaef5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:12.251926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502c39-1681-4856-b3dd-6a9eadcaef5e service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:12.251926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502c39-1681-4856-b3dd-6a9eadcaef5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:12.251926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502c39-1681-4856-b3dd-6a9eadcaef5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:12.252385 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-de502c39-1681-4856-b3dd-6a9eadcaef5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:12.373414 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de502c39-1681-4856-b3dd-6a9eadcaef5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:12.374887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de502c39-1681-4856-b3dd-6a9eadcaef5e service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:12.393377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 721/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:14.487823 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3b5a0-0547-45fe-bdb5-499023c39d97 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:14.488387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3b5a0-0547-45fe-bdb5-499023c39d97 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:14.488387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3b5a0-0547-45fe-bdb5-499023c39d97 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:14.489808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 747/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:29:14.496006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22ea96-c83a-4a3f-83dd-4ae1db7aace1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:14.496471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22ea96-c83a-4a3f-83dd-4ae1db7aace1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:14.496578 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22ea96-c83a-4a3f-83dd-4ae1db7aace1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:14.563941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-df22ea96-c83a-4a3f-83dd-4ae1db7aace1 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:14.565107 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-df22ea96-c83a-4a3f-83dd-4ae1db7aace1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:14.613845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:14.662194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 722/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:14.701211 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3b5a0-0547-45fe-bdb5-499023c39d97 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:14.702809 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fde3b5a0-0547-45fe-bdb5-499023c39d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:14.808284 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3b5a0-0547-45fe-bdb5-499023c39d97 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:14.857323 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:14.884468 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24236fcf-51e4-4a7d-90ce-94d6811785be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:14.885120 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24236fcf-51e4-4a7d-90ce-94d6811785be service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:14.885398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24236fcf-51e4-4a7d-90ce-94d6811785be service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:14.885665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24236fcf-51e4-4a7d-90ce-94d6811785be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:14.887461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-24236fcf-51e4-4a7d-90ce-94d6811785be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:15.019927 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24236fcf-51e4-4a7d-90ce-94d6811785be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:15.021381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24236fcf-51e4-4a7d-90ce-94d6811785be service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:15.041967 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 748/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:24.665948 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=22 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:25.039524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=66 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:35.968036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694a347-18e2-4950-a221-95c000245d89 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:35.968676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694a347-18e2-4950-a221-95c000245d89 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:35.968676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694a347-18e2-4950-a221-95c000245d89 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:35.969971 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 723/1471] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:29:35.976062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d82a9f-40f4-4d79-926a-f1375764b925 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:35.976505 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d82a9f-40f4-4d79-926a-f1375764b925 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:35.976630 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d82a9f-40f4-4d79-926a-f1375764b925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:36.041577 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c7d82a9f-40f4-4d79-926a-f1375764b925 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:36.042816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c7d82a9f-40f4-4d79-926a-f1375764b925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:36.140211 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 749/1472] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:36.227235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc96504-30c2-4902-9e86-813f1a3dfdd7 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:36.227525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc96504-30c2-4902-9e86-813f1a3dfdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:36.227809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc96504-30c2-4902-9e86-813f1a3dfdd7 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:36.229176 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 724/1473] 10.222.0.16 () {54 vars in 966 bytes} [Wed Jul 20 19:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:29:36.234045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49259a-3aea-4175-b0e4-935de6f69c91 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:36.234330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49259a-3aea-4175-b0e4-935de6f69c91 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:36.234603 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49259a-3aea-4175-b0e4-935de6f69c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:36.313056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3f49259a-3aea-4175-b0e4-935de6f69c91 None None] MFA Rules not processed for user `dbc7e1bc2eb943eba57a0009635de70d`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:36.314279 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3f49259a-3aea-4175-b0e4-935de6f69c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:36.336025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:36.393586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 750/1474] 10.222.0.16 () {58 vars in 1063 bytes} [Wed Jul 20 19:29:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:36.401302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc96504-30c2-4902-9e86-813f1a3dfdd7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:36.402891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-afc96504-30c2-4902-9e86-813f1a3dfdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:36.512540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc96504-30c2-4902-9e86-813f1a3dfdd7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:36.585314 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1359d9-b6e1-4be6-94ff-a40d8528b521 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc7e1bc2eb943eba57a0009635de70d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:36.586094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1359d9-b6e1-4be6-94ff-a40d8528b521 service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:36.586376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1359d9-b6e1-4be6-94ff-a40d8528b521 service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:36.586647 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1359d9-b6e1-4be6-94ff-a40d8528b521 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:36.588317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ce1359d9-b6e1-4be6-94ff-a40d8528b521 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:36.643177 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:36.699591 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1359d9-b6e1-4be6-94ff-a40d8528b521 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:36.701600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1359d9-b6e1-4be6-94ff-a40d8528b521 service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:36.721985 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 725/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:38.884195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122ceff-a1be-4ef3-9696-c1e126b16c8a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:38.884860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122ceff-a1be-4ef3-9696-c1e126b16c8a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:38.884860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122ceff-a1be-4ef3-9696-c1e126b16c8a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:38.886139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 751/1476] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:29:38.891513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9499386-ec04-474e-bd5e-155fd192b213 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:38.891945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9499386-ec04-474e-bd5e-155fd192b213 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:38.892062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9499386-ec04-474e-bd5e-155fd192b213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:39.074438 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b9499386-ec04-474e-bd5e-155fd192b213 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:39.075686 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b9499386-ec04-474e-bd5e-155fd192b213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:39.174164 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 726/1477] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:39.199433 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122ceff-a1be-4ef3-9696-c1e126b16c8a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:39.200960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c122ceff-a1be-4ef3-9696-c1e126b16c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:39.334848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122ceff-a1be-4ef3-9696-c1e126b16c8a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:39.387468 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:39.432820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b66a04-0fee-43b8-a522-bf711f88b68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:39.433430 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b66a04-0fee-43b8-a522-bf711f88b68f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:39.433705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b66a04-0fee-43b8-a522-bf711f88b68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:39.433975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b66a04-0fee-43b8-a522-bf711f88b68f admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:39.434806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b66a04-0fee-43b8-a522-bf711f88b68f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:39.436628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-78b66a04-0fee-43b8-a522-bf711f88b68f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:29:39.436628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 20 19:29:39.436628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: Jul 20 19:29:39.437784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b66a04-0fee-43b8-a522-bf711f88b68f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:39.458435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 752/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jul 20 19:29:39 2022] GET /identity/v3/projects => generated 2553 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:29:41.557588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a4f5-fd3a-410f-b8df-a3854a5cd162 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:41.558121 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a4f5-fd3a-410f-b8df-a3854a5cd162 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:41.558121 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a4f5-fd3a-410f-b8df-a3854a5cd162 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:41.559485 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 727/1479] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:29:41.564776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007ed2c-ba7b-4d2a-89e6-25008d2fde0c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:41.565211 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007ed2c-ba7b-4d2a-89e6-25008d2fde0c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:41.565316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007ed2c-ba7b-4d2a-89e6-25008d2fde0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:41.632519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0007ed2c-ba7b-4d2a-89e6-25008d2fde0c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:41.633768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0007ed2c-ba7b-4d2a-89e6-25008d2fde0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:41.736535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 753/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:29:41.780799 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60a4f5-fd3a-410f-b8df-a3854a5cd162 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:41.782340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6e60a4f5-fd3a-410f-b8df-a3854a5cd162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:41.792281 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:41.931047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60a4f5-fd3a-410f-b8df-a3854a5cd162 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:42.012169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:42.044276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903148c0-da50-4659-af3f-d014a1f93fe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:42.044924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903148c0-da50-4659-af3f-d014a1f93fe7 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:42.045200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903148c0-da50-4659-af3f-d014a1f93fe7 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:42.045466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903148c0-da50-4659-af3f-d014a1f93fe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:42.047824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-903148c0-da50-4659-af3f-d014a1f93fe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:42.136843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903148c0-da50-4659-af3f-d014a1f93fe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:42.138426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903148c0-da50-4659-af3f-d014a1f93fe7 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:42.156129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 728/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:44.501711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaafa78-c0b7-4fbe-a22d-92a5e5755b43 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:44.502309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaafa78-c0b7-4fbe-a22d-92a5e5755b43 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:44.502309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaafa78-c0b7-4fbe-a22d-92a5e5755b43 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:44.503682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 754/1482] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:29:44.509417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6139f-2c93-460a-8a7f-d9d7f7d84b0a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:44.509977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6139f-2c93-460a-8a7f-d9d7f7d84b0a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:44.509977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6139f-2c93-460a-8a7f-d9d7f7d84b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:44.590541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-afc6139f-2c93-460a-8a7f-d9d7f7d84b0a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:44.591717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-afc6139f-2c93-460a-8a7f-d9d7f7d84b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:44.643811 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:44.694233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 729/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:44.731944 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaafa78-c0b7-4fbe-a22d-92a5e5755b43 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:44.733493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dbaafa78-c0b7-4fbe-a22d-92a5e5755b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:44.759425 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:44.841859 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaafa78-c0b7-4fbe-a22d-92a5e5755b43 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:44.916776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d210c9-0a59-4281-9d60-566c17e9d461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:44.917435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d210c9-0a59-4281-9d60-566c17e9d461 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:44.917720 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d210c9-0a59-4281-9d60-566c17e9d461 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:44.917999 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d210c9-0a59-4281-9d60-566c17e9d461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:44.919716 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-48d210c9-0a59-4281-9d60-566c17e9d461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:44.997792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:45.034133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d210c9-0a59-4281-9d60-566c17e9d461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:45.035632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d210c9-0a59-4281-9d60-566c17e9d461 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:45.055136 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 755/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:47.171754 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed2524-7ba9-4cd5-98e4-27f577c85f8d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:47.172312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed2524-7ba9-4cd5-98e4-27f577c85f8d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:47.172312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed2524-7ba9-4cd5-98e4-27f577c85f8d None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:47.173690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 730/1485] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:29:47.179539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291accb8-b25e-44fd-afc5-d646ebf74725 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:47.180087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291accb8-b25e-44fd-afc5-d646ebf74725 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:47.180087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291accb8-b25e-44fd-afc5-d646ebf74725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:47.246467 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-291accb8-b25e-44fd-afc5-d646ebf74725 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:47.247730 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-291accb8-b25e-44fd-afc5-d646ebf74725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:47.349634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 756/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:47.388395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed2524-7ba9-4cd5-98e4-27f577c85f8d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:47.389933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8bed2524-7ba9-4cd5-98e4-27f577c85f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:47.501116 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed2524-7ba9-4cd5-98e4-27f577c85f8d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:47.572723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:47.574423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad41e8-cf51-41b3-9940-35bb1beae220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:47.575145 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad41e8-cf51-41b3-9940-35bb1beae220 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:47.575431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad41e8-cf51-41b3-9940-35bb1beae220 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:47.575707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad41e8-cf51-41b3-9940-35bb1beae220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:47.577403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e1ad41e8-cf51-41b3-9940-35bb1beae220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:47.685496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad41e8-cf51-41b3-9940-35bb1beae220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:47.686964 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad41e8-cf51-41b3-9940-35bb1beae220 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:47.706370 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 731/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:49.886436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32853fc7-0cc0-4e39-8d72-691337d55fa8 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:49.887042 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32853fc7-0cc0-4e39-8d72-691337d55fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:49.887042 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32853fc7-0cc0-4e39-8d72-691337d55fa8 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:49.888411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 757/1488] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:29:49.893607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f6eda-aaf1-4ef9-b317-51890432bb27 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:49.894033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f6eda-aaf1-4ef9-b317-51890432bb27 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:49.894252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f6eda-aaf1-4ef9-b317-51890432bb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:49.959399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e98f6eda-aaf1-4ef9-b317-51890432bb27 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:49.960607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e98f6eda-aaf1-4ef9-b317-51890432bb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:50.012950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:50.057265 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 732/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:50.098945 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32853fc7-0cc0-4e39-8d72-691337d55fa8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:50.100534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-32853fc7-0cc0-4e39-8d72-691337d55fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:50.137916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:50.208398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32853fc7-0cc0-4e39-8d72-691337d55fa8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:50.283660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b9092-0675-4536-bb24-bb56afa7b790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:50.284314 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b9092-0675-4536-bb24-bb56afa7b790 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:50.284598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b9092-0675-4536-bb24-bb56afa7b790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:50.284905 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b9092-0675-4536-bb24-bb56afa7b790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:50.286952 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b95b9092-0675-4536-bb24-bb56afa7b790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:50.369238 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:50.400578 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b9092-0675-4536-bb24-bb56afa7b790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:50.402315 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b9092-0675-4536-bb24-bb56afa7b790 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:50.420833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 758/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:53.028078 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd854fa4-60fd-48b7-a472-eb6bc3304a0e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:53.028505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd854fa4-60fd-48b7-a472-eb6bc3304a0e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:53.028624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd854fa4-60fd-48b7-a472-eb6bc3304a0e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:53.030010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 733/1491] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jul 20 19:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:29:53.036034 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50790c9c-daa3-4421-aa5d-52e47bdd712a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:53.036495 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50790c9c-daa3-4421-aa5d-52e47bdd712a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:53.036601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50790c9c-daa3-4421-aa5d-52e47bdd712a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:53.102521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-50790c9c-daa3-4421-aa5d-52e47bdd712a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:53.103734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-50790c9c-daa3-4421-aa5d-52e47bdd712a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:53.200605 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 759/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jul 20 19:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:53.241134 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd854fa4-60fd-48b7-a472-eb6bc3304a0e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:53.242761 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cd854fa4-60fd-48b7-a472-eb6bc3304a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:53.349332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd854fa4-60fd-48b7-a472-eb6bc3304a0e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:53.424257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd26dfa-172d-49a1-867c-86a0b082d75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:53.424907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd26dfa-172d-49a1-867c-86a0b082d75d service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:53.425437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd26dfa-172d-49a1-867c-86a0b082d75d service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:53.425725 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd26dfa-172d-49a1-867c-86a0b082d75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:53.427424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7fd26dfa-172d-49a1-867c-86a0b082d75d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:53.436579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:53.536047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd26dfa-172d-49a1-867c-86a0b082d75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:53.537403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd26dfa-172d-49a1-867c-86a0b082d75d service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:53.555231 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 734/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:03.198665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=82 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:03.552999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=50 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:54.296536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad649d-00bd-48d7-9f2f-15078b38c02c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:54.304368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad649d-00bd-48d7-9f2f-15078b38c02c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:54.304368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad649d-00bd-48d7-9f2f-15078b38c02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:54.389765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5dad649d-00bd-48d7-9f2f-15078b38c02c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:54.391150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5dad649d-00bd-48d7-9f2f-15078b38c02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:54.621967 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 760/1494] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:54.630428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72343afe-8dbb-4654-b159-9d3728e8fe4f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:54.631040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72343afe-8dbb-4654-b159-9d3728e8fe4f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:54.631040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72343afe-8dbb-4654-b159-9d3728e8fe4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:54.651085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-72343afe-8dbb-4654-b159-9d3728e8fe4f None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:54.652291 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-72343afe-8dbb-4654-b159-9d3728e8fe4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:54.661061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 735/1495] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:54.666219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad649d-00bd-48d7-9f2f-15078b38c02c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:54.675819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad649d-00bd-48d7-9f2f-15078b38c02c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:54.680578 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341717e-7b3a-45cc-81ed-0ca6c6dbd5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:54.681224 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341717e-7b3a-45cc-81ed-0ca6c6dbd5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:54.681501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341717e-7b3a-45cc-81ed-0ca6c6dbd5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:54.681772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341717e-7b3a-45cc-81ed-0ca6c6dbd5b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:54.682492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341717e-7b3a-45cc-81ed-0ca6c6dbd5b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:31:54.682832 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341717e-7b3a-45cc-81ed-0ca6c6dbd5b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:54.683854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-0341717e-7b3a-45cc-81ed-0ca6c6dbd5b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:31:54.683854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 20 19:31:54.683854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: Jul 20 19:31:54.684733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341717e-7b3a-45cc-81ed-0ca6c6dbd5b9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:54.696701 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 761/1496] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:31:54.704821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72343afe-8dbb-4654-b159-9d3728e8fe4f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:54.715020 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72343afe-8dbb-4654-b159-9d3728e8fe4f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:54.719566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e5d22-30f1-49ab-839a-0664c2930103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:54.720209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e5d22-30f1-49ab-839a-0664c2930103 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:54.720483 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e5d22-30f1-49ab-839a-0664c2930103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:54.720754 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e5d22-30f1-49ab-839a-0664c2930103 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:54.721441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e5d22-30f1-49ab-839a-0664c2930103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:54.723198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-765e5d22-30f1-49ab-839a-0664c2930103 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:31:54.723198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: warnings.warn(msg) Jul 20 19:31:54.723198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: Jul 20 19:31:54.724403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e5d22-30f1-49ab-839a-0664c2930103 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:54.847624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 736/1497] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:31:54 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:31:54.852585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341717e-7b3a-45cc-81ed-0ca6c6dbd5b9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:54.862612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341717e-7b3a-45cc-81ed-0ca6c6dbd5b9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:54.926957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:54.933747 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c543527-4fed-4bdf-b1bd-b51cd8e13697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:54.934406 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c543527-4fed-4bdf-b1bd-b51cd8e13697 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:54.934696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c543527-4fed-4bdf-b1bd-b51cd8e13697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:54.934980 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c543527-4fed-4bdf-b1bd-b51cd8e13697 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:54.935678 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c543527-4fed-4bdf-b1bd-b51cd8e13697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:54.936698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-9c543527-4fed-4bdf-b1bd-b51cd8e13697 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:31:54.936698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 20 19:31:54.936698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: Jul 20 19:31:54.937880 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c543527-4fed-4bdf-b1bd-b51cd8e13697 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:55.017190 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 762/1498] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:31:54 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:31:55.023553 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e5d22-30f1-49ab-839a-0664c2930103 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:55.034042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e5d22-30f1-49ab-839a-0664c2930103 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:55.039130 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6315ab-46ba-4d8a-a3ac-62bf9b829048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:55.039813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6315ab-46ba-4d8a-a3ac-62bf9b829048 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:55.040132 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6315ab-46ba-4d8a-a3ac-62bf9b829048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:55.040407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6315ab-46ba-4d8a-a3ac-62bf9b829048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:55.041311 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6315ab-46ba-4d8a-a3ac-62bf9b829048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:55.042388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-9f6315ab-46ba-4d8a-a3ac-62bf9b829048 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:31:55.042388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: warnings.warn(msg) Jul 20 19:31:55.042388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: Jul 20 19:31:55.043349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6315ab-46ba-4d8a-a3ac-62bf9b829048 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:55.057322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 737/1499] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:31:55.061380 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c543527-4fed-4bdf-b1bd-b51cd8e13697 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:55.072395 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c543527-4fed-4bdf-b1bd-b51cd8e13697 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:55.079521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d561b4a-8aa7-4616-84cc-bbd35e92c1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:55.079521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d561b4a-8aa7-4616-84cc-bbd35e92c1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:55.079521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d561b4a-8aa7-4616-84cc-bbd35e92c1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:55.079521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d561b4a-8aa7-4616-84cc-bbd35e92c1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:55.079993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d561b4a-8aa7-4616-84cc-bbd35e92c1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:55.079993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-3d561b4a-8aa7-4616-84cc-bbd35e92c1f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:31:55.079993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 20 19:31:55.079993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: Jul 20 19:31:55.080774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d561b4a-8aa7-4616-84cc-bbd35e92c1f3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:55.094738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 763/1500] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:31:55.099023 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6315ab-46ba-4d8a-a3ac-62bf9b829048 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:55.109533 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6315ab-46ba-4d8a-a3ac-62bf9b829048 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:55.114598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a7ab4-c660-4741-a4a0-ff7bb9b72535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:55.115590 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a7ab4-c660-4741-a4a0-ff7bb9b72535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:55.115867 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a7ab4-c660-4741-a4a0-ff7bb9b72535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:55.116174 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a7ab4-c660-4741-a4a0-ff7bb9b72535 admin admin] PATH_INFO: `/v3/projects/3ffc69a3cd0f4a4681162b38d9aa7084/users/3987b8a7a6904527abcf1aa78998e6d5/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:55.132596 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a7ab4-c660-4741-a4a0-ff7bb9b72535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffc69a3cd0f4a4681162b38d9aa7084, user_id=3987b8a7a6904527abcf1aa78998e6d5, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:55.133638 dv-cinder-835384-16-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-ca1a7ab4-c660-4741-a4a0-ff7bb9b72535 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:31:55.133638 dv-cinder-835384-16-smb devstack@keystone.service[80399]: warnings.warn(msg) Jul 20 19:31:55.133638 dv-cinder-835384-16-smb devstack@keystone.service[80399]: Jul 20 19:31:55.135608 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a7ab4-c660-4741-a4a0-ff7bb9b72535 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:55.205689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 738/1501] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:31:55 2022] PUT /identity/v3/projects/3ffc69a3cd0f4a4681162b38d9aa7084/users/3987b8a7a6904527abcf1aa78998e6d5/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:55.218574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f167b-8001-40a6-b725-6813d08e6b48 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:55.218900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f167b-8001-40a6-b725-6813d08e6b48 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:55.219173 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f167b-8001-40a6-b725-6813d08e6b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:55.246933 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-272f167b-8001-40a6-b725-6813d08e6b48 None None] MFA Rules not processed for user `3987b8a7a6904527abcf1aa78998e6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:55.248194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-272f167b-8001-40a6-b725-6813d08e6b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:55.321715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 764/1502] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:31:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:55.335694 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a46c-b0b9-474a-a551-03bcb4fe57f7 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:55.335983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a46c-b0b9-474a-a551-03bcb4fe57f7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:55.336259 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a46c-b0b9-474a-a551-03bcb4fe57f7 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:55.337635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 739/1503] 10.222.0.16 () {54 vars in 964 bytes} [Wed Jul 20 19:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:31:55.342566 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cc5c8-d1f0-4974-8190-91c4faaeae14 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:55.342885 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cc5c8-d1f0-4974-8190-91c4faaeae14 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:55.343164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cc5c8-d1f0-4974-8190-91c4faaeae14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:55.403358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-237cc5c8-d1f0-4974-8190-91c4faaeae14 None None] MFA Rules not processed for user `f2fcf925f9ec45b3b2cbea7e6acc0522`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:55.404658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-237cc5c8-d1f0-4974-8190-91c4faaeae14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:55.480404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 765/1504] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Jul 20 19:31:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:55.488057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5a46c-b0b9-474a-a551-03bcb4fe57f7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:55.499121 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5a46c-b0b9-474a-a551-03bcb4fe57f7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:55.502821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a72e6-a74e-4249-b77a-e554be428bad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:55.503463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a72e6-a74e-4249-b77a-e554be428bad service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:55.503737 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a72e6-a74e-4249-b77a-e554be428bad service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:55.504006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a72e6-a74e-4249-b77a-e554be428bad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:55.513122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a72e6-a74e-4249-b77a-e554be428bad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:55.514578 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a72e6-a74e-4249-b77a-e554be428bad service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:55.523427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 740/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:55.565501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faabc1-b585-4905-beb7-e969bac86c10 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:55.565790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faabc1-b585-4905-beb7-e969bac86c10 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:55.566065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faabc1-b585-4905-beb7-e969bac86c10 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:55.567663 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 766/1506] 10.222.0.16 () {52 vars in 829 bytes} [Wed Jul 20 19:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:31:55.571976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a72e6-a74e-4249-b77a-e554be428bad service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:55.633133 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a72e6-a74e-4249-b77a-e554be428bad service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:55.637863 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d8e86-d1c3-4cc5-b309-ec76723321f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:55.638765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d8e86-d1c3-4cc5-b309-ec76723321f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:55.639057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d8e86-d1c3-4cc5-b309-ec76723321f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:55.639330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d8e86-d1c3-4cc5-b309-ec76723321f4 admin admin] PATH_INFO: `/v3/users/3987b8a7a6904527abcf1aa78998e6d5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:55.640533 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d8e86-d1c3-4cc5-b309-ec76723321f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3987b8a7a6904527abcf1aa78998e6d5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:55.641556 dv-cinder-835384-16-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-c69d8e86-d1c3-4cc5-b309-ec76723321f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:31:55.641556 dv-cinder-835384-16-smb devstack@keystone.service[80399]: warnings.warn(msg) Jul 20 19:31:55.641556 dv-cinder-835384-16-smb devstack@keystone.service[80399]: Jul 20 19:31:55.642777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d8e86-d1c3-4cc5-b309-ec76723321f4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:55.847466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c69d8e86-d1c3-4cc5-b309-ec76723321f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3987b8a7a6904527abcf1aa78998e6d5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:55.924413 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c69d8e86-d1c3-4cc5-b309-ec76723321f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3987b8a7a6904527abcf1aa78998e6d5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:55.925055 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c69d8e86-d1c3-4cc5-b309-ec76723321f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3987b8a7a6904527abcf1aa78998e6d5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:55.944981 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c69d8e86-d1c3-4cc5-b309-ec76723321f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3987b8a7a6904527abcf1aa78998e6d5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:55.953312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:55.964848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c69d8e86-d1c3-4cc5-b309-ec76723321f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3987b8a7a6904527abcf1aa78998e6d5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:55.964848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 741/1507] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:31:55 2022] DELETE /identity/v3/users/3987b8a7a6904527abcf1aa78998e6d5 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:55.968714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53ecc5-78c7-494c-bb4c-610d0abe4cf9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:55.969080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53ecc5-78c7-494c-bb4c-610d0abe4cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:55.969362 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53ecc5-78c7-494c-bb4c-610d0abe4cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:55.989639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7b53ecc5-78c7-494c-bb4c-610d0abe4cf9 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:55.991501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7b53ecc5-78c7-494c-bb4c-610d0abe4cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:56.001311 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:56.051739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 767/1508] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:56.061493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d8e86-d1c3-4cc5-b309-ec76723321f4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:56.062953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c69d8e86-d1c3-4cc5-b309-ec76723321f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:56.143813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d8e86-d1c3-4cc5-b309-ec76723321f4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:56.147988 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f5321-6e70-4b1d-bec6-8b161b935eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:56.151564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f5321-6e70-4b1d-bec6-8b161b935eba service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:56.151564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f5321-6e70-4b1d-bec6-8b161b935eba service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:56.151564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f5321-6e70-4b1d-bec6-8b161b935eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:56.159555 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f5321-6e70-4b1d-bec6-8b161b935eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:56.160988 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f5321-6e70-4b1d-bec6-8b161b935eba service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:56.173945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 742/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:56.645913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53ecc5-78c7-494c-bb4c-610d0abe4cf9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:56.648341 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7b53ecc5-78c7-494c-bb4c-610d0abe4cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:56.660768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53ecc5-78c7-494c-bb4c-610d0abe4cf9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:56.665484 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:56.666346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:56.666629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:56.666936 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d admin admin] PATH_INFO: `/v3/projects/3ffc69a3cd0f4a4681162b38d9aa7084` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:56.668124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ffc69a3cd0f4a4681162b38d9aa7084)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:56.669159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:31:56.669159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 20 19:31:56.669159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: Jul 20 19:31:56.670352 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:56.821890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ffc69a3cd0f4a4681162b38d9aa7084', 'request_id': 'req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:56.836129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ffc69a3cd0f4a4681162b38d9aa7084', 'request_id': 'req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:56.907907 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ffc69a3cd0f4a4681162b38d9aa7084', 'request_id': 'req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:56.920483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d admin admin] The token cache is being invalidate because project 3ffc69a3cd0f4a4681162b38d9aa7084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:31:56.920761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:56.921486 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0ca4bffe-ff5e-4b0f-b070-a1d5cd9b130d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:56.931385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 768/1510] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:31:56 2022] DELETE /identity/v3/projects/3ffc69a3cd0f4a4681162b38d9aa7084 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:06.174332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=38 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:06.917430 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:44.567948 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d45b13-4fc0-4ea3-87a6-d93b83f1f0d6 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:44.568519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d45b13-4fc0-4ea3-87a6-d93b83f1f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:44.568519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d45b13-4fc0-4ea3-87a6-d93b83f1f0d6 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:44.569802 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 743/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:33:44.574786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8fe03-ec20-4a22-bd62-4e1427a9d676 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:44.575245 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8fe03-ec20-4a22-bd62-4e1427a9d676 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:44.575353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8fe03-ec20-4a22-bd62-4e1427a9d676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:44.593507 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-10b8fe03-ec20-4a22-bd62-4e1427a9d676 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:44.594730 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-10b8fe03-ec20-4a22-bd62-4e1427a9d676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:44.653921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 769/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:44.812538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d45b13-4fc0-4ea3-87a6-d93b83f1f0d6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:44.814276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-74d45b13-4fc0-4ea3-87a6-d93b83f1f0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:44.916163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d45b13-4fc0-4ea3-87a6-d93b83f1f0d6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:44.922566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8fde6-9e54-4b9a-ab50-cccf97520d1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:44.923242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8fde6-9e54-4b9a-ab50-cccf97520d1c service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:44.923525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8fde6-9e54-4b9a-ab50-cccf97520d1c service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:44.923799 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8fde6-9e54-4b9a-ab50-cccf97520d1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:44.932353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8fde6-9e54-4b9a-ab50-cccf97520d1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:44.933941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8fde6-9e54-4b9a-ab50-cccf97520d1c service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:44.943486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 744/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:45.790686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01c7ba-97a8-4fba-9520-4568b3b64862 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:45.791262 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01c7ba-97a8-4fba-9520-4568b3b64862 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:45.791262 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01c7ba-97a8-4fba-9520-4568b3b64862 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:45.792666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 770/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:33:45.798103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79823ee-765e-4c68-9811-ef4aff9d4f02 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:45.798531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79823ee-765e-4c68-9811-ef4aff9d4f02 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:45.798640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79823ee-765e-4c68-9811-ef4aff9d4f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:45.817461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e79823ee-765e-4c68-9811-ef4aff9d4f02 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:45.818656 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e79823ee-765e-4c68-9811-ef4aff9d4f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:45.826450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 745/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:45.980358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01c7ba-97a8-4fba-9520-4568b3b64862 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:45.996236 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01c7ba-97a8-4fba-9520-4568b3b64862 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:46.002300 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b51a5-a21b-4d6e-94b6-f3d3d316fd80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:46.002975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b51a5-a21b-4d6e-94b6-f3d3d316fd80 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:46.003256 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b51a5-a21b-4d6e-94b6-f3d3d316fd80 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:46.003530 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b51a5-a21b-4d6e-94b6-f3d3d316fd80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:46.012109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b51a5-a21b-4d6e-94b6-f3d3d316fd80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:46.013705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b51a5-a21b-4d6e-94b6-f3d3d316fd80 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:46.023510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 771/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:46.133260 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e791f8-d0ff-4a40-8e11-368bebb46a5d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:46.133660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e791f8-d0ff-4a40-8e11-368bebb46a5d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:46.134002 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e791f8-d0ff-4a40-8e11-368bebb46a5d None None] PATH_INFO: `/v3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:46.135488 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 746/1517] 10.222.0.91 () {54 vars in 925 bytes} [Wed Jul 20 19:33:46 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:33:46.142253 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1effc30-0ff2-4bb2-abb2-56749bb63035 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:46.142535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1effc30-0ff2-4bb2-abb2-56749bb63035 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:46.142843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1effc30-0ff2-4bb2-abb2-56749bb63035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:46.193819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d1effc30-0ff2-4bb2-abb2-56749bb63035 None None] MFA Rules not processed for user `dbc616ed904d43d2b160b8d2766f7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:46.195073 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d1effc30-0ff2-4bb2-abb2-56749bb63035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:46.267058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 772/1518] 10.222.0.91 () {58 vars in 1015 bytes} [Wed Jul 20 19:33:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:33:55.501791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2316c-e648-439c-9dfa-398df6ddbf39 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:55.502343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2316c-e648-439c-9dfa-398df6ddbf39 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:55.502343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2316c-e648-439c-9dfa-398df6ddbf39 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:55.503673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 747/1519] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jul 20 19:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:33:55.508797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1eb74-79fe-4c17-be98-5b98509aa4db None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:55.509258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1eb74-79fe-4c17-be98-5b98509aa4db None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:55.509367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1eb74-79fe-4c17-be98-5b98509aa4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:55.527948 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3da1eb74-79fe-4c17-be98-5b98509aa4db None None] MFA Rules not processed for user `dbc616ed904d43d2b160b8d2766f7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:55.529148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3da1eb74-79fe-4c17-be98-5b98509aa4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:55.538410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 773/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jul 20 19:33:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:55.546357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2316c-e648-439c-9dfa-398df6ddbf39 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:55.559909 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2316c-e648-439c-9dfa-398df6ddbf39 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:55.566526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d41d92-326e-4ff1-a7e1-99b4a3566bc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc616ed904d43d2b160b8d2766f7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:55.567192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d41d92-326e-4ff1-a7e1-99b4a3566bc6 service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:55.567467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d41d92-326e-4ff1-a7e1-99b4a3566bc6 service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:55.567736 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d41d92-326e-4ff1-a7e1-99b4a3566bc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:55.576341 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d41d92-326e-4ff1-a7e1-99b4a3566bc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:55.578440 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d41d92-326e-4ff1-a7e1-99b4a3566bc6 service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:55.588035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 748/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:57.306038 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c8fa6-996d-4ca5-9106-5368445a0a3f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:57.306544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c8fa6-996d-4ca5-9106-5368445a0a3f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:57.306639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c8fa6-996d-4ca5-9106-5368445a0a3f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:57.308280 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 774/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:33:57.313637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf666f-71e4-4b62-a8e6-28d3256d1042 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:57.314067 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf666f-71e4-4b62-a8e6-28d3256d1042 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:57.314172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf666f-71e4-4b62-a8e6-28d3256d1042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:57.333986 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6caf666f-71e4-4b62-a8e6-28d3256d1042 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:57.335228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6caf666f-71e4-4b62-a8e6-28d3256d1042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:57.343141 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 749/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:57.506718 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c8fa6-996d-4ca5-9106-5368445a0a3f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:57.533026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c8fa6-996d-4ca5-9106-5368445a0a3f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:57.538512 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8f112-a2c9-4e17-bb81-7ae97e73c540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:57.543595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8f112-a2c9-4e17-bb81-7ae97e73c540 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:57.543595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8f112-a2c9-4e17-bb81-7ae97e73c540 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:57.543595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8f112-a2c9-4e17-bb81-7ae97e73c540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:57.548474 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8f112-a2c9-4e17-bb81-7ae97e73c540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:57.550117 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8f112-a2c9-4e17-bb81-7ae97e73c540 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:57.559842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 775/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:58.385329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224c7fe-cb3f-4e04-804d-265baf84ca52 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:58.457371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224c7fe-cb3f-4e04-804d-265baf84ca52 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:58.457371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224c7fe-cb3f-4e04-804d-265baf84ca52 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:58.457371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 750/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:33:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:33:58.458364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f831-1c07-4287-b025-791994a8b550 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:58.458364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f831-1c07-4287-b025-791994a8b550 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:58.458364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f831-1c07-4287-b025-791994a8b550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:58.458364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6a67f831-1c07-4287-b025-791994a8b550 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:58.458364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6a67f831-1c07-4287-b025-791994a8b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:58.458364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 776/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:58.578565 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224c7fe-cb3f-4e04-804d-265baf84ca52 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:58.592632 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224c7fe-cb3f-4e04-804d-265baf84ca52 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:58.597993 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06bbf1-2e0c-4fa7-821a-77ca89e033a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:58.598623 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06bbf1-2e0c-4fa7-821a-77ca89e033a2 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:58.598926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06bbf1-2e0c-4fa7-821a-77ca89e033a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:58.599198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06bbf1-2e0c-4fa7-821a-77ca89e033a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:58.607365 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06bbf1-2e0c-4fa7-821a-77ca89e033a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:58.609540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06bbf1-2e0c-4fa7-821a-77ca89e033a2 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:58.618909 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 751/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:02.703263 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27301a9c-3f2c-4529-99af-ff29d10faa5c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:02.703865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27301a9c-3f2c-4529-99af-ff29d10faa5c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:02.703865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27301a9c-3f2c-4529-99af-ff29d10faa5c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:02.705200 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 777/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:34:02.710606 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9bb60-ed53-45ec-87dc-ced9747a1849 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:02.711070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9bb60-ed53-45ec-87dc-ced9747a1849 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:02.711174 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9bb60-ed53-45ec-87dc-ced9747a1849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:02.730045 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f9f9bb60-ed53-45ec-87dc-ced9747a1849 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:02.731339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f9f9bb60-ed53-45ec-87dc-ced9747a1849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:02.739894 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 752/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:34:02.814963 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27301a9c-3f2c-4529-99af-ff29d10faa5c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:02.816659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-27301a9c-3f2c-4529-99af-ff29d10faa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:02.845231 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:02.875722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27301a9c-3f2c-4529-99af-ff29d10faa5c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:02.879303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693889f4-0298-43de-9ea7-5b8907c8ef40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:02.880032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693889f4-0298-43de-9ea7-5b8907c8ef40 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:02.880545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693889f4-0298-43de-9ea7-5b8907c8ef40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:02.881053 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693889f4-0298-43de-9ea7-5b8907c8ef40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:02.890954 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693889f4-0298-43de-9ea7-5b8907c8ef40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:02.892403 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693889f4-0298-43de-9ea7-5b8907c8ef40 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:02.901937 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 778/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:04.953097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53374d0c-b756-43ee-982f-293c807686f7 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:04.953671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53374d0c-b756-43ee-982f-293c807686f7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:04.953671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53374d0c-b756-43ee-982f-293c807686f7 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:04.955067 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 753/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:34:04.960524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ca4b9-ab18-4207-9acb-c53246bb792a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:04.960940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ca4b9-ab18-4207-9acb-c53246bb792a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:04.961071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ca4b9-ab18-4207-9acb-c53246bb792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:04.979560 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c21ca4b9-ab18-4207-9acb-c53246bb792a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:04.980743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c21ca4b9-ab18-4207-9acb-c53246bb792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:04.989527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 779/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:05.026007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53374d0c-b756-43ee-982f-293c807686f7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:05.037453 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53374d0c-b756-43ee-982f-293c807686f7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:05.041001 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96509370-8519-40f2-ae33-455e523c7a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:05.042203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96509370-8519-40f2-ae33-455e523c7a3b service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:05.042203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96509370-8519-40f2-ae33-455e523c7a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:05.042203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96509370-8519-40f2-ae33-455e523c7a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:05.052265 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96509370-8519-40f2-ae33-455e523c7a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:05.053735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96509370-8519-40f2-ae33-455e523c7a3b service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:05.064271 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 754/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:34:08.803686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1b892-283c-42f2-b152-7fbb78cb2a2e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:08.804265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1b892-283c-42f2-b152-7fbb78cb2a2e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:08.804265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1b892-283c-42f2-b152-7fbb78cb2a2e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:08.805651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 780/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:34:08.811633 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff9a79-a992-4fd8-9c47-c1ca9ddece3f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:08.812071 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff9a79-a992-4fd8-9c47-c1ca9ddece3f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:08.812191 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff9a79-a992-4fd8-9c47-c1ca9ddece3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:08.818535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=74 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:08.831026 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-97ff9a79-a992-4fd8-9c47-c1ca9ddece3f None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:08.832232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-97ff9a79-a992-4fd8-9c47-c1ca9ddece3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:08.840154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 755/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:09.152192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1b892-283c-42f2-b152-7fbb78cb2a2e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:09.154071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dcf1b892-283c-42f2-b152-7fbb78cb2a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:09.215289 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1b892-283c-42f2-b152-7fbb78cb2a2e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:09.219140 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a41e9-b6b3-460b-9bef-04175bb18c75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:09.219791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a41e9-b6b3-460b-9bef-04175bb18c75 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:09.220071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a41e9-b6b3-460b-9bef-04175bb18c75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:09.220344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a41e9-b6b3-460b-9bef-04175bb18c75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:09.229979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a41e9-b6b3-460b-9bef-04175bb18c75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:09.232047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a41e9-b6b3-460b-9bef-04175bb18c75 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:09.241924 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 781/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:11.365230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8974af6-800a-4556-97fc-00a1ff1e4dd8 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:11.365793 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8974af6-800a-4556-97fc-00a1ff1e4dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:11.365793 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8974af6-800a-4556-97fc-00a1ff1e4dd8 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:11.367188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 756/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:34:11.372768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0ba6-f6ec-47f2-bd85-0d061cb47660 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:11.373270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0ba6-f6ec-47f2-bd85-0d061cb47660 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:11.373373 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0ba6-f6ec-47f2-bd85-0d061cb47660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:11.391979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-acdb0ba6-f6ec-47f2-bd85-0d061cb47660 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:11.393217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-acdb0ba6-f6ec-47f2-bd85-0d061cb47660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:11.401343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 782/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:11.726896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8974af6-800a-4556-97fc-00a1ff1e4dd8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:11.728646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e8974af6-800a-4556-97fc-00a1ff1e4dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:11.742475 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8974af6-800a-4556-97fc-00a1ff1e4dd8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:11.746066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0150e7-1132-4f56-9c85-b500213e33dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:11.747293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0150e7-1132-4f56-9c85-b500213e33dd service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:11.747568 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0150e7-1132-4f56-9c85-b500213e33dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:11.747836 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0150e7-1132-4f56-9c85-b500213e33dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:11.757631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0150e7-1132-4f56-9c85-b500213e33dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:11.759037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0150e7-1132-4f56-9c85-b500213e33dd service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:11.769886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 757/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:21.386003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=47 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:21.765557 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=8 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:45.133199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65a0ce-2f88-47ab-860a-154c051e9d70 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.134512 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65a0ce-2f88-47ab-860a-154c051e9d70 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.134512 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65a0ce-2f88-47ab-860a-154c051e9d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.164166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8a65a0ce-2f88-47ab-860a-154c051e9d70 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.165416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8a65a0ce-2f88-47ab-860a-154c051e9d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.177799 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 783/1540] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:45.187831 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e254ee-f8b0-4171-aefc-9ec08bf40f94 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.188425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e254ee-f8b0-4171-aefc-9ec08bf40f94 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.188425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e254ee-f8b0-4171-aefc-9ec08bf40f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.217379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c0e254ee-f8b0-4171-aefc-9ec08bf40f94 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.218919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c0e254ee-f8b0-4171-aefc-9ec08bf40f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.233394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 758/1541] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:45.240721 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65a0ce-2f88-47ab-860a-154c051e9d70 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:45.245244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43040b89-4d12-4c4e-8777-979d5f890e2b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.245730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43040b89-4d12-4c4e-8777-979d5f890e2b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.246018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43040b89-4d12-4c4e-8777-979d5f890e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.257517 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65a0ce-2f88-47ab-860a-154c051e9d70 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:45.271434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4508d-741b-4ba6-9169-2a04fc73fe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:45.272424 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4508d-741b-4ba6-9169-2a04fc73fe4c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.273124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4508d-741b-4ba6-9169-2a04fc73fe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.273585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4508d-741b-4ba6-9169-2a04fc73fe4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.274490 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4508d-741b-4ba6-9169-2a04fc73fe4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:35:45.275005 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4508d-741b-4ba6-9169-2a04fc73fe4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:45.277691 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4508d-741b-4ba6-9169-2a04fc73fe4c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:45.284240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-43040b89-4d12-4c4e-8777-979d5f890e2b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.290701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-43040b89-4d12-4c4e-8777-979d5f890e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.302977 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 784/1542] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:35:45.310726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 759/1543] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:35:45.312796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4508d-741b-4ba6-9169-2a04fc73fe4c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:45.320558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ef5ca-ccdb-4516-a627-2d4ecf7efebe None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.321338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ef5ca-ccdb-4516-a627-2d4ecf7efebe None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.321776 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ef5ca-ccdb-4516-a627-2d4ecf7efebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.329348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4508d-741b-4ba6-9169-2a04fc73fe4c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:45.341990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07517eb-f18d-4175-8ff2-9c110fb49cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:45.342700 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07517eb-f18d-4175-8ff2-9c110fb49cbb admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.343002 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07517eb-f18d-4175-8ff2-9c110fb49cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.343276 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07517eb-f18d-4175-8ff2-9c110fb49cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.343984 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07517eb-f18d-4175-8ff2-9c110fb49cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:45.345032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-e07517eb-f18d-4175-8ff2-9c110fb49cbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:35:45.345032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 20 19:35:45.345032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: Jul 20 19:35:45.346232 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07517eb-f18d-4175-8ff2-9c110fb49cbb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:45.359046 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4d3ef5ca-ccdb-4516-a627-2d4ecf7efebe None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.361211 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4d3ef5ca-ccdb-4516-a627-2d4ecf7efebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.381756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 760/1544] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:35:45.389290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206acc6d-fb98-426d-bcc1-b3073bb791d5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.389290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206acc6d-fb98-426d-bcc1-b3073bb791d5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.389290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206acc6d-fb98-426d-bcc1-b3073bb791d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.413224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-206acc6d-fb98-426d-bcc1-b3073bb791d5 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.415022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-206acc6d-fb98-426d-bcc1-b3073bb791d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.431900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 761/1545] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:45.433051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206acc6d-fb98-426d-bcc1-b3073bb791d5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:45.448613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206acc6d-fb98-426d-bcc1-b3073bb791d5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:45.456971 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f77220-4c14-4e8d-8195-669914114515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:45.460332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f77220-4c14-4e8d-8195-669914114515 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.460332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f77220-4c14-4e8d-8195-669914114515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.460332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f77220-4c14-4e8d-8195-669914114515 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.460332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f77220-4c14-4e8d-8195-669914114515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:35:45.460332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f77220-4c14-4e8d-8195-669914114515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:45.461265 dv-cinder-835384-16-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-d6f77220-4c14-4e8d-8195-669914114515 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:35:45.461265 dv-cinder-835384-16-smb devstack@keystone.service[80399]: warnings.warn(msg) Jul 20 19:35:45.461265 dv-cinder-835384-16-smb devstack@keystone.service[80399]: Jul 20 19:35:45.463752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f77220-4c14-4e8d-8195-669914114515 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:45.469806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 785/1546] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:45.471796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b59060-faac-472e-b3b0-c6bc0cdd463b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.472257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b59060-faac-472e-b3b0-c6bc0cdd463b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.472680 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b59060-faac-472e-b3b0-c6bc0cdd463b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.489041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 762/1547] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:35:45.490596 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b588cf-6d29-49e2-8e75-cbda5972999c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.491092 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b588cf-6d29-49e2-8e75-cbda5972999c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.491525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b588cf-6d29-49e2-8e75-cbda5972999c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.522216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a8b59060-faac-472e-b3b0-c6bc0cdd463b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.523330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f9b588cf-6d29-49e2-8e75-cbda5972999c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.524067 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a8b59060-faac-472e-b3b0-c6bc0cdd463b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.525491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f9b588cf-6d29-49e2-8e75-cbda5972999c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.611078 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 786/1548] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:45.611974 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b59060-faac-472e-b3b0-c6bc0cdd463b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:45.612601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 763/1549] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:45.614139 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ff867-ec26-4fc9-b0d2-4f02107544fb None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.614537 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ff867-ec26-4fc9-b0d2-4f02107544fb None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.615015 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ff867-ec26-4fc9-b0d2-4f02107544fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.623250 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b59060-faac-472e-b3b0-c6bc0cdd463b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:45.629063 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855425-9bc6-4c02-b064-19bca1a54aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:45.629741 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855425-9bc6-4c02-b064-19bca1a54aff admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.630024 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855425-9bc6-4c02-b064-19bca1a54aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.630491 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855425-9bc6-4c02-b064-19bca1a54aff admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.631232 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d855425-9bc6-4c02-b064-19bca1a54aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:45.633182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d855425-9bc6-4c02-b064-19bca1a54aff admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:45.638635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ee9ff867-ec26-4fc9-b0d2-4f02107544fb None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.639902 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ee9ff867-ec26-4fc9-b0d2-4f02107544fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.648840 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 764/1550] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:45.650168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d49e2-f7f5-4a31-8b0b-dade50542363 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.654923 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d49e2-f7f5-4a31-8b0b-dade50542363 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.654923 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d49e2-f7f5-4a31-8b0b-dade50542363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.671940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-cb4d49e2-f7f5-4a31-8b0b-dade50542363 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.673170 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cb4d49e2-f7f5-4a31-8b0b-dade50542363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.681349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 765/1551] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:45.683617 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d49e2-f7f5-4a31-8b0b-dade50542363 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:45.692377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d49e2-f7f5-4a31-8b0b-dade50542363 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:45.697119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5921707-f3ae-4b66-a272-10afd41b9ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:45.698404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5921707-f3ae-4b66-a272-10afd41b9ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.698696 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5921707-f3ae-4b66-a272-10afd41b9ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.699353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5921707-f3ae-4b66-a272-10afd41b9ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.699924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5921707-f3ae-4b66-a272-10afd41b9ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:45.701917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5921707-f3ae-4b66-a272-10afd41b9ab2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:45.730133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 787/1552] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:45.731491 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938bd1a-f752-4a88-8dd1-63ca7045cb76 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.731769 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938bd1a-f752-4a88-8dd1-63ca7045cb76 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.732058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938bd1a-f752-4a88-8dd1-63ca7045cb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.751399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9938bd1a-f752-4a88-8dd1-63ca7045cb76 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.752635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9938bd1a-f752-4a88-8dd1-63ca7045cb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.761417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 788/1553] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:45.762568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0494639-1694-4728-bb58-f3e5ad7a3099 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.762869 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0494639-1694-4728-bb58-f3e5ad7a3099 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.763158 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0494639-1694-4728-bb58-f3e5ad7a3099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.781796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b0494639-1694-4728-bb58-f3e5ad7a3099 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.783013 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b0494639-1694-4728-bb58-f3e5ad7a3099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.789438 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 766/1554] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:45.790954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352df618-774e-45ab-b1fd-318d8ff2ca1c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.791192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 789/1555] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:45.791975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352df618-774e-45ab-b1fd-318d8ff2ca1c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.792263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352df618-774e-45ab-b1fd-318d8ff2ca1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.792819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0494639-1694-4728-bb58-f3e5ad7a3099 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:45.810449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0494639-1694-4728-bb58-f3e5ad7a3099 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:45.811581 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-352df618-774e-45ab-b1fd-318d8ff2ca1c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.812779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-352df618-774e-45ab-b1fd-318d8ff2ca1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.872426 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177bc89-7cd8-4ae6-a734-c0d0c4a5c052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:45.873130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177bc89-7cd8-4ae6-a734-c0d0c4a5c052 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.873404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177bc89-7cd8-4ae6-a734-c0d0c4a5c052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.873673 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177bc89-7cd8-4ae6-a734-c0d0c4a5c052 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.874390 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177bc89-7cd8-4ae6-a734-c0d0c4a5c052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:35:45.874717 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177bc89-7cd8-4ae6-a734-c0d0c4a5c052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:45.876546 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177bc89-7cd8-4ae6-a734-c0d0c4a5c052 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:45.883477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 767/1556] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:45.884635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d6612-af0c-452c-827b-e5d3308f439e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.885560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d6612-af0c-452c-827b-e5d3308f439e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.885897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d6612-af0c-452c-827b-e5d3308f439e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.893505 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 790/1557] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:35:45.895068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7c83b-e5a4-406c-afa5-ae2388149424 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.895358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7c83b-e5a4-406c-afa5-ae2388149424 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.895638 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7c83b-e5a4-406c-afa5-ae2388149424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.905581 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-140d6612-af0c-452c-827b-e5d3308f439e None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.907026 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-140d6612-af0c-452c-827b-e5d3308f439e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.915789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 768/1558] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:45.917263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d6612-af0c-452c-827b-e5d3308f439e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:45.917385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a9a7c83b-e5a4-406c-afa5-ae2388149424 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.919020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a9a7c83b-e5a4-406c-afa5-ae2388149424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.927413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 791/1559] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:45.927716 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d6612-af0c-452c-827b-e5d3308f439e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:45.928828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eff35f-5a24-4424-b935-5bd1314d42f9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.929110 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eff35f-5a24-4424-b935-5bd1314d42f9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.929349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eff35f-5a24-4424-b935-5bd1314d42f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.934369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1e02e-f4ff-4cf3-a65d-96a14b06c74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:45.935084 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1e02e-f4ff-4cf3-a65d-96a14b06c74d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.935439 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1e02e-f4ff-4cf3-a65d-96a14b06c74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.935639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1e02e-f4ff-4cf3-a65d-96a14b06c74d admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.936376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1e02e-f4ff-4cf3-a65d-96a14b06c74d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:45.938009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1e02e-f4ff-4cf3-a65d-96a14b06c74d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:45.948585 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 769/1560] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:45.949399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1e02e-f4ff-4cf3-a65d-96a14b06c74d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:45.949789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-04eff35f-5a24-4424-b935-5bd1314d42f9 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.951008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-04eff35f-5a24-4424-b935-5bd1314d42f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.958867 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 792/1561] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:45.962756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1e02e-f4ff-4cf3-a65d-96a14b06c74d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:45.962887 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e838d15-03a1-466d-8cec-b7d5abcda324 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.962887 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e838d15-03a1-466d-8cec-b7d5abcda324 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.962887 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e838d15-03a1-466d-8cec-b7d5abcda324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.965022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f2ed0-3a7d-4354-aad6-8da9de17bf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:45.965683 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f2ed0-3a7d-4354-aad6-8da9de17bf46 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:45.965964 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f2ed0-3a7d-4354-aad6-8da9de17bf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:45.966239 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f2ed0-3a7d-4354-aad6-8da9de17bf46 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:45.966961 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f2ed0-3a7d-4354-aad6-8da9de17bf46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:45.967979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-ed0f2ed0-3a7d-4354-aad6-8da9de17bf46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:35:45.967979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: warnings.warn(msg) Jul 20 19:35:45.967979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: Jul 20 19:35:45.969187 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f2ed0-3a7d-4354-aad6-8da9de17bf46 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:45.976986 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:45.981193 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5e838d15-03a1-466d-8cec-b7d5abcda324 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:45.982666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5e838d15-03a1-466d-8cec-b7d5abcda324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:45.991228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 793/1562] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:45.992046 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e838d15-03a1-466d-8cec-b7d5abcda324 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:45.997442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:46.002385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e838d15-03a1-466d-8cec-b7d5abcda324 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.007101 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe07d6-e666-4390-902c-31468257e565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.007744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe07d6-e666-4390-902c-31468257e565 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.008024 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe07d6-e666-4390-902c-31468257e565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.008297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe07d6-e666-4390-902c-31468257e565 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.009014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe07d6-e666-4390-902c-31468257e565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:35:46.009316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe07d6-e666-4390-902c-31468257e565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.011632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe07d6-e666-4390-902c-31468257e565 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:46.023676 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 794/1563] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:35:46.031617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe07d6-e666-4390-902c-31468257e565 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.035350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe07d6-e666-4390-902c-31468257e565 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.041008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afe6ac-51b7-487d-9f73-10c80eb2ca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.041821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afe6ac-51b7-487d-9f73-10c80eb2ca81 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.042106 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afe6ac-51b7-487d-9f73-10c80eb2ca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.042377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afe6ac-51b7-487d-9f73-10c80eb2ca81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.043116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afe6ac-51b7-487d-9f73-10c80eb2ca81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.045075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afe6ac-51b7-487d-9f73-10c80eb2ca81 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:46.110074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 770/1564] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:35:45 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:46.113379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f2ed0-3a7d-4354-aad6-8da9de17bf46 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.120870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f2ed0-3a7d-4354-aad6-8da9de17bf46 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.125605 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873004e7-36b7-40e7-829c-2e4f472309b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.126256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873004e7-36b7-40e7-829c-2e4f472309b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.126539 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873004e7-36b7-40e7-829c-2e4f472309b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.126845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873004e7-36b7-40e7-829c-2e4f472309b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.127564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873004e7-36b7-40e7-829c-2e4f472309b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:35:46.127867 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873004e7-36b7-40e7-829c-2e4f472309b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.129459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873004e7-36b7-40e7-829c-2e4f472309b6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:46.145966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 771/1565] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:35:46.145966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873004e7-36b7-40e7-829c-2e4f472309b6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.156764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873004e7-36b7-40e7-829c-2e4f472309b6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.166330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8362bd-1835-4c53-9190-ad36e1d0262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.167530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8362bd-1835-4c53-9190-ad36e1d0262d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.168012 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8362bd-1835-4c53-9190-ad36e1d0262d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.168564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8362bd-1835-4c53-9190-ad36e1d0262d admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.169908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8362bd-1835-4c53-9190-ad36e1d0262d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:35:46.170443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8362bd-1835-4c53-9190-ad36e1d0262d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.173436 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8362bd-1835-4c53-9190-ad36e1d0262d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:46.190188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 795/1566] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:35:46 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:46.190188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afe6ac-51b7-487d-9f73-10c80eb2ca81 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.195762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 772/1567] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:35:46.196665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8362bd-1835-4c53-9190-ad36e1d0262d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.207781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8362bd-1835-4c53-9190-ad36e1d0262d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.271036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afe6ac-51b7-487d-9f73-10c80eb2ca81 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.276004 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c92a5-2129-4e8a-99df-4c712c00866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.276722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c92a5-2129-4e8a-99df-4c712c00866a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.277046 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c92a5-2129-4e8a-99df-4c712c00866a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.277322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c92a5-2129-4e8a-99df-4c712c00866a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.278096 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa06110-dc49-4dd7-b979-81fd8c2cf32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.278222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c92a5-2129-4e8a-99df-4c712c00866a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.279107 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa06110-dc49-4dd7-b979-81fd8c2cf32f admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.279492 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa06110-dc49-4dd7-b979-81fd8c2cf32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.279878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa06110-dc49-4dd7-b979-81fd8c2cf32f admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.280028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c92a5-2129-4e8a-99df-4c712c00866a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:46.281049 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa06110-dc49-4dd7-b979-81fd8c2cf32f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:35:46.281445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa06110-dc49-4dd7-b979-81fd8c2cf32f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.283690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa06110-dc49-4dd7-b979-81fd8c2cf32f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:46.293197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 796/1568] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:46.294353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c92a5-2129-4e8a-99df-4c712c00866a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.300149 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 773/1569] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:35:46.302865 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa06110-dc49-4dd7-b979-81fd8c2cf32f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.305841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c92a5-2129-4e8a-99df-4c712c00866a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.311437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa4182-87aa-4355-b621-45324a2906e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.312105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa4182-87aa-4355-b621-45324a2906e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.312386 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa4182-87aa-4355-b621-45324a2906e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.312658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa4182-87aa-4355-b621-45324a2906e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.313389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa4182-87aa-4355-b621-45324a2906e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:35:46.313690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa4182-87aa-4355-b621-45324a2906e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.314741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa06110-dc49-4dd7-b979-81fd8c2cf32f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.315457 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa4182-87aa-4355-b621-45324a2906e5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:46.319579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ac180-7a46-4b99-bb5c-7dbb6f8c9acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.320565 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac180-7a46-4b99-bb5c-7dbb6f8c9acd admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.320565 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac180-7a46-4b99-bb5c-7dbb6f8c9acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.320755 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac180-7a46-4b99-bb5c-7dbb6f8c9acd admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.321478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ac180-7a46-4b99-bb5c-7dbb6f8c9acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.324272 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ac180-7a46-4b99-bb5c-7dbb6f8c9acd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:46.328959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 797/1570] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:35:46.331644 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa4182-87aa-4355-b621-45324a2906e5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.343288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa4182-87aa-4355-b621-45324a2906e5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.348356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b8749-bf60-449c-893b-544e783dc2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.349155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b8749-bf60-449c-893b-544e783dc2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.349440 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b8749-bf60-449c-893b-544e783dc2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.349714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b8749-bf60-449c-893b-544e783dc2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.350454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b8749-bf60-449c-893b-544e783dc2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.352114 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b8749-bf60-449c-893b-544e783dc2b8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:46.362655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 798/1571] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:46.363465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b8749-bf60-449c-893b-544e783dc2b8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.373888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b8749-bf60-449c-893b-544e783dc2b8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.378842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb952c-3955-4590-8e77-956cfb8fc169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.379521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb952c-3955-4590-8e77-956cfb8fc169 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.379806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb952c-3955-4590-8e77-956cfb8fc169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.380103 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb952c-3955-4590-8e77-956cfb8fc169 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.380824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb952c-3955-4590-8e77-956cfb8fc169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.382890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb952c-3955-4590-8e77-956cfb8fc169 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:46.397022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 774/1572] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:35:46 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:46.398010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ac180-7a46-4b99-bb5c-7dbb6f8c9acd admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.458923 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ac180-7a46-4b99-bb5c-7dbb6f8c9acd admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.466029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d8502-fcc3-4ddd-817e-ef8cd78adeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.471330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d8502-fcc3-4ddd-817e-ef8cd78adeaf admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.471330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d8502-fcc3-4ddd-817e-ef8cd78adeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.471330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d8502-fcc3-4ddd-817e-ef8cd78adeaf admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.471330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d8502-fcc3-4ddd-817e-ef8cd78adeaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.471330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d8502-fcc3-4ddd-817e-ef8cd78adeaf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:46.472453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 799/1573] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:35:46 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:46.473279 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb952c-3955-4590-8e77-956cfb8fc169 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.537225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb952c-3955-4590-8e77-956cfb8fc169 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.543025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ecfdd-970c-4068-900d-582913951f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.543640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ecfdd-970c-4068-900d-582913951f47 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.544570 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ecfdd-970c-4068-900d-582913951f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.544570 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ecfdd-970c-4068-900d-582913951f47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.544900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ecfdd-970c-4068-900d-582913951f47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.546894 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ecfdd-970c-4068-900d-582913951f47 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:46.564098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 775/1574] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:35:46 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:46.568759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d8502-fcc3-4ddd-817e-ef8cd78adeaf admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.578771 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d8502-fcc3-4ddd-817e-ef8cd78adeaf admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.583530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eb801-271c-4a51-a44f-c559eb572539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.584429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eb801-271c-4a51-a44f-c559eb572539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.584664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eb801-271c-4a51-a44f-c559eb572539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.584962 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eb801-271c-4a51-a44f-c559eb572539 admin admin] PATH_INFO: `/v3/projects/3d5db27b540b45ed804673be8ac390e7/users/5e3abbae6fea4203b3f0fc3dfe1ca39b/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.601386 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20eb801-271c-4a51-a44f-c559eb572539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5db27b540b45ed804673be8ac390e7, user_id=5e3abbae6fea4203b3f0fc3dfe1ca39b, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.604909 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20eb801-271c-4a51-a44f-c559eb572539 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:46.657037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 800/1575] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:35:46 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:46.657786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ecfdd-970c-4068-900d-582913951f47 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.662371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:46.688001 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 776/1576] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:46 2022] PUT /identity/v3/projects/3d5db27b540b45ed804673be8ac390e7/users/5e3abbae6fea4203b3f0fc3dfe1ca39b/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:46.689353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eb801-271c-4a51-a44f-c559eb572539 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.693152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:46.723065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ecfdd-970c-4068-900d-582913951f47 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.755732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eb801-271c-4a51-a44f-c559eb572539 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.761405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2868c56-05f6-4b0b-ad6e-47113ad79181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.762070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2868c56-05f6-4b0b-ad6e-47113ad79181 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.762360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2868c56-05f6-4b0b-ad6e-47113ad79181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.762631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2868c56-05f6-4b0b-ad6e-47113ad79181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.763354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2868c56-05f6-4b0b-ad6e-47113ad79181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.765272 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2868c56-05f6-4b0b-ad6e-47113ad79181 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:46.787261 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369c671-062a-46fd-9801-032f92084035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.788062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369c671-062a-46fd-9801-032f92084035 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.788288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369c671-062a-46fd-9801-032f92084035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.788984 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369c671-062a-46fd-9801-032f92084035 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.789720 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369c671-062a-46fd-9801-032f92084035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.791740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369c671-062a-46fd-9801-032f92084035 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:46.868524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 777/1577] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:35:46 2022] POST /identity/v3/projects => generated 363 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:46.870174 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2868c56-05f6-4b0b-ad6e-47113ad79181 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.895342 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 801/1578] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:35:46 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:46.896394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369c671-062a-46fd-9801-032f92084035 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:46.942942 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2868c56-05f6-4b0b-ad6e-47113ad79181 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.967597 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369c671-062a-46fd-9801-032f92084035 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:46.972501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6789975-bada-4d06-83e2-2fd6538a7322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:46.973185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6789975-bada-4d06-83e2-2fd6538a7322 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:46.973632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6789975-bada-4d06-83e2-2fd6538a7322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:46.974039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6789975-bada-4d06-83e2-2fd6538a7322 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:46.974860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6789975-bada-4d06-83e2-2fd6538a7322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:46.976807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6789975-bada-4d06-83e2-2fd6538a7322 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.002407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6431e2-8475-4260-b826-3062a83c3b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.003149 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6431e2-8475-4260-b826-3062a83c3b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.003447 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6431e2-8475-4260-b826-3062a83c3b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.003740 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6431e2-8475-4260-b826-3062a83c3b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.004515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6431e2-8475-4260-b826-3062a83c3b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.006215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6431e2-8475-4260-b826-3062a83c3b0b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.016734 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 778/1579] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:47.017523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6431e2-8475-4260-b826-3062a83c3b0b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.027860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6431e2-8475-4260-b826-3062a83c3b0b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.032569 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9d01d-38e5-401c-accc-9631025bd907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.033220 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9d01d-38e5-401c-accc-9631025bd907 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.033504 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9d01d-38e5-401c-accc-9631025bd907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.033781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9d01d-38e5-401c-accc-9631025bd907 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.034527 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9d01d-38e5-401c-accc-9631025bd907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.036516 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9d01d-38e5-401c-accc-9631025bd907 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.081854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 802/1580] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:35:46 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:47.082836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6789975-bada-4d06-83e2-2fd6538a7322 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.094156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6789975-bada-4d06-83e2-2fd6538a7322 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.099045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27a97e-0e1e-408a-85a2-e2cbada9f30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.099699 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27a97e-0e1e-408a-85a2-e2cbada9f30c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.099982 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27a97e-0e1e-408a-85a2-e2cbada9f30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.100258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27a97e-0e1e-408a-85a2-e2cbada9f30c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.100993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27a97e-0e1e-408a-85a2-e2cbada9f30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.102661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27a97e-0e1e-408a-85a2-e2cbada9f30c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.115473 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 803/1581] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:47.117805 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27a97e-0e1e-408a-85a2-e2cbada9f30c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.126361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27a97e-0e1e-408a-85a2-e2cbada9f30c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.131076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1ddec-3f6d-48ab-a584-ef4c9aea3444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.131731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1ddec-3f6d-48ab-a584-ef4c9aea3444 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.132011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1ddec-3f6d-48ab-a584-ef4c9aea3444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.132287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1ddec-3f6d-48ab-a584-ef4c9aea3444 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.133003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1ddec-3f6d-48ab-a584-ef4c9aea3444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.135590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1ddec-3f6d-48ab-a584-ef4c9aea3444 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.138911 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 779/1582] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:35:47 2022] POST /identity/v3/users => generated 303 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:47.142209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00ce8b-787e-4cb6-add7-c4aad9c0b6e8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.142209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00ce8b-787e-4cb6-add7-c4aad9c0b6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.142209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00ce8b-787e-4cb6-add7-c4aad9c0b6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.146980 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:47.162816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5e00ce8b-787e-4cb6-add7-c4aad9c0b6e8 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:47.164297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5e00ce8b-787e-4cb6-add7-c4aad9c0b6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:47.173328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 780/1583] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:47.174087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00ce8b-787e-4cb6-add7-c4aad9c0b6e8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.184627 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00ce8b-787e-4cb6-add7-c4aad9c0b6e8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.189679 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e676d6-c647-4971-9ab3-60386bc0fb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.190379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e676d6-c647-4971-9ab3-60386bc0fb17 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.190771 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e676d6-c647-4971-9ab3-60386bc0fb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.191052 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e676d6-c647-4971-9ab3-60386bc0fb17 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.191756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e676d6-c647-4971-9ab3-60386bc0fb17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.193778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e676d6-c647-4971-9ab3-60386bc0fb17 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.200607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:47.270236 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 804/1584] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:35:47 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:47.271123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1ddec-3f6d-48ab-a584-ef4c9aea3444 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.281877 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1ddec-3f6d-48ab-a584-ef4c9aea3444 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.288181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003994d4-b9df-4417-8789-18226868d469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.289144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003994d4-b9df-4417-8789-18226868d469 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.289423 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003994d4-b9df-4417-8789-18226868d469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.289692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003994d4-b9df-4417-8789-18226868d469 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.290394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003994d4-b9df-4417-8789-18226868d469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.293390 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003994d4-b9df-4417-8789-18226868d469 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.306250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 781/1585] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:35:47 2022] POST /identity/v3/users => generated 282 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:47.308619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e676d6-c647-4971-9ab3-60386bc0fb17 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.317937 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e676d6-c647-4971-9ab3-60386bc0fb17 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.323168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da338038-4d96-419f-99d6-aae558bc742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.324356 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da338038-4d96-419f-99d6-aae558bc742c admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.324638 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da338038-4d96-419f-99d6-aae558bc742c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.324908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da338038-4d96-419f-99d6-aae558bc742c admin admin] PATH_INFO: `/v3/projects/46ce4c173abc49a6b92c2aece8e5c520/users/a46612adeaa0450d94c0e10eb385d083/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.341227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da338038-4d96-419f-99d6-aae558bc742c admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ce4c173abc49a6b92c2aece8e5c520, user_id=a46612adeaa0450d94c0e10eb385d083, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.343998 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da338038-4d96-419f-99d6-aae558bc742c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.393227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 805/1586] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:35:47 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:47.394190 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003994d4-b9df-4417-8789-18226868d469 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.404517 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003994d4-b9df-4417-8789-18226868d469 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.409348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed43b00-a563-42b7-8398-48ffb8a641e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.410005 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed43b00-a563-42b7-8398-48ffb8a641e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.410278 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed43b00-a563-42b7-8398-48ffb8a641e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.410547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed43b00-a563-42b7-8398-48ffb8a641e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.411303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed43b00-a563-42b7-8398-48ffb8a641e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.412909 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed43b00-a563-42b7-8398-48ffb8a641e3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.423529 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 782/1587] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:47 2022] PUT /identity/v3/projects/46ce4c173abc49a6b92c2aece8e5c520/users/a46612adeaa0450d94c0e10eb385d083/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:47.427212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 806/1588] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:47.427212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed43b00-a563-42b7-8398-48ffb8a641e3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.428559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da338038-4d96-419f-99d6-aae558bc742c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.437646 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed43b00-a563-42b7-8398-48ffb8a641e3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.502913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0234f70-7aa9-4fa5-95bf-da9a9253ce0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.503519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234f70-7aa9-4fa5-95bf-da9a9253ce0a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.503795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234f70-7aa9-4fa5-95bf-da9a9253ce0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.503903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da338038-4d96-419f-99d6-aae558bc742c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.504200 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234f70-7aa9-4fa5-95bf-da9a9253ce0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.504786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0234f70-7aa9-4fa5-95bf-da9a9253ce0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.506637 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0234f70-7aa9-4fa5-95bf-da9a9253ce0a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.510218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358ea4c-169f-4516-b503-b3c3fab36200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.511093 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358ea4c-169f-4516-b503-b3c3fab36200 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.511431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358ea4c-169f-4516-b503-b3c3fab36200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.511766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358ea4c-169f-4516-b503-b3c3fab36200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.514478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358ea4c-169f-4516-b503-b3c3fab36200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.514807 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358ea4c-169f-4516-b503-b3c3fab36200 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.517396 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 807/1589] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:47.518300 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0234f70-7aa9-4fa5-95bf-da9a9253ce0a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.528675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 783/1590] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:47.528675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358ea4c-169f-4516-b503-b3c3fab36200 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.538693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358ea4c-169f-4516-b503-b3c3fab36200 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.544282 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037f331-2e2d-4420-af03-52a1e19af19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.544949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037f331-2e2d-4420-af03-52a1e19af19c admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.545225 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037f331-2e2d-4420-af03-52a1e19af19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.545495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037f331-2e2d-4420-af03-52a1e19af19c admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.546225 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037f331-2e2d-4420-af03-52a1e19af19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.547934 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037f331-2e2d-4420-af03-52a1e19af19c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.560054 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 784/1591] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:47.560892 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037f331-2e2d-4420-af03-52a1e19af19c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.573601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037f331-2e2d-4420-af03-52a1e19af19c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.578271 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21170a48-43c6-4299-9ab1-21f054583cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.578792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0234f70-7aa9-4fa5-95bf-da9a9253ce0a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.578965 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21170a48-43c6-4299-9ab1-21f054583cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.579244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21170a48-43c6-4299-9ab1-21f054583cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.579514 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21170a48-43c6-4299-9ab1-21f054583cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.580233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21170a48-43c6-4299-9ab1-21f054583cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.581818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21170a48-43c6-4299-9ab1-21f054583cf7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.582560 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76ca22-8e20-4591-a047-beee5e9714b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.583413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76ca22-8e20-4591-a047-beee5e9714b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.583692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76ca22-8e20-4591-a047-beee5e9714b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.584344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76ca22-8e20-4591-a047-beee5e9714b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.592381 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 785/1592] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:47.593411 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21170a48-43c6-4299-9ab1-21f054583cf7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.594577 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76ca22-8e20-4591-a047-beee5e9714b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.596226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76ca22-8e20-4591-a047-beee5e9714b2 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.605538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21170a48-43c6-4299-9ab1-21f054583cf7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.607088 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 808/1593] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:47.608208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c35e14-fdac-4087-a7fe-24118013494f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.608492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c35e14-fdac-4087-a7fe-24118013494f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.608768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c35e14-fdac-4087-a7fe-24118013494f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.614301 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c349c8-f6a7-4b7b-a5f5-6bcf3b00b36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.615242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c349c8-f6a7-4b7b-a5f5-6bcf3b00b36d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.616504 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c349c8-f6a7-4b7b-a5f5-6bcf3b00b36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.617040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c349c8-f6a7-4b7b-a5f5-6bcf3b00b36d admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.617809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c349c8-f6a7-4b7b-a5f5-6bcf3b00b36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.620207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c349c8-f6a7-4b7b-a5f5-6bcf3b00b36d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.628334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-24c35e14-fdac-4087-a7fe-24118013494f None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:47.629641 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-24c35e14-fdac-4087-a7fe-24118013494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:47.632458 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 786/1594] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:47.633292 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c349c8-f6a7-4b7b-a5f5-6bcf3b00b36d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.639963 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 809/1595] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:47.646177 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c35e14-fdac-4087-a7fe-24118013494f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.646321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c349c8-f6a7-4b7b-a5f5-6bcf3b00b36d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.650870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c35e14-fdac-4087-a7fe-24118013494f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.652773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65ff4a-d6f7-4c4b-a16d-742fff837381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.653564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65ff4a-d6f7-4c4b-a16d-742fff837381 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.653913 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65ff4a-d6f7-4c4b-a16d-742fff837381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.654255 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65ff4a-d6f7-4c4b-a16d-742fff837381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.655194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65ff4a-d6f7-4c4b-a16d-742fff837381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.655838 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b217d-3305-430c-aacd-d5dca51a7b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.656934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b217d-3305-430c-aacd-d5dca51a7b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.657040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65ff4a-d6f7-4c4b-a16d-742fff837381 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.657440 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b217d-3305-430c-aacd-d5dca51a7b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.657707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b217d-3305-430c-aacd-d5dca51a7b1c admin admin] PATH_INFO: `/v3/projects/082a80b84f274a458cbb823a6f87b131/users/27e9d71846d840c4899ab2cbcd773a97/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.671921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 787/1596] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:47.671921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65ff4a-d6f7-4c4b-a16d-742fff837381 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.674387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b217d-3305-430c-aacd-d5dca51a7b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=082a80b84f274a458cbb823a6f87b131, user_id=27e9d71846d840c4899ab2cbcd773a97, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.675522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-aa2b217d-3305-430c-aacd-d5dca51a7b1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:35:47.675522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 20 19:35:47.675522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: Jul 20 19:35:47.677456 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b217d-3305-430c-aacd-d5dca51a7b1c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.682805 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65ff4a-d6f7-4c4b-a16d-742fff837381 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.687664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52282abb-01f5-4659-a3da-24844b8f66b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.688362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52282abb-01f5-4659-a3da-24844b8f66b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.688673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52282abb-01f5-4659-a3da-24844b8f66b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.688949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52282abb-01f5-4659-a3da-24844b8f66b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.689719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52282abb-01f5-4659-a3da-24844b8f66b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.691552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52282abb-01f5-4659-a3da-24844b8f66b4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.702144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 788/1597] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:47.702985 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52282abb-01f5-4659-a3da-24844b8f66b4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.712460 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52282abb-01f5-4659-a3da-24844b8f66b4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.717501 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabc599-9f3d-48f2-ae29-5ac64cdfbe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.718189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabc599-9f3d-48f2-ae29-5ac64cdfbe01 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.718495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabc599-9f3d-48f2-ae29-5ac64cdfbe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.718836 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabc599-9f3d-48f2-ae29-5ac64cdfbe01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.719656 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabc599-9f3d-48f2-ae29-5ac64cdfbe01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.721310 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabc599-9f3d-48f2-ae29-5ac64cdfbe01 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.737596 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 789/1598] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:47.737596 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabc599-9f3d-48f2-ae29-5ac64cdfbe01 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.749563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabc599-9f3d-48f2-ae29-5ac64cdfbe01 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.752143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de8d26-b21c-4989-9604-2e24648935d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.752882 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de8d26-b21c-4989-9604-2e24648935d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.753272 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de8d26-b21c-4989-9604-2e24648935d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.753490 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de8d26-b21c-4989-9604-2e24648935d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.754208 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de8d26-b21c-4989-9604-2e24648935d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.755833 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de8d26-b21c-4989-9604-2e24648935d8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.770468 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 790/1599] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:47.770703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 810/1600] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:47 2022] PUT /identity/v3/projects/082a80b84f274a458cbb823a6f87b131/users/27e9d71846d840c4899ab2cbcd773a97/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:47.770828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de8d26-b21c-4989-9604-2e24648935d8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.770934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b217d-3305-430c-aacd-d5dca51a7b1c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.786725 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de8d26-b21c-4989-9604-2e24648935d8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.815935 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:47.834557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b217d-3305-430c-aacd-d5dca51a7b1c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.839063 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f196ef6-857d-4c60-bbe2-369da5317d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.839848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f196ef6-857d-4c60-bbe2-369da5317d0c service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.840134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f196ef6-857d-4c60-bbe2-369da5317d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.840407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f196ef6-857d-4c60-bbe2-369da5317d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.841214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:47.857318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c22ef3-882a-46f7-b73b-756e50e76e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.858148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c22ef3-882a-46f7-b73b-756e50e76e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.858486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c22ef3-882a-46f7-b73b-756e50e76e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.858881 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c22ef3-882a-46f7-b73b-756e50e76e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.859781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c22ef3-882a-46f7-b73b-756e50e76e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.861809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c22ef3-882a-46f7-b73b-756e50e76e3a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.877893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 791/1601] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:47.877893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c22ef3-882a-46f7-b73b-756e50e76e3a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.885822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c22ef3-882a-46f7-b73b-756e50e76e3a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.890412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1e73c-383a-435f-b557-bfa0ef521f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.891328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1e73c-383a-435f-b557-bfa0ef521f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.891605 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1e73c-383a-435f-b557-bfa0ef521f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.891870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1e73c-383a-435f-b557-bfa0ef521f88 admin admin] PATH_INFO: `/v3/projects/5edb950587ac48b28d3e600db5782fbc/users/0c82e97093b94a688475a7876e1b9c05/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.906548 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f196ef6-857d-4c60-bbe2-369da5317d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.908039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f196ef6-857d-4c60-bbe2-369da5317d0c service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.909395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1e73c-383a-435f-b557-bfa0ef521f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5edb950587ac48b28d3e600db5782fbc, user_id=0c82e97093b94a688475a7876e1b9c05, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.912813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1e73c-383a-435f-b557-bfa0ef521f88 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:47.918617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 811/1602] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:47.919367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f196ef6-857d-4c60-bbe2-369da5317d0c service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:47.929133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f196ef6-857d-4c60-bbe2-369da5317d0c service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:47.934873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb21bde-795f-4d73-8c1c-b9415aea72c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:47.935849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb21bde-795f-4d73-8c1c-b9415aea72c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:47.936121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb21bde-795f-4d73-8c1c-b9415aea72c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:47.936389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb21bde-795f-4d73-8c1c-b9415aea72c7 admin admin] PATH_INFO: `/v3/projects/84759abad9864d98af74c57d963f2204/users/8f9ec5b59a0440bc9c11e0235a3b9595/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:47.955706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb21bde-795f-4d73-8c1c-b9415aea72c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84759abad9864d98af74c57d963f2204, user_id=8f9ec5b59a0440bc9c11e0235a3b9595, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:47.955706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb21bde-795f-4d73-8c1c-b9415aea72c7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:48.006297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 792/1603] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:47 2022] PUT /identity/v3/projects/5edb950587ac48b28d3e600db5782fbc/users/0c82e97093b94a688475a7876e1b9c05/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:48.008603 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1e73c-383a-435f-b557-bfa0ef521f88 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:48.051901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 812/1604] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:47 2022] PUT /identity/v3/projects/84759abad9864d98af74c57d963f2204/users/8f9ec5b59a0440bc9c11e0235a3b9595/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:48.053075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb21bde-795f-4d73-8c1c-b9415aea72c7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:48.098899 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1e73c-383a-435f-b557-bfa0ef521f88 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:48.137974 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb21bde-795f-4d73-8c1c-b9415aea72c7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:48.145779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd964c17-8f1f-4b58-b739-967955c8004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:48.147272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd964c17-8f1f-4b58-b739-967955c8004e admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:48.147272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd964c17-8f1f-4b58-b739-967955c8004e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:48.147272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd964c17-8f1f-4b58-b739-967955c8004e admin admin] PATH_INFO: `/v3/projects/c9a20009561f45868949046fd68c7847/users/32593038cc0c48baa93c213c2ab26062/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:48.166890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd964c17-8f1f-4b58-b739-967955c8004e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a20009561f45868949046fd68c7847, user_id=32593038cc0c48baa93c213c2ab26062, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:48.179875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd964c17-8f1f-4b58-b739-967955c8004e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:48.193065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b56e5b-ffd8-4d2f-9973-894aa1613309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:48.194083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b56e5b-ffd8-4d2f-9973-894aa1613309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:48.194441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b56e5b-ffd8-4d2f-9973-894aa1613309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:48.194804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b56e5b-ffd8-4d2f-9973-894aa1613309 admin admin] PATH_INFO: `/v3/projects/09f91f26c1854053aa33065fbc4b542b/users/499db61d9c2f46cd841f39fafa935d8a/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:48.211225 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b56e5b-ffd8-4d2f-9973-894aa1613309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f91f26c1854053aa33065fbc4b542b, user_id=499db61d9c2f46cd841f39fafa935d8a, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:48.214514 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b56e5b-ffd8-4d2f-9973-894aa1613309 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:48.268152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 813/1605] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:48 2022] PUT /identity/v3/projects/c9a20009561f45868949046fd68c7847/users/32593038cc0c48baa93c213c2ab26062/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:48.269738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c1f22-fc36-4918-9da6-155ac2d19e62 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:48.270091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c1f22-fc36-4918-9da6-155ac2d19e62 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:48.270445 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c1f22-fc36-4918-9da6-155ac2d19e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:48.290876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f08c1f22-fc36-4918-9da6-155ac2d19e62 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:48.297174 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f08c1f22-fc36-4918-9da6-155ac2d19e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:48.331194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 793/1606] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:48 2022] PUT /identity/v3/projects/09f91f26c1854053aa33065fbc4b542b/users/499db61d9c2f46cd841f39fafa935d8a/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:48.338396 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b56e5b-ffd8-4d2f-9973-894aa1613309 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:48.345587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:48.366999 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 814/1607] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:48.369130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9f664-fff2-47f8-8af0-8d63a318d1e6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:48.369532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9f664-fff2-47f8-8af0-8d63a318d1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:48.369912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9f664-fff2-47f8-8af0-8d63a318d1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:48.394396 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:48.405517 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-97e9f664-fff2-47f8-8af0-8d63a318d1e6 None None] MFA Rules not processed for user `0c82e97093b94a688475a7876e1b9c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:48.406762 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-97e9f664-fff2-47f8-8af0-8d63a318d1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:48.413818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b56e5b-ffd8-4d2f-9973-894aa1613309 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:48.419530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b04c0-fee8-4ef0-82d8-2f0993d9d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:48.423629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b04c0-fee8-4ef0-82d8-2f0993d9d8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:48.423629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b04c0-fee8-4ef0-82d8-2f0993d9d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:48.423629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b04c0-fee8-4ef0-82d8-2f0993d9d8e7 admin admin] PATH_INFO: `/v3/projects/8cf503badc8c487ea068fed5ef3fd66e/users/29699d4182424a95bc151c7467fe4f35/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:48.438290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b04c0-fee8-4ef0-82d8-2f0993d9d8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf503badc8c487ea068fed5ef3fd66e, user_id=29699d4182424a95bc151c7467fe4f35, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:48.441353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b04c0-fee8-4ef0-82d8-2f0993d9d8e7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:48.505283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 815/1608] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:48.506931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec9a4-fc76-4fdc-a555-b976c6ae5c82 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:48.507256 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec9a4-fc76-4fdc-a555-b976c6ae5c82 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:48.507621 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec9a4-fc76-4fdc-a555-b976c6ae5c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:48.530126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c6dec9a4-fc76-4fdc-a555-b976c6ae5c82 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:48.531864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c6dec9a4-fc76-4fdc-a555-b976c6ae5c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:48.543075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 816/1609] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:48.547724 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27015677-52d5-4526-9d78-ceb13be43119 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:48.548063 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27015677-52d5-4526-9d78-ceb13be43119 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:48.548357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27015677-52d5-4526-9d78-ceb13be43119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:48.570822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 794/1610] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:48 2022] PUT /identity/v3/projects/8cf503badc8c487ea068fed5ef3fd66e/users/29699d4182424a95bc151c7467fe4f35/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:48.571082 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94341c05-baf8-41f3-8249-3b85c0191b52 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:48.571281 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94341c05-baf8-41f3-8249-3b85c0191b52 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:48.571600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94341c05-baf8-41f3-8249-3b85c0191b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:48.587255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-27015677-52d5-4526-9d78-ceb13be43119 None None] MFA Rules not processed for user `32593038cc0c48baa93c213c2ab26062`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:48.588440 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-27015677-52d5-4526-9d78-ceb13be43119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:48.618322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-94341c05-baf8-41f3-8249-3b85c0191b52 None None] MFA Rules not processed for user `499db61d9c2f46cd841f39fafa935d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:48.620769 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-94341c05-baf8-41f3-8249-3b85c0191b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:48.686639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 817/1611] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:48 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:48.687752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27015677-52d5-4526-9d78-ceb13be43119 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:48.689059 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-27015677-52d5-4526-9d78-ceb13be43119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:48.731577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 795/1612] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:48.736600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94341c05-baf8-41f3-8249-3b85c0191b52 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:48.758986 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27015677-52d5-4526-9d78-ceb13be43119 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:48.763285 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dc6d6-e4c1-4f9e-b0df-7cf1d45926b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:48.763938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dc6d6-e4c1-4f9e-b0df-7cf1d45926b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:48.764207 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dc6d6-e4c1-4f9e-b0df-7cf1d45926b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:48.764476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dc6d6-e4c1-4f9e-b0df-7cf1d45926b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:48.775946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:48.819605 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94341c05-baf8-41f3-8249-3b85c0191b52 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:48.826754 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d6b72-d2c9-4ed2-a3ec-bd15bda824dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:48.827700 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d6b72-d2c9-4ed2-a3ec-bd15bda824dd admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:48.828753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d6b72-d2c9-4ed2-a3ec-bd15bda824dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:48.829031 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d6b72-d2c9-4ed2-a3ec-bd15bda824dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:48.829743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d6b72-d2c9-4ed2-a3ec-bd15bda824dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:48.831712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d6b72-d2c9-4ed2-a3ec-bd15bda824dd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:48.838522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242dc6d6-e4c1-4f9e-b0df-7cf1d45926b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:48.838522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242dc6d6-e4c1-4f9e-b0df-7cf1d45926b0 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:48.851619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 818/1613] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:48.852054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dc6d6-e4c1-4f9e-b0df-7cf1d45926b0 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:48.862129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dc6d6-e4c1-4f9e-b0df-7cf1d45926b0 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:48.866432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9417f-a24f-4e02-a639-04539d8c2bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:48.866432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9417f-a24f-4e02-a639-04539d8c2bef service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:48.866825 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9417f-a24f-4e02-a639-04539d8c2bef service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:48.867008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9417f-a24f-4e02-a639-04539d8c2bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:48.878601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9417f-a24f-4e02-a639-04539d8c2bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:48.880234 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9417f-a24f-4e02-a639-04539d8c2bef service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:48.891264 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 819/1614] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:48.895207 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c79ad-3fd8-4f22-8dfe-cb9848242478 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:48.895207 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c79ad-3fd8-4f22-8dfe-cb9848242478 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:48.895207 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c79ad-3fd8-4f22-8dfe-cb9848242478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:48.927685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 796/1615] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:35:48 2022] POST /identity/v3/projects => generated 369 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:48.929331 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d6b72-d2c9-4ed2-a3ec-bd15bda824dd admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:48.932127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c82c79ad-3fd8-4f22-8dfe-cb9848242478 None None] MFA Rules not processed for user `29699d4182424a95bc151c7467fe4f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:48.933812 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c82c79ad-3fd8-4f22-8dfe-cb9848242478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:49.000166 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:49.017299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 820/1616] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:49.018138 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c79ad-3fd8-4f22-8dfe-cb9848242478 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:49.019577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d6b72-d2c9-4ed2-a3ec-bd15bda824dd admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:49.025276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fa211-86be-4080-9fc3-f0b794f8fb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:49.026898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fa211-86be-4080-9fc3-f0b794f8fb2c admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:49.027374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fa211-86be-4080-9fc3-f0b794f8fb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:49.027815 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fa211-86be-4080-9fc3-f0b794f8fb2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:49.028856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fa211-86be-4080-9fc3-f0b794f8fb2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:49.030981 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fa211-86be-4080-9fc3-f0b794f8fb2c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:49.048144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c79ad-3fd8-4f22-8dfe-cb9848242478 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:49.061175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8993d-d708-4499-a15b-f97a19e6859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:49.062217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8993d-d708-4499-a15b-f97a19e6859d admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:49.062545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8993d-d708-4499-a15b-f97a19e6859d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:49.062939 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8993d-d708-4499-a15b-f97a19e6859d admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:49.064092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8993d-d708-4499-a15b-f97a19e6859d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:49.066357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8993d-d708-4499-a15b-f97a19e6859d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:49.151266 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 797/1617] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:35:48 2022] POST /identity/v3/projects => generated 365 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:49.151492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 821/1618] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:35:49 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:49.151595 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fa211-86be-4080-9fc3-f0b794f8fb2c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:49.151685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41f369-5c20-4851-abc8-cff6798349d0 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:49.151685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41f369-5c20-4851-abc8-cff6798349d0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:49.151685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41f369-5c20-4851-abc8-cff6798349d0 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:49.152840 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 822/1619] 10.222.0.16 () {54 vars in 962 bytes} [Wed Jul 20 19:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:35:49.153458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41f369-5c20-4851-abc8-cff6798349d0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:49.265772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fa211-86be-4080-9fc3-f0b794f8fb2c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:49.272293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad3d4d-1433-4482-b544-cf719e3bfce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:49.273146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad3d4d-1433-4482-b544-cf719e3bfce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:49.273577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad3d4d-1433-4482-b544-cf719e3bfce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:49.274118 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad3d4d-1433-4482-b544-cf719e3bfce5 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:49.275603 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad3d4d-1433-4482-b544-cf719e3bfce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:49.283382 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad3d4d-1433-4482-b544-cf719e3bfce5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:49.311497 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41f369-5c20-4851-abc8-cff6798349d0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:49.318729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f402457-37ec-40b5-b899-fef5b17c6409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:49.319499 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f402457-37ec-40b5-b899-fef5b17c6409 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:49.319845 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f402457-37ec-40b5-b899-fef5b17c6409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:49.320250 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f402457-37ec-40b5-b899-fef5b17c6409 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:49.321274 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f402457-37ec-40b5-b899-fef5b17c6409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:49.329438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f402457-37ec-40b5-b899-fef5b17c6409 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:49.346117 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:49.383011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 798/1620] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:35:49 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:49.383965 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad3d4d-1433-4482-b544-cf719e3bfce5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:49.396486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad3d4d-1433-4482-b544-cf719e3bfce5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:49.402192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b99f5a-b8a3-430a-badb-b641117ec98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:49.402921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b99f5a-b8a3-430a-badb-b641117ec98e admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:49.403200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b99f5a-b8a3-430a-badb-b641117ec98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:49.403476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b99f5a-b8a3-430a-badb-b641117ec98e admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:49.404257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b99f5a-b8a3-430a-badb-b641117ec98e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:49.406139 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b99f5a-b8a3-430a-badb-b641117ec98e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:49.474534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 823/1621] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:35:49 2022] POST /identity/v3/users => generated 289 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:49.474534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abfc21-92e7-48c5-8b6f-b3c6fb9ee037 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:49.474534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abfc21-92e7-48c5-8b6f-b3c6fb9ee037 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:49.474534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abfc21-92e7-48c5-8b6f-b3c6fb9ee037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:49.501424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 799/1622] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:35:49 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:49.502515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b99f5a-b8a3-430a-badb-b641117ec98e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:49.527949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b99f5a-b8a3-430a-badb-b641117ec98e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:49.548233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf23ea-1f1a-4c5f-89eb-cc2ccc3608b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:49.552560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf23ea-1f1a-4c5f-89eb-cc2ccc3608b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:49.552560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf23ea-1f1a-4c5f-89eb-cc2ccc3608b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:49.552560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf23ea-1f1a-4c5f-89eb-cc2ccc3608b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:49.554898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf23ea-1f1a-4c5f-89eb-cc2ccc3608b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:49.559177 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf23ea-1f1a-4c5f-89eb-cc2ccc3608b1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:49.587200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 800/1623] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:49.589009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf23ea-1f1a-4c5f-89eb-cc2ccc3608b1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:49.592410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f6abfc21-92e7-48c5-8b6f-b3c6fb9ee037 None None] MFA Rules not processed for user `e3fd38ebb5514af686204d0b02a91edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:49.593701 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f6abfc21-92e7-48c5-8b6f-b3c6fb9ee037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:49.602567 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf23ea-1f1a-4c5f-89eb-cc2ccc3608b1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:49.611512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff465d3-29fa-49ab-9b15-27f4a16b02a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:49.612691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff465d3-29fa-49ab-9b15-27f4a16b02a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:49.612980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff465d3-29fa-49ab-9b15-27f4a16b02a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:49.613301 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff465d3-29fa-49ab-9b15-27f4a16b02a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:49.614345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff465d3-29fa-49ab-9b15-27f4a16b02a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:49.617117 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff465d3-29fa-49ab-9b15-27f4a16b02a4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:49.637267 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 801/1624] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:49.637267 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff465d3-29fa-49ab-9b15-27f4a16b02a4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:49.648001 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff465d3-29fa-49ab-9b15-27f4a16b02a4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:49.656486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de9c64-add4-4cd8-8eb6-99b0769e6b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:49.657333 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de9c64-add4-4cd8-8eb6-99b0769e6b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:49.657617 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de9c64-add4-4cd8-8eb6-99b0769e6b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:49.657957 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de9c64-add4-4cd8-8eb6-99b0769e6b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:49.659480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de9c64-add4-4cd8-8eb6-99b0769e6b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:49.663696 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de9c64-add4-4cd8-8eb6-99b0769e6b71 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:49.694051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 802/1625] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:49.694984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de9c64-add4-4cd8-8eb6-99b0769e6b71 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:49.732227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de9c64-add4-4cd8-8eb6-99b0769e6b71 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:49.751679 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660c410-b281-412b-9811-ebc3f300a183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:49.753862 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660c410-b281-412b-9811-ebc3f300a183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:49.754396 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660c410-b281-412b-9811-ebc3f300a183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:49.754895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660c410-b281-412b-9811-ebc3f300a183 admin admin] PATH_INFO: `/v3/projects/15a70b7b93264315a7ce7ae3480f6080/users/90b176d19d40411ba56a084c048e7d07/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:49.767904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 824/1626] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Jul 20 19:35:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:49.769451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abfc21-92e7-48c5-8b6f-b3c6fb9ee037 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:49.790830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660c410-b281-412b-9811-ebc3f300a183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a70b7b93264315a7ce7ae3480f6080, user_id=90b176d19d40411ba56a084c048e7d07, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:49.794574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660c410-b281-412b-9811-ebc3f300a183 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:49.799888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abfc21-92e7-48c5-8b6f-b3c6fb9ee037 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:49.813718 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ee4fd-9a01-4616-8512-5c01c89a9114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:49.816814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ee4fd-9a01-4616-8512-5c01c89a9114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:49.816814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ee4fd-9a01-4616-8512-5c01c89a9114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:49.816814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ee4fd-9a01-4616-8512-5c01c89a9114 admin admin] PATH_INFO: `/v3/projects/1a72903a1b4844519969c76be879c0be/users/f42b820a76ef441bbb6904e0039dc4dd/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:49.845885 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ee4fd-9a01-4616-8512-5c01c89a9114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a72903a1b4844519969c76be879c0be, user_id=f42b820a76ef441bbb6904e0039dc4dd, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:49.849770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ee4fd-9a01-4616-8512-5c01c89a9114 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:49.873868 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 803/1627] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:49 2022] PUT /identity/v3/projects/15a70b7b93264315a7ce7ae3480f6080/users/90b176d19d40411ba56a084c048e7d07/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:49.875674 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660c410-b281-412b-9811-ebc3f300a183 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:49.974576 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 825/1628] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:49 2022] PUT /identity/v3/projects/1a72903a1b4844519969c76be879c0be/users/f42b820a76ef441bbb6904e0039dc4dd/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:49.974576 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ee4fd-9a01-4616-8512-5c01c89a9114 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:49.985907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:50.016437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660c410-b281-412b-9811-ebc3f300a183 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:50.131650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ee4fd-9a01-4616-8512-5c01c89a9114 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:50.136698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eea87-49c0-4c0b-86d6-6f1cc64c892c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:50.138187 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eea87-49c0-4c0b-86d6-6f1cc64c892c admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:50.138489 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eea87-49c0-4c0b-86d6-6f1cc64c892c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:50.138793 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eea87-49c0-4c0b-86d6-6f1cc64c892c admin admin] PATH_INFO: `/v3/projects/afa164c9dc0e41549ce4e20f5b2018a7/users/90bb72f63f7943a3a7a0e0aedfe17e17/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:50.139846 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d412d7a-fa9f-445a-8abb-508ddc517f5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:50.140642 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d412d7a-fa9f-445a-8abb-508ddc517f5f service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:50.141157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d412d7a-fa9f-445a-8abb-508ddc517f5f service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:50.141681 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d412d7a-fa9f-445a-8abb-508ddc517f5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:50.178555 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824eea87-49c0-4c0b-86d6-6f1cc64c892c admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa164c9dc0e41549ce4e20f5b2018a7, user_id=90bb72f63f7943a3a7a0e0aedfe17e17, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:50.186061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824eea87-49c0-4c0b-86d6-6f1cc64c892c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:50.270299 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 804/1629] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:49 2022] PUT /identity/v3/projects/afa164c9dc0e41549ce4e20f5b2018a7/users/90bb72f63f7943a3a7a0e0aedfe17e17/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:50.273955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eea87-49c0-4c0b-86d6-6f1cc64c892c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:50.317398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d412d7a-fa9f-445a-8abb-508ddc517f5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:50.319179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d412d7a-fa9f-445a-8abb-508ddc517f5f service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:50.368130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 826/1630] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:50.389005 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:50.392524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d412d7a-fa9f-445a-8abb-508ddc517f5f service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:50.436197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d412d7a-fa9f-445a-8abb-508ddc517f5f service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:50.534194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eea87-49c0-4c0b-86d6-6f1cc64c892c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:50.546883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457977eb-1dad-4c10-8876-2b832660e37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:50.547586 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457977eb-1dad-4c10-8876-2b832660e37b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:50.551018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457977eb-1dad-4c10-8876-2b832660e37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:50.551469 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457977eb-1dad-4c10-8876-2b832660e37b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:50.552303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457977eb-1dad-4c10-8876-2b832660e37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:50.556873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457977eb-1dad-4c10-8876-2b832660e37b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:50.592417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 805/1631] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:50.594872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457977eb-1dad-4c10-8876-2b832660e37b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:50.622185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148cec6-95cd-42ac-81c4-909980b0fa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:50.628513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148cec6-95cd-42ac-81c4-909980b0fa6a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:50.629909 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148cec6-95cd-42ac-81c4-909980b0fa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:50.635888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148cec6-95cd-42ac-81c4-909980b0fa6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:50.635888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148cec6-95cd-42ac-81c4-909980b0fa6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:50.636216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457977eb-1dad-4c10-8876-2b832660e37b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:50.637488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148cec6-95cd-42ac-81c4-909980b0fa6a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:50.647989 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf385670-9a68-44d9-8e48-e6afd54dab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:50.650941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385670-9a68-44d9-8e48-e6afd54dab92 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:50.651263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385670-9a68-44d9-8e48-e6afd54dab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:50.651629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385670-9a68-44d9-8e48-e6afd54dab92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:50.652544 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf385670-9a68-44d9-8e48-e6afd54dab92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:50.657314 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf385670-9a68-44d9-8e48-e6afd54dab92 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:50.663458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 827/1632] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:50.664527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148cec6-95cd-42ac-81c4-909980b0fa6a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:50.692566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 806/1633] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:50.695474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf385670-9a68-44d9-8e48-e6afd54dab92 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:50.697846 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148cec6-95cd-42ac-81c4-909980b0fa6a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:50.712824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be6591-ed3b-495c-96f6-0edb29a8666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:50.714704 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be6591-ed3b-495c-96f6-0edb29a8666e admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:50.716744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be6591-ed3b-495c-96f6-0edb29a8666e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:50.718647 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be6591-ed3b-495c-96f6-0edb29a8666e admin admin] PATH_INFO: `/v3/projects/15a70b7b93264315a7ce7ae3480f6080/users/90b176d19d40411ba56a084c048e7d07/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:50.720701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf385670-9a68-44d9-8e48-e6afd54dab92 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:50.721674 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be6591-ed3b-495c-96f6-0edb29a8666e admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a70b7b93264315a7ce7ae3480f6080, user_id=90b176d19d40411ba56a084c048e7d07, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:50.727712 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be6591-ed3b-495c-96f6-0edb29a8666e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:50.731419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa559014-551f-49ea-b105-bd0b01ca62fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:50.733637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa559014-551f-49ea-b105-bd0b01ca62fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:50.733959 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa559014-551f-49ea-b105-bd0b01ca62fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:50.734234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa559014-551f-49ea-b105-bd0b01ca62fa admin admin] PATH_INFO: `/v3/projects/1a72903a1b4844519969c76be879c0be/users/f42b820a76ef441bbb6904e0039dc4dd/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:50.742828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa559014-551f-49ea-b105-bd0b01ca62fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a72903a1b4844519969c76be879c0be, user_id=f42b820a76ef441bbb6904e0039dc4dd, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:50.755410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa559014-551f-49ea-b105-bd0b01ca62fa admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:50.773609 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 828/1634] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:50 2022] PUT /identity/v3/projects/15a70b7b93264315a7ce7ae3480f6080/users/90b176d19d40411ba56a084c048e7d07/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:50.778641 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be6591-ed3b-495c-96f6-0edb29a8666e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:50.795604 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 807/1635] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:50 2022] PUT /identity/v3/projects/1a72903a1b4844519969c76be879c0be/users/f42b820a76ef441bbb6904e0039dc4dd/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:50.800952 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72244e9-a560-478e-86c6-38b69437b5ea None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:50.800952 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72244e9-a560-478e-86c6-38b69437b5ea None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:50.804788 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72244e9-a560-478e-86c6-38b69437b5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:50.889055 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e72244e9-a560-478e-86c6-38b69437b5ea None None] MFA Rules not processed for user `90b176d19d40411ba56a084c048e7d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:50.892434 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e72244e9-a560-478e-86c6-38b69437b5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:50.964508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be6591-ed3b-495c-96f6-0edb29a8666e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:51.012866 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:51.075572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 808/1636] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:50 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:51.080257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438470cd-6c00-47b1-a27f-c7a0d260d77a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:51.080257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438470cd-6c00-47b1-a27f-c7a0d260d77a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:51.080257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438470cd-6c00-47b1-a27f-c7a0d260d77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:51.094458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b345c-5232-4c41-974e-d4da3f69e8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:51.095850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b345c-5232-4c41-974e-d4da3f69e8cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:51.096424 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b345c-5232-4c41-974e-d4da3f69e8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:51.096923 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b345c-5232-4c41-974e-d4da3f69e8cb admin admin] PATH_INFO: `/v3/projects/afa164c9dc0e41549ce4e20f5b2018a7/users/90bb72f63f7943a3a7a0e0aedfe17e17/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:51.099421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b345c-5232-4c41-974e-d4da3f69e8cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa164c9dc0e41549ce4e20f5b2018a7, user_id=90bb72f63f7943a3a7a0e0aedfe17e17, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:51.312463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b345c-5232-4c41-974e-d4da3f69e8cb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:51.312463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 829/1637] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:50 2022] PUT /identity/v3/projects/afa164c9dc0e41549ce4e20f5b2018a7/users/90bb72f63f7943a3a7a0e0aedfe17e17/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:51.312463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40aa7e-e54e-488e-bf63-3199fc8b7e6f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:51.312463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40aa7e-e54e-488e-bf63-3199fc8b7e6f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:51.312463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40aa7e-e54e-488e-bf63-3199fc8b7e6f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:51.312463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 830/1638] 10.222.0.16 () {54 vars in 912 bytes} [Wed Jul 20 19:35:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:35:51.313561 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40aa7e-e54e-488e-bf63-3199fc8b7e6f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:51.313861 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-438470cd-6c00-47b1-a27f-c7a0d260d77a None None] MFA Rules not processed for user `f42b820a76ef441bbb6904e0039dc4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:51.313861 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-438470cd-6c00-47b1-a27f-c7a0d260d77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:51.314587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40aa7e-e54e-488e-bf63-3199fc8b7e6f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:51.314587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528e828-69f0-43c5-94ec-b99ef34c42ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:51.314587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528e828-69f0-43c5-94ec-b99ef34c42ad service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:51.314587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528e828-69f0-43c5-94ec-b99ef34c42ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:51.317063 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528e828-69f0-43c5-94ec-b99ef34c42ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:51.374139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:51.387436 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 809/1639] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:51.398831 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9eb73-d9d8-467d-a2af-123877fae33d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:51.399218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9eb73-d9d8-467d-a2af-123877fae33d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:51.399500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9eb73-d9d8-467d-a2af-123877fae33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:51.426320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528e828-69f0-43c5-94ec-b99ef34c42ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:51.427663 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528e828-69f0-43c5-94ec-b99ef34c42ad service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:51.453836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 831/1640] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:51 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:51.479410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff56fe-57e3-41ee-aede-baaffb1d93d1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:51.480974 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff56fe-57e3-41ee-aede-baaffb1d93d1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:51.484745 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9ea9eb73-d9d8-467d-a2af-123877fae33d None None] MFA Rules not processed for user `90bb72f63f7943a3a7a0e0aedfe17e17`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:51.485343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff56fe-57e3-41ee-aede-baaffb1d93d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:51.486787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9ea9eb73-d9d8-467d-a2af-123877fae33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:51.567057 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f0ff56fe-57e3-41ee-aede-baaffb1d93d1 None None] MFA Rules not processed for user `e3fd38ebb5514af686204d0b02a91edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:51.568153 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f0ff56fe-57e3-41ee-aede-baaffb1d93d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:51.670025 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 810/1641] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:51.671153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9eb73-d9d8-467d-a2af-123877fae33d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:51.701811 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9eb73-d9d8-467d-a2af-123877fae33d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:51.705716 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6ad12-d358-469c-ac1f-3fade71eec26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:51.706389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6ad12-d358-469c-ac1f-3fade71eec26 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:51.706698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6ad12-d358-469c-ac1f-3fade71eec26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:51.707226 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6ad12-d358-469c-ac1f-3fade71eec26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:51.734812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6ad12-d358-469c-ac1f-3fade71eec26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:51.736300 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6ad12-d358-469c-ac1f-3fade71eec26 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:51.747100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 832/1642] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 20 19:35:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:51.748557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa68303-bf4b-462f-98e1-0701fb6af835 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:51.748849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa68303-bf4b-462f-98e1-0701fb6af835 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:51.749120 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa68303-bf4b-462f-98e1-0701fb6af835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:51.749941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 811/1643] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:51.750849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6ad12-d358-469c-ac1f-3fade71eec26 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:51.760467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6ad12-d358-469c-ac1f-3fade71eec26 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:51.764808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778f8af-6d29-497a-8299-e008aa3d20a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:51.765664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778f8af-6d29-497a-8299-e008aa3d20a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:51.765951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778f8af-6d29-497a-8299-e008aa3d20a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:51.766229 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778f8af-6d29-497a-8299-e008aa3d20a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:51.778213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778f8af-6d29-497a-8299-e008aa3d20a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:51.780125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778f8af-6d29-497a-8299-e008aa3d20a1 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:51.798598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 812/1644] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:51.836753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-dfa68303-bf4b-462f-98e1-0701fb6af835 None None] MFA Rules not processed for user `8f9ec5b59a0440bc9c11e0235a3b9595`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:51.839139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dfa68303-bf4b-462f-98e1-0701fb6af835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:51.943729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778f8af-6d29-497a-8299-e008aa3d20a1 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:51.955362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778f8af-6d29-497a-8299-e008aa3d20a1 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:51.972321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117f26b-b2dd-4657-8a0b-d0dc55b37c51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:51.973352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117f26b-b2dd-4657-8a0b-d0dc55b37c51 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:51.973753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117f26b-b2dd-4657-8a0b-d0dc55b37c51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:51.974145 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117f26b-b2dd-4657-8a0b-d0dc55b37c51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:51.995759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117f26b-b2dd-4657-8a0b-d0dc55b37c51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:51.997650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117f26b-b2dd-4657-8a0b-d0dc55b37c51 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:52.008004 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 833/1645] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:52.008992 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa68303-bf4b-462f-98e1-0701fb6af835 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:52.033529 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 813/1646] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:35:52.035407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa68303-bf4b-462f-98e1-0701fb6af835 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:52.041354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117f26b-b2dd-4657-8a0b-d0dc55b37c51 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:52.042394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dfaaa-aadd-45ba-963e-86eb175abc59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:52.043186 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dfaaa-aadd-45ba-963e-86eb175abc59 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:52.043469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dfaaa-aadd-45ba-963e-86eb175abc59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:52.043739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dfaaa-aadd-45ba-963e-86eb175abc59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:52.055665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:52.207794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dfaaa-aadd-45ba-963e-86eb175abc59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:52.209482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dfaaa-aadd-45ba-963e-86eb175abc59 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:52.234842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117f26b-b2dd-4657-8a0b-d0dc55b37c51 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:52.242932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 834/1647] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:52.248250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97bf4a-fdc7-4a23-9795-8aa029cac5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:52.249063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97bf4a-fdc7-4a23-9795-8aa029cac5cd admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:52.250433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97bf4a-fdc7-4a23-9795-8aa029cac5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:52.252457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97bf4a-fdc7-4a23-9795-8aa029cac5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:52.253329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97bf4a-fdc7-4a23-9795-8aa029cac5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:52.259718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97bf4a-fdc7-4a23-9795-8aa029cac5cd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:52.418225 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 814/1648] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:35:52 2022] POST /identity/v3/projects => generated 405 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:52.422756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dfaaa-aadd-45ba-963e-86eb175abc59 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:52.439261 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dfaaa-aadd-45ba-963e-86eb175abc59 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:52.441696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:52.592667 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400322c-f927-47b9-bfd7-704f4a480754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:52.593415 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400322c-f927-47b9-bfd7-704f4a480754 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:52.593700 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400322c-f927-47b9-bfd7-704f4a480754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:52.593974 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400322c-f927-47b9-bfd7-704f4a480754 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:52.607985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400322c-f927-47b9-bfd7-704f4a480754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:52.607985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400322c-f927-47b9-bfd7-704f4a480754 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:52.713054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 835/1649] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:35:52 2022] POST /identity/v3/users => generated 309 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:35:52.717588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97bf4a-fdc7-4a23-9795-8aa029cac5cd admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:52.733894 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97bf4a-fdc7-4a23-9795-8aa029cac5cd admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:52.740298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e279fbf-701b-4e4d-aed2-f76b3b5f8672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:52.741220 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e279fbf-701b-4e4d-aed2-f76b3b5f8672 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:52.741740 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e279fbf-701b-4e4d-aed2-f76b3b5f8672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:52.742175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e279fbf-701b-4e4d-aed2-f76b3b5f8672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:52.743253 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e279fbf-701b-4e4d-aed2-f76b3b5f8672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:52.745522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e279fbf-701b-4e4d-aed2-f76b3b5f8672 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:52.784637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 815/1650] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:52.788844 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400322c-f927-47b9-bfd7-704f4a480754 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:52.800518 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400322c-f927-47b9-bfd7-704f4a480754 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:52.814397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53953361-65c1-46b4-93fc-17b56793c0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:52.815384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53953361-65c1-46b4-93fc-17b56793c0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:52.815656 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53953361-65c1-46b4-93fc-17b56793c0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:52.817217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53953361-65c1-46b4-93fc-17b56793c0c4 admin admin] PATH_INFO: `/v3/projects/06cb9060f2774a7a82696a1cf48fd738/users/4e02355dec5d4bc38e6c5176a4c9977b/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:52.845610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53953361-65c1-46b4-93fc-17b56793c0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06cb9060f2774a7a82696a1cf48fd738, user_id=4e02355dec5d4bc38e6c5176a4c9977b, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:52.849552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53953361-65c1-46b4-93fc-17b56793c0c4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:52.961240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 836/1651] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:52 2022] PUT /identity/v3/projects/06cb9060f2774a7a82696a1cf48fd738/users/4e02355dec5d4bc38e6c5176a4c9977b/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:52.965751 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e279fbf-701b-4e4d-aed2-f76b3b5f8672 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:52.976811 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e279fbf-701b-4e4d-aed2-f76b3b5f8672 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:53.124395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c0f0e-20cb-4e99-b179-a1e6ba6a656c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:53.125099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c0f0e-20cb-4e99-b179-a1e6ba6a656c admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:53.125384 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c0f0e-20cb-4e99-b179-a1e6ba6a656c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:53.125694 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c0f0e-20cb-4e99-b179-a1e6ba6a656c admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:53.126443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c0f0e-20cb-4e99-b179-a1e6ba6a656c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:53.129611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c0f0e-20cb-4e99-b179-a1e6ba6a656c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:53.148272 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 816/1652] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:35:53.151334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53953361-65c1-46b4-93fc-17b56793c0c4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:53.163298 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53953361-65c1-46b4-93fc-17b56793c0c4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:53.190354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bad00-a0cc-45ab-ac61-12da734bdb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:53.222696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bad00-a0cc-45ab-ac61-12da734bdb73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:53.223236 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bad00-a0cc-45ab-ac61-12da734bdb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:53.225587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bad00-a0cc-45ab-ac61-12da734bdb73 admin admin] PATH_INFO: `/v3/projects/06cb9060f2774a7a82696a1cf48fd738/users/4e02355dec5d4bc38e6c5176a4c9977b/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:53.237584 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bad00-a0cc-45ab-ac61-12da734bdb73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06cb9060f2774a7a82696a1cf48fd738, user_id=4e02355dec5d4bc38e6c5176a4c9977b, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:53.249536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bad00-a0cc-45ab-ac61-12da734bdb73 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:53.305008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 837/1653] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:35:53 2022] PUT /identity/v3/projects/06cb9060f2774a7a82696a1cf48fd738/users/4e02355dec5d4bc38e6c5176a4c9977b/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:53.876517 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c0f0e-20cb-4e99-b179-a1e6ba6a656c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:54.051525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c0f0e-20cb-4e99-b179-a1e6ba6a656c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:54.123809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:54.197720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26821b-6cb3-472b-826c-c45d42071b55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:54.198989 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26821b-6cb3-472b-826c-c45d42071b55 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:54.200195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26821b-6cb3-472b-826c-c45d42071b55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:54.203960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26821b-6cb3-472b-826c-c45d42071b55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:54.460157 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26821b-6cb3-472b-826c-c45d42071b55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:54.467516 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26821b-6cb3-472b-826c-c45d42071b55 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:54.519030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 817/1654] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:53 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:54.717065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a6229-0e06-4f4c-a815-8d2c9d6b0eaf None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:54.717639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a6229-0e06-4f4c-a815-8d2c9d6b0eaf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:54.718277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a6229-0e06-4f4c-a815-8d2c9d6b0eaf None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:54.722770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 838/1655] 10.222.0.16 () {54 vars in 962 bytes} [Wed Jul 20 19:35:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:35:54.739940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e29af2-fa6b-47f5-8bf1-28787f9635e2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:54.740622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e29af2-fa6b-47f5-8bf1-28787f9635e2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:54.741268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e29af2-fa6b-47f5-8bf1-28787f9635e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:54.783943 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-76e29af2-fa6b-47f5-8bf1-28787f9635e2 None None] MFA Rules not processed for user `e3fd38ebb5514af686204d0b02a91edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:54.786845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-76e29af2-fa6b-47f5-8bf1-28787f9635e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:54.977274 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 818/1656] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Jul 20 19:35:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:35:54.994293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50522a29-8c5d-4de3-ad31-3c4bd0c201ce None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:54.994801 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50522a29-8c5d-4de3-ad31-3c4bd0c201ce None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:54.995153 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50522a29-8c5d-4de3-ad31-3c4bd0c201ce None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:54.997071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 839/1657] 10.222.0.16 () {54 vars in 912 bytes} [Wed Jul 20 19:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:35:55.014770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d4450-5339-41d4-b904-85a856d9dcd6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:55.015307 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d4450-5339-41d4-b904-85a856d9dcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:55.015636 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d4450-5339-41d4-b904-85a856d9dcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:55.108387 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a61d4450-5339-41d4-b904-85a856d9dcd6 None None] MFA Rules not processed for user `e3fd38ebb5514af686204d0b02a91edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:55.124865 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a61d4450-5339-41d4-b904-85a856d9dcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:55.163000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 819/1658] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 20 19:35:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:55.265541 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50522a29-8c5d-4de3-ad31-3c4bd0c201ce None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:55.291341 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50522a29-8c5d-4de3-ad31-3c4bd0c201ce None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:55.300830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7dee5-4cc3-4dde-9ef0-f98f8a1883c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:55.301524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7dee5-4cc3-4dde-9ef0-f98f8a1883c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:55.301790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7dee5-4cc3-4dde-9ef0-f98f8a1883c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:55.302218 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7dee5-4cc3-4dde-9ef0-f98f8a1883c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:55.339705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7dee5-4cc3-4dde-9ef0-f98f8a1883c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:55.343442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7dee5-4cc3-4dde-9ef0-f98f8a1883c1 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:55.382970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 840/1659] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:56.958085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d4450-5339-41d4-b904-85a856d9dcd6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:57.094735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d4450-5339-41d4-b904-85a856d9dcd6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:57.103615 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a33de-26bf-4935-a317-e0a3f4e21c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:57.107083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a33de-26bf-4935-a317-e0a3f4e21c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:57.107599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a33de-26bf-4935-a317-e0a3f4e21c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:57.108104 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a33de-26bf-4935-a317-e0a3f4e21c3e admin admin] PATH_INFO: `/v3/users/499db61d9c2f46cd841f39fafa935d8a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:57.111713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a33de-26bf-4935-a317-e0a3f4e21c3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=499db61d9c2f46cd841f39fafa935d8a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:57.119810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a33de-26bf-4935-a317-e0a3f4e21c3e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:57.154074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:57.461425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4e4a33de-26bf-4935-a317-e0a3f4e21c3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '499db61d9c2f46cd841f39fafa935d8a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:57.483145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb3dc6-1c22-4e7f-a41d-2e638535007f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:57.483613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb3dc6-1c22-4e7f-a41d-2e638535007f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:57.483702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb3dc6-1c22-4e7f-a41d-2e638535007f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:57.525753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d2eb3dc6-1c22-4e7f-a41d-2e638535007f None None] MFA Rules not processed for user `5e3abbae6fea4203b3f0fc3dfe1ca39b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:57.527093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d2eb3dc6-1c22-4e7f-a41d-2e638535007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:57.534233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:57.567665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4e4a33de-26bf-4935-a317-e0a3f4e21c3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '499db61d9c2f46cd841f39fafa935d8a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:57.568469 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4e4a33de-26bf-4935-a317-e0a3f4e21c3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '499db61d9c2f46cd841f39fafa935d8a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:57.604151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4e4a33de-26bf-4935-a317-e0a3f4e21c3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '499db61d9c2f46cd841f39fafa935d8a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:57.623213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4e4a33de-26bf-4935-a317-e0a3f4e21c3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '499db61d9c2f46cd841f39fafa935d8a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:57.640419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 820/1660] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:35:56 2022] DELETE /identity/v3/users/499db61d9c2f46cd841f39fafa935d8a => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:57.646796 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e28774-60fe-4e28-ae9d-36170722cf85 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:57.648577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e28774-60fe-4e28-ae9d-36170722cf85 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:57.648863 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e28774-60fe-4e28-ae9d-36170722cf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:57.693977 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 841/1661] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:57.699094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-60e28774-60fe-4e28-ae9d-36170722cf85 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:57.700610 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-60e28774-60fe-4e28-ae9d-36170722cf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:57.706248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0609b-6908-4b2d-87c2-7e893d9c1d7e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:57.706541 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0609b-6908-4b2d-87c2-7e893d9c1d7e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:57.706985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0609b-6908-4b2d-87c2-7e893d9c1d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:57.738807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-30c0609b-6908-4b2d-87c2-7e893d9c1d7e None None] MFA Rules not processed for user `5e3abbae6fea4203b3f0fc3dfe1ca39b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:57.739855 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-30c0609b-6908-4b2d-87c2-7e893d9c1d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:57.840551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 842/1662] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:57.843343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f63ecb-1f41-4cf7-8d4f-4fe9377aa3b0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:57.843782 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f63ecb-1f41-4cf7-8d4f-4fe9377aa3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:57.845307 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f63ecb-1f41-4cf7-8d4f-4fe9377aa3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:57.848081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 821/1663] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:57.859255 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e28774-60fe-4e28-ae9d-36170722cf85 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:57.860670 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-60e28774-60fe-4e28-ae9d-36170722cf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:57.918628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-63f63ecb-1f41-4cf7-8d4f-4fe9377aa3b0 None None] MFA Rules not processed for user `4e02355dec5d4bc38e6c5176a4c9977b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:57.920196 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-63f63ecb-1f41-4cf7-8d4f-4fe9377aa3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:58.028200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e28774-60fe-4e28-ae9d-36170722cf85 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:58.042423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124d48b-9476-4116-a4e9-8721a09af989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:58.043117 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124d48b-9476-4116-a4e9-8721a09af989 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:58.043402 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124d48b-9476-4116-a4e9-8721a09af989 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:58.045179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124d48b-9476-4116-a4e9-8721a09af989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:58.064622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124d48b-9476-4116-a4e9-8721a09af989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:58.069461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124d48b-9476-4116-a4e9-8721a09af989 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:58.090038 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 843/1664] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:35:57 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:58.090038 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f63ecb-1f41-4cf7-8d4f-4fe9377aa3b0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:58.100122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 822/1665] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:58.111730 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-63f63ecb-1f41-4cf7-8d4f-4fe9377aa3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:58.281350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f63ecb-1f41-4cf7-8d4f-4fe9377aa3b0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:58.298745 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13b023-b1c3-473a-b675-5de17b2bd8d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:58.299698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13b023-b1c3-473a-b675-5de17b2bd8d1 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:58.300760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13b023-b1c3-473a-b675-5de17b2bd8d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:58.302384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13b023-b1c3-473a-b675-5de17b2bd8d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:58.313472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13b023-b1c3-473a-b675-5de17b2bd8d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:58.315470 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13b023-b1c3-473a-b675-5de17b2bd8d1 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:58.329788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 844/1666] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:58.961402 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bfefa-d10c-4760-9620-7644dd548dbb None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:58.992789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bfefa-d10c-4760-9620-7644dd548dbb None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:58.992789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bfefa-d10c-4760-9620-7644dd548dbb None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:58.992789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 823/1667] 10.222.0.16 () {54 vars in 912 bytes} [Wed Jul 20 19:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:35:58.993671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cadb0-ef8f-4cfd-a3a7-9fb8968a839d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:58.993671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cadb0-ef8f-4cfd-a3a7-9fb8968a839d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:58.993671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cadb0-ef8f-4cfd-a3a7-9fb8968a839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:59.115897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-dd2cadb0-ef8f-4cfd-a3a7-9fb8968a839d None None] MFA Rules not processed for user `454b9259519c4332a8a36131c8273786`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:59.117443 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dd2cadb0-ef8f-4cfd-a3a7-9fb8968a839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:59.140704 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 845/1668] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 20 19:35:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:59.271368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bfefa-d10c-4760-9620-7644dd548dbb None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:59.318374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bfefa-d10c-4760-9620-7644dd548dbb None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:59.327625 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e19c5d-4001-431e-8939-4e616823d650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:59.328392 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e19c5d-4001-431e-8939-4e616823d650 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:59.329212 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e19c5d-4001-431e-8939-4e616823d650 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:59.329498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e19c5d-4001-431e-8939-4e616823d650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:59.351452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e19c5d-4001-431e-8939-4e616823d650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:59.352919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e19c5d-4001-431e-8939-4e616823d650 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:59.369671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:59.390536 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 824/1669] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:59.746509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cadb0-ef8f-4cfd-a3a7-9fb8968a839d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:59.749588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dd2cadb0-ef8f-4cfd-a3a7-9fb8968a839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:59.795419 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cadb0-ef8f-4cfd-a3a7-9fb8968a839d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:59.800796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e245d23-8cfe-428f-b114-681ee137786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:59.801687 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e245d23-8cfe-428f-b114-681ee137786d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:59.801969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e245d23-8cfe-428f-b114-681ee137786d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:59.802245 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e245d23-8cfe-428f-b114-681ee137786d admin admin] PATH_INFO: `/v3/projects/09f91f26c1854053aa33065fbc4b542b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:59.803745 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e245d23-8cfe-428f-b114-681ee137786d admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f91f26c1854053aa33065fbc4b542b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:59.805871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e245d23-8cfe-428f-b114-681ee137786d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:00.005939 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e245d23-8cfe-428f-b114-681ee137786d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f91f26c1854053aa33065fbc4b542b', 'request_id': 'req-1e245d23-8cfe-428f-b114-681ee137786d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:00.029719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e245d23-8cfe-428f-b114-681ee137786d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f91f26c1854053aa33065fbc4b542b', 'request_id': 'req-1e245d23-8cfe-428f-b114-681ee137786d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:00.129155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e245d23-8cfe-428f-b114-681ee137786d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f91f26c1854053aa33065fbc4b542b', 'request_id': 'req-1e245d23-8cfe-428f-b114-681ee137786d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:00.147172 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e245d23-8cfe-428f-b114-681ee137786d admin admin] The token cache is being invalidate because project 09f91f26c1854053aa33065fbc4b542b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:00.147624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e245d23-8cfe-428f-b114-681ee137786d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:00.149636 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e245d23-8cfe-428f-b114-681ee137786d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:00.163961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 846/1670] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:35:59 2022] DELETE /identity/v3/projects/09f91f26c1854053aa33065fbc4b542b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:00.167055 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e19c5d-4001-431e-8939-4e616823d650 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:00.183689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e19c5d-4001-431e-8939-4e616823d650 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:00.217195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:00.405417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48beb5f8-6999-4d7f-bfd1-4f9c64736628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:00.420179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beb5f8-6999-4d7f-bfd1-4f9c64736628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:00.420179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beb5f8-6999-4d7f-bfd1-4f9c64736628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:00.420461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beb5f8-6999-4d7f-bfd1-4f9c64736628 admin admin] PATH_INFO: `/v3/users/f42b820a76ef441bbb6904e0039dc4dd` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:00.426651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48beb5f8-6999-4d7f-bfd1-4f9c64736628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42b820a76ef441bbb6904e0039dc4dd)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:00.434062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48beb5f8-6999-4d7f-bfd1-4f9c64736628 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:00.691545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808de68-49c6-4287-a835-bef8ead8488c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:00.691545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808de68-49c6-4287-a835-bef8ead8488c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:00.691545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808de68-49c6-4287-a835-bef8ead8488c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:00.691545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 847/1671] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jul 20 19:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:36:00.709122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d31cb1-3da2-4d66-aee3-91b1c637be1a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:00.709759 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d31cb1-3da2-4d66-aee3-91b1c637be1a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:00.710237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d31cb1-3da2-4d66-aee3-91b1c637be1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:00.731816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-48beb5f8-6999-4d7f-bfd1-4f9c64736628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42b820a76ef441bbb6904e0039dc4dd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:00.758327 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c0d31cb1-3da2-4d66-aee3-91b1c637be1a None None] MFA Rules not processed for user `dbc616ed904d43d2b160b8d2766f7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:00.762629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c0d31cb1-3da2-4d66-aee3-91b1c637be1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:00.854091 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-48beb5f8-6999-4d7f-bfd1-4f9c64736628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42b820a76ef441bbb6904e0039dc4dd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:00.855835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-48beb5f8-6999-4d7f-bfd1-4f9c64736628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42b820a76ef441bbb6904e0039dc4dd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:00.883125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-48beb5f8-6999-4d7f-bfd1-4f9c64736628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42b820a76ef441bbb6904e0039dc4dd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:00.904487 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-48beb5f8-6999-4d7f-bfd1-4f9c64736628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42b820a76ef441bbb6904e0039dc4dd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:00.940074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 825/1672] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:00 2022] DELETE /identity/v3/users/f42b820a76ef441bbb6904e0039dc4dd => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:00.971178 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48beb5f8-6999-4d7f-bfd1-4f9c64736628 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:00.983373 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 848/1673] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jul 20 19:36:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 20 19:36:01.059876 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48beb5f8-6999-4d7f-bfd1-4f9c64736628 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:01.094256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a156d-704b-4a64-9b3c-bf37f3060dc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc616ed904d43d2b160b8d2766f7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:01.096019 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a156d-704b-4a64-9b3c-bf37f3060dc6 service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:01.096877 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a156d-704b-4a64-9b3c-bf37f3060dc6 service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:01.097494 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a156d-704b-4a64-9b3c-bf37f3060dc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:01.100086 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-eb8a156d-704b-4a64-9b3c-bf37f3060dc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:01.127404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a156d-704b-4a64-9b3c-bf37f3060dc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:01.127404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a156d-704b-4a64-9b3c-bf37f3060dc6 service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:01.158876 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 826/1674] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:01.808804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06ad2e-f577-41b3-a2f6-c5bd6108d4f2 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:01.817112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06ad2e-f577-41b3-a2f6-c5bd6108d4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:01.817112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06ad2e-f577-41b3-a2f6-c5bd6108d4f2 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:01.817112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 849/1675] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 20 19:36:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:36:01.826520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b3876-ec09-4dd6-acc4-ab39def31a7a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:01.827572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b3876-ec09-4dd6-acc4-ab39def31a7a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:01.828072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b3876-ec09-4dd6-acc4-ab39def31a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:01.875525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d03b3876-ec09-4dd6-acc4-ab39def31a7a None None] MFA Rules not processed for user `dbc616ed904d43d2b160b8d2766f7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:01.877192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d03b3876-ec09-4dd6-acc4-ab39def31a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:01.899352 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06ad2e-f577-41b3-a2f6-c5bd6108d4f2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:01.902162 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5a06ad2e-f577-41b3-a2f6-c5bd6108d4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:01.943177 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 827/1676] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 20 19:36:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:36:01.996395 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:02.025130 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b3876-ec09-4dd6-acc4-ab39def31a7a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:02.030813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d03b3876-ec09-4dd6-acc4-ab39def31a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:02.070052 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b3876-ec09-4dd6-acc4-ab39def31a7a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:02.127772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c49e40-c04d-4455-85b1-0b2c4286f32f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc616ed904d43d2b160b8d2766f7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:02.129512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c49e40-c04d-4455-85b1-0b2c4286f32f service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:02.131037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c49e40-c04d-4455-85b1-0b2c4286f32f service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:02.133572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c49e40-c04d-4455-85b1-0b2c4286f32f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:02.195044 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c49e40-c04d-4455-85b1-0b2c4286f32f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:02.197593 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06ad2e-f577-41b3-a2f6-c5bd6108d4f2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:02.197793 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c49e40-c04d-4455-85b1-0b2c4286f32f service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:02.215559 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace77a76-b1b3-407c-8634-5b7667158589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:02.216256 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace77a76-b1b3-407c-8634-5b7667158589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:02.216537 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace77a76-b1b3-407c-8634-5b7667158589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:02.217401 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 828/1677] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:36:02.218512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c49e40-c04d-4455-85b1-0b2c4286f32f service placement] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:02.221814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace77a76-b1b3-407c-8634-5b7667158589 admin admin] PATH_INFO: `/v3/users/0c82e97093b94a688475a7876e1b9c05` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:02.225636 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-34c49e40-c04d-4455-85b1-0b2c4286f32f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:02.228425 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace77a76-b1b3-407c-8634-5b7667158589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c82e97093b94a688475a7876e1b9c05)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:02.229251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-ace77a76-b1b3-407c-8634-5b7667158589 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:36:02.229251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: warnings.warn(msg) Jul 20 19:36:02.229251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: Jul 20 19:36:02.233752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace77a76-b1b3-407c-8634-5b7667158589 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:02.307657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c49e40-c04d-4455-85b1-0b2c4286f32f service placement] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:02.332792 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2fd6a-fed9-4ea8-ab53-c9b80c5410b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:02.333698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2fd6a-fed9-4ea8-ab53-c9b80c5410b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:02.333987 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2fd6a-fed9-4ea8-ab53-c9b80c5410b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:02.334262 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2fd6a-fed9-4ea8-ab53-c9b80c5410b7 admin admin] PATH_INFO: `/v3/users/29699d4182424a95bc151c7467fe4f35` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:02.346624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2fd6a-fed9-4ea8-ab53-c9b80c5410b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29699d4182424a95bc151c7467fe4f35)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:02.368627 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2fd6a-fed9-4ea8-ab53-c9b80c5410b7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:02.607040 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ace77a76-b1b3-407c-8634-5b7667158589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c82e97093b94a688475a7876e1b9c05'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:02.686376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-19f2fd6a-fed9-4ea8-ab53-c9b80c5410b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29699d4182424a95bc151c7467fe4f35'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:02.703549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ace77a76-b1b3-407c-8634-5b7667158589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c82e97093b94a688475a7876e1b9c05'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:02.730197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ace77a76-b1b3-407c-8634-5b7667158589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c82e97093b94a688475a7876e1b9c05'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:02.787014 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-19f2fd6a-fed9-4ea8-ab53-c9b80c5410b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29699d4182424a95bc151c7467fe4f35'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:02.787825 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-19f2fd6a-fed9-4ea8-ab53-c9b80c5410b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29699d4182424a95bc151c7467fe4f35'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:02.801200 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ace77a76-b1b3-407c-8634-5b7667158589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c82e97093b94a688475a7876e1b9c05'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:02.805522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ace77a76-b1b3-407c-8634-5b7667158589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c82e97093b94a688475a7876e1b9c05'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:02.816363 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-19f2fd6a-fed9-4ea8-ab53-c9b80c5410b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29699d4182424a95bc151c7467fe4f35'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:02.841868 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 850/1678] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:01 2022] DELETE /identity/v3/users/0c82e97093b94a688475a7876e1b9c05 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:02.841868 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a09cd8-4ef9-4178-a082-8a91555fb80f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:02.841868 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a09cd8-4ef9-4178-a082-8a91555fb80f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:02.841868 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a09cd8-4ef9-4178-a082-8a91555fb80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:02.848479 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-19f2fd6a-fed9-4ea8-ab53-c9b80c5410b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29699d4182424a95bc151c7467fe4f35'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:02.864323 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 829/1679] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:02 2022] DELETE /identity/v3/users/29699d4182424a95bc151c7467fe4f35 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:02.888028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35f96d-08b6-4343-968d-f91014d857e1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:02.888672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35f96d-08b6-4343-968d-f91014d857e1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:02.889298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35f96d-08b6-4343-968d-f91014d857e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:02.918719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-36a09cd8-4ef9-4178-a082-8a91555fb80f None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:02.939152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-36a09cd8-4ef9-4178-a082-8a91555fb80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:02.940055 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-cd35f96d-08b6-4343-968d-f91014d857e1 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:02.942161 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cd35f96d-08b6-4343-968d-f91014d857e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:03.109499 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 851/1680] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:36:03.133520 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 830/1681] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:03.141148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a09cd8-4ef9-4178-a082-8a91555fb80f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:03.143684 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-36a09cd8-4ef9-4178-a082-8a91555fb80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:03.166997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35f96d-08b6-4343-968d-f91014d857e1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:03.166997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cd35f96d-08b6-4343-968d-f91014d857e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:03.308632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a09cd8-4ef9-4178-a082-8a91555fb80f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:03.314214 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb004a5c-cae4-44ee-b797-2f42cdae4be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:03.315128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb004a5c-cae4-44ee-b797-2f42cdae4be0 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:03.315584 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb004a5c-cae4-44ee-b797-2f42cdae4be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:03.316039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb004a5c-cae4-44ee-b797-2f42cdae4be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:03.350440 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb004a5c-cae4-44ee-b797-2f42cdae4be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:03.354703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb004a5c-cae4-44ee-b797-2f42cdae4be0 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:03.357338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35f96d-08b6-4343-968d-f91014d857e1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:03.374857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09473127-77f3-4175-becc-4edc62726c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:03.384246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09473127-77f3-4175-becc-4edc62726c1a service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:03.386031 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09473127-77f3-4175-becc-4edc62726c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:03.386784 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09473127-77f3-4175-becc-4edc62726c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:03.394633 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 852/1682] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:03.440168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09473127-77f3-4175-becc-4edc62726c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:03.459278 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09473127-77f3-4175-becc-4edc62726c1a service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:03.476988 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 831/1683] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:03.600355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb004a5c-cae4-44ee-b797-2f42cdae4be0 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:03.602581 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cb004a5c-cae4-44ee-b797-2f42cdae4be0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:03.644219 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:03.648142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb004a5c-cae4-44ee-b797-2f42cdae4be0 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:03.667534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4704de4-60e5-483c-a19f-5a180d0a0646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:03.668831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4704de4-60e5-483c-a19f-5a180d0a0646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:03.669114 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4704de4-60e5-483c-a19f-5a180d0a0646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:03.669390 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4704de4-60e5-483c-a19f-5a180d0a0646 admin admin] PATH_INFO: `/v3/projects/1a72903a1b4844519969c76be879c0be` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:03.671553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4704de4-60e5-483c-a19f-5a180d0a0646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a72903a1b4844519969c76be879c0be)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:03.673766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4704de4-60e5-483c-a19f-5a180d0a0646 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:03.892241 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4704de4-60e5-483c-a19f-5a180d0a0646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a72903a1b4844519969c76be879c0be', 'request_id': 'req-b4704de4-60e5-483c-a19f-5a180d0a0646'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:03.905404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4704de4-60e5-483c-a19f-5a180d0a0646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a72903a1b4844519969c76be879c0be', 'request_id': 'req-b4704de4-60e5-483c-a19f-5a180d0a0646'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:03.989606 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4704de4-60e5-483c-a19f-5a180d0a0646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a72903a1b4844519969c76be879c0be', 'request_id': 'req-b4704de4-60e5-483c-a19f-5a180d0a0646'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:04.012781 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4704de4-60e5-483c-a19f-5a180d0a0646 admin admin] The token cache is being invalidate because project 1a72903a1b4844519969c76be879c0be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:04.013080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4704de4-60e5-483c-a19f-5a180d0a0646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:04.013815 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4704de4-60e5-483c-a19f-5a180d0a0646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:04.016061 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 853/1684] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:03 2022] DELETE /identity/v3/projects/1a72903a1b4844519969c76be879c0be => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:04.020816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e40c50-d970-4947-817c-68fb7eba6267 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:04.029282 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e40c50-d970-4947-817c-68fb7eba6267 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:04.029282 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e40c50-d970-4947-817c-68fb7eba6267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:04.092135 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d8e40c50-d970-4947-817c-68fb7eba6267 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:04.093855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d8e40c50-d970-4947-817c-68fb7eba6267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:04.339930 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 832/1685] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:04.347387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960712e-e2b3-4432-8388-25e5e8f5eddc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:04.347387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960712e-e2b3-4432-8388-25e5e8f5eddc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:04.347387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960712e-e2b3-4432-8388-25e5e8f5eddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:04.383839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d960712e-e2b3-4432-8388-25e5e8f5eddc None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:04.387870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d960712e-e2b3-4432-8388-25e5e8f5eddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:04.418778 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 854/1686] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:04.423252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e40c50-d970-4947-817c-68fb7eba6267 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:04.448097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e40c50-d970-4947-817c-68fb7eba6267 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:04.466088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859abb10-9d4d-435d-8d1f-b51742865d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:04.466971 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859abb10-9d4d-435d-8d1f-b51742865d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:04.467254 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859abb10-9d4d-435d-8d1f-b51742865d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:04.467677 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859abb10-9d4d-435d-8d1f-b51742865d04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:04.468292 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859abb10-9d4d-435d-8d1f-b51742865d04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:04.468593 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859abb10-9d4d-435d-8d1f-b51742865d04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:04.470243 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859abb10-9d4d-435d-8d1f-b51742865d04 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:04.532084 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 833/1687] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:04.537150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960712e-e2b3-4432-8388-25e5e8f5eddc None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:04.588784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960712e-e2b3-4432-8388-25e5e8f5eddc None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:04.604381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40995ee-4d2e-4974-bf4e-723a7644d6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:04.608368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40995ee-4d2e-4974-bf4e-723a7644d6cb admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:04.608368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40995ee-4d2e-4974-bf4e-723a7644d6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:04.608368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40995ee-4d2e-4974-bf4e-723a7644d6cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:04.608368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40995ee-4d2e-4974-bf4e-723a7644d6cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:04.610419 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40995ee-4d2e-4974-bf4e-723a7644d6cb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:04.692103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48045bbf-ed53-49ee-8cb4-eab6e86f8ac6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:04.692887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48045bbf-ed53-49ee-8cb4-eab6e86f8ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:04.693555 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48045bbf-ed53-49ee-8cb4-eab6e86f8ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:04.754319 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 855/1688] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:04 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:04.764761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40995ee-4d2e-4974-bf4e-723a7644d6cb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:04.792171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-48045bbf-ed53-49ee-8cb4-eab6e86f8ac6 None None] MFA Rules not processed for user `a46612adeaa0450d94c0e10eb385d083`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:04.794155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-48045bbf-ed53-49ee-8cb4-eab6e86f8ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:04.875421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40995ee-4d2e-4974-bf4e-723a7644d6cb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:04.883720 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e780d-8e04-416e-94b8-86543a5a3b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:04.884625 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e780d-8e04-416e-94b8-86543a5a3b2c admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:04.885201 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e780d-8e04-416e-94b8-86543a5a3b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:04.885737 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e780d-8e04-416e-94b8-86543a5a3b2c admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:04.886629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e780d-8e04-416e-94b8-86543a5a3b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:04.889680 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e780d-8e04-416e-94b8-86543a5a3b2c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:05.000736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 856/1689] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:04 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:36:05.001721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 834/1690] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:05.005005 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e780d-8e04-416e-94b8-86543a5a3b2c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:05.020120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e771f-a394-4b4a-97c5-4e1cdd6197e8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:05.023380 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e771f-a394-4b4a-97c5-4e1cdd6197e8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:05.023380 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e771f-a394-4b4a-97c5-4e1cdd6197e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:05.047513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e780d-8e04-416e-94b8-86543a5a3b2c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:05.069927 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b6ef4-7d27-499a-8c20-0c4ac482a696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:05.070812 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b6ef4-7d27-499a-8c20-0c4ac482a696 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:05.074887 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b6ef4-7d27-499a-8c20-0c4ac482a696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:05.074887 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b6ef4-7d27-499a-8c20-0c4ac482a696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:05.074887 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b6ef4-7d27-499a-8c20-0c4ac482a696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:05.074887 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b6ef4-7d27-499a-8c20-0c4ac482a696 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:05.076349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0f5e771f-a394-4b4a-97c5-4e1cdd6197e8 None None] MFA Rules not processed for user `a46612adeaa0450d94c0e10eb385d083`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:05.079363 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0f5e771f-a394-4b4a-97c5-4e1cdd6197e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:05.103110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 835/1691] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:05.109142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e771f-a394-4b4a-97c5-4e1cdd6197e8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:05.110248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 857/1692] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:05.121075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b6ef4-7d27-499a-8c20-0c4ac482a696 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:05.121539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-171b6ef4-7d27-499a-8c20-0c4ac482a696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:05.131540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e771f-a394-4b4a-97c5-4e1cdd6197e8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:05.149719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d299bc-d3da-406b-bf5f-f4f273deca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:05.150938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d299bc-d3da-406b-bf5f-f4f273deca26 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:05.153427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d299bc-d3da-406b-bf5f-f4f273deca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:05.154044 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d299bc-d3da-406b-bf5f-f4f273deca26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:05.156420 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d299bc-d3da-406b-bf5f-f4f273deca26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:05.162481 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d299bc-d3da-406b-bf5f-f4f273deca26 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:05.191326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 836/1693] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:05.198556 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d299bc-d3da-406b-bf5f-f4f273deca26 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:05.215241 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d299bc-d3da-406b-bf5f-f4f273deca26 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:05.224852 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff645e-4bd9-4c55-bd95-bf036a282d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:05.226207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff645e-4bd9-4c55-bd95-bf036a282d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:05.227585 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff645e-4bd9-4c55-bd95-bf036a282d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:05.229222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff645e-4bd9-4c55-bd95-bf036a282d7b admin admin] PATH_INFO: `/v3/projects/13c29f233e6749169f48efe00e6531c7/users/6154489f911d4bd69497da4f9a0d04be/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:05.249307 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff645e-4bd9-4c55-bd95-bf036a282d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c29f233e6749169f48efe00e6531c7, user_id=6154489f911d4bd69497da4f9a0d04be, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:05.254646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff645e-4bd9-4c55-bd95-bf036a282d7b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:05.322485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b6ef4-7d27-499a-8c20-0c4ac482a696 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:05.338501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5721ef-82b4-4e34-b9c2-3657e9ee8318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:05.340735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5721ef-82b4-4e34-b9c2-3657e9ee8318 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:05.340735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5721ef-82b4-4e34-b9c2-3657e9ee8318 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:05.340735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5721ef-82b4-4e34-b9c2-3657e9ee8318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:05.351500 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5721ef-82b4-4e34-b9c2-3657e9ee8318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:05.354805 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5721ef-82b4-4e34-b9c2-3657e9ee8318 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:05.367529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 858/1694] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:05.368814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5721ef-82b4-4e34-b9c2-3657e9ee8318 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:05.371500 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fd5721ef-82b4-4e34-b9c2-3657e9ee8318 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:05.375336 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 837/1695] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:05 2022] PUT /identity/v3/projects/13c29f233e6749169f48efe00e6531c7/users/6154489f911d4bd69497da4f9a0d04be/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:05.388436 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1c96d-933a-4a6f-abe4-6125d733b410 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:05.389038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1c96d-933a-4a6f-abe4-6125d733b410 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:05.389524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1c96d-933a-4a6f-abe4-6125d733b410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:05.411557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5721ef-82b4-4e34-b9c2-3657e9ee8318 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:05.441584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8bd1c96d-933a-4a6f-abe4-6125d733b410 None None] MFA Rules not processed for user `6154489f911d4bd69497da4f9a0d04be`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:05.444354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8bd1c96d-933a-4a6f-abe4-6125d733b410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:05.479080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:05.579558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5fbec-72ee-44fc-885b-30614f3a9db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:05.580564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5fbec-72ee-44fc-885b-30614f3a9db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:05.580828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5fbec-72ee-44fc-885b-30614f3a9db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:05.581125 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5fbec-72ee-44fc-885b-30614f3a9db6 admin admin] PATH_INFO: `/v3/users/8f9ec5b59a0440bc9c11e0235a3b9595` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:05.583282 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 838/1696] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:05.584729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8163bf3-ce20-4c54-bb55-2dc5eb0693f5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:05.585178 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8163bf3-ce20-4c54-bb55-2dc5eb0693f5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:05.585474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8163bf3-ce20-4c54-bb55-2dc5eb0693f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:05.587237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5fbec-72ee-44fc-885b-30614f3a9db6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9ec5b59a0440bc9c11e0235a3b9595)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:05.589168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5fbec-72ee-44fc-885b-30614f3a9db6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:05.639484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c8163bf3-ce20-4c54-bb55-2dc5eb0693f5 None None] MFA Rules not processed for user `27e9d71846d840c4899ab2cbcd773a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:05.640892 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c8163bf3-ce20-4c54-bb55-2dc5eb0693f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:05.831815 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 839/1697] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:05.833350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8163bf3-ce20-4c54-bb55-2dc5eb0693f5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:05.864285 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8163bf3-ce20-4c54-bb55-2dc5eb0693f5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:05.880318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3fc6c-937a-4277-8f0d-22809bf15a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:05.881621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3fc6c-937a-4277-8f0d-22809bf15a58 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:05.881904 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3fc6c-937a-4277-8f0d-22809bf15a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:05.882179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3fc6c-937a-4277-8f0d-22809bf15a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:05.882926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3fc6c-937a-4277-8f0d-22809bf15a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:05.887181 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3fc6c-937a-4277-8f0d-22809bf15a58 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:05.927448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-32f5fbec-72ee-44fc-885b-30614f3a9db6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9ec5b59a0440bc9c11e0235a3b9595'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:06.023731 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 840/1698] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:05 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:06.025629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3fc6c-937a-4277-8f0d-22809bf15a58 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:06.029658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b8a3fc6c-937a-4277-8f0d-22809bf15a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:06.038514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-32f5fbec-72ee-44fc-885b-30614f3a9db6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9ec5b59a0440bc9c11e0235a3b9595'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:06.053148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-32f5fbec-72ee-44fc-885b-30614f3a9db6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9ec5b59a0440bc9c11e0235a3b9595'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:06.126167 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-32f5fbec-72ee-44fc-885b-30614f3a9db6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9ec5b59a0440bc9c11e0235a3b9595'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:06.127399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-32f5fbec-72ee-44fc-885b-30614f3a9db6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9ec5b59a0440bc9c11e0235a3b9595'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:06.143816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 859/1699] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:05 2022] DELETE /identity/v3/users/8f9ec5b59a0440bc9c11e0235a3b9595 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:06.145098 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5fbec-72ee-44fc-885b-30614f3a9db6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:06.157419 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-32f5fbec-72ee-44fc-885b-30614f3a9db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:06.243348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3fc6c-937a-4277-8f0d-22809bf15a58 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:06.333440 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5fbec-72ee-44fc-885b-30614f3a9db6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:06.366226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fed9a5-0929-48c0-9ece-bf0998d42552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:06.367166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fed9a5-0929-48c0-9ece-bf0998d42552 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:06.367597 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fed9a5-0929-48c0-9ece-bf0998d42552 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:06.368046 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fed9a5-0929-48c0-9ece-bf0998d42552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:06.376311 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e2fed9a5-0929-48c0-9ece-bf0998d42552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:06.412648 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:06.413643 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:06.413977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:06.414256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] PATH_INFO: `/v3/projects/5edb950587ac48b28d3e600db5782fbc` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:06.420082 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5edb950587ac48b28d3e600db5782fbc)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:06.421159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:36:06.421159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: warnings.warn(msg) Jul 20 19:36:06.421159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: Jul 20 19:36:06.424658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:06.528412 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fed9a5-0929-48c0-9ece-bf0998d42552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:06.532592 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fed9a5-0929-48c0-9ece-bf0998d42552 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:06.569809 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 860/1700] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:06.575340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fed9a5-0929-48c0-9ece-bf0998d42552 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:06.577079 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e2fed9a5-0929-48c0-9ece-bf0998d42552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:06.585003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:06.605453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fed9a5-0929-48c0-9ece-bf0998d42552 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:06.621270 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5edb950587ac48b28d3e600db5782fbc', 'request_id': 'req-0ffc3955-0382-4eea-baa5-998389280baf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:06.707735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5edb950587ac48b28d3e600db5782fbc', 'request_id': 'req-0ffc3955-0382-4eea-baa5-998389280baf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:06.718093 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5edb950587ac48b28d3e600db5782fbc', 'request_id': 'req-0ffc3955-0382-4eea-baa5-998389280baf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:06.751450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] The token cache is being invalidate because project 5edb950587ac48b28d3e600db5782fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:06.751854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:06.752945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:06.758581 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 841/1701] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:06 2022] DELETE /identity/v3/projects/5edb950587ac48b28d3e600db5782fbc => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:06.759752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:06.761281 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:06.812588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4284b64-45b3-451b-a4b2-9f539fd4f3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:06.813427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4284b64-45b3-451b-a4b2-9f539fd4f3ee admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:06.813712 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4284b64-45b3-451b-a4b2-9f539fd4f3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:06.813986 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4284b64-45b3-451b-a4b2-9f539fd4f3ee admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:06.814780 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4284b64-45b3-451b-a4b2-9f539fd4f3ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:06.828052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4284b64-45b3-451b-a4b2-9f539fd4f3ee admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:06.946965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 861/1702] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:06 2022] POST /identity/v3/users => generated 299 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:06.946965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4284b64-45b3-451b-a4b2-9f539fd4f3ee admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:06.947257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc3955-0382-4eea-baa5-998389280baf admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:06.948062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f4284b64-45b3-451b-a4b2-9f539fd4f3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:06.951873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a667a9-c353-4331-83ac-d6fdb249f910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:06.952899 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a667a9-c353-4331-83ac-d6fdb249f910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:06.953180 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a667a9-c353-4331-83ac-d6fdb249f910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:06.953452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a667a9-c353-4331-83ac-d6fdb249f910 admin admin] PATH_INFO: `/v3/users/32593038cc0c48baa93c213c2ab26062` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:06.954929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a667a9-c353-4331-83ac-d6fdb249f910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32593038cc0c48baa93c213c2ab26062)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:06.959721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a667a9-c353-4331-83ac-d6fdb249f910 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:06.972783 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4284b64-45b3-451b-a4b2-9f539fd4f3ee admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:06.987848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf75ac7-fa06-4395-8c1d-f731406be6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:06.989341 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf75ac7-fa06-4395-8c1d-f731406be6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:06.989993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf75ac7-fa06-4395-8c1d-f731406be6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:06.991359 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf75ac7-fa06-4395-8c1d-f731406be6b4 admin admin] PATH_INFO: `/v3/projects/8cf503badc8c487ea068fed5ef3fd66e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:06.996796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf75ac7-fa06-4395-8c1d-f731406be6b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cf503badc8c487ea068fed5ef3fd66e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:07.001205 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf75ac7-fa06-4395-8c1d-f731406be6b4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:07.272833 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a6a667a9-c353-4331-83ac-d6fdb249f910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32593038cc0c48baa93c213c2ab26062'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:07.275389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-faf75ac7-fa06-4395-8c1d-f731406be6b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cf503badc8c487ea068fed5ef3fd66e', 'request_id': 'req-faf75ac7-fa06-4395-8c1d-f731406be6b4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:07.297578 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-faf75ac7-fa06-4395-8c1d-f731406be6b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cf503badc8c487ea068fed5ef3fd66e', 'request_id': 'req-faf75ac7-fa06-4395-8c1d-f731406be6b4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:07.445652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a6a667a9-c353-4331-83ac-d6fdb249f910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32593038cc0c48baa93c213c2ab26062'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:07.446340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a6a667a9-c353-4331-83ac-d6fdb249f910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32593038cc0c48baa93c213c2ab26062'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:07.466534 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a6a667a9-c353-4331-83ac-d6fdb249f910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32593038cc0c48baa93c213c2ab26062'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:07.474996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a6a667a9-c353-4331-83ac-d6fdb249f910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32593038cc0c48baa93c213c2ab26062'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:07.484272 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 842/1703] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:06 2022] DELETE /identity/v3/users/32593038cc0c48baa93c213c2ab26062 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:07.487610 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a667a9-c353-4331-83ac-d6fdb249f910 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:07.490442 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a6a667a9-c353-4331-83ac-d6fdb249f910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:07.597960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-faf75ac7-fa06-4395-8c1d-f731406be6b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cf503badc8c487ea068fed5ef3fd66e', 'request_id': 'req-faf75ac7-fa06-4395-8c1d-f731406be6b4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:07.626542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-faf75ac7-fa06-4395-8c1d-f731406be6b4 admin admin] The token cache is being invalidate because project 8cf503badc8c487ea068fed5ef3fd66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:07.626542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-faf75ac7-fa06-4395-8c1d-f731406be6b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:07.626990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-faf75ac7-fa06-4395-8c1d-f731406be6b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:07.630226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 862/1704] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:06 2022] DELETE /identity/v3/projects/8cf503badc8c487ea068fed5ef3fd66e => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:07.631179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf75ac7-fa06-4395-8c1d-f731406be6b4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:07.634048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-faf75ac7-fa06-4395-8c1d-f731406be6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:07.691922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a667a9-c353-4331-83ac-d6fdb249f910 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:07.713422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c0aa8-a7f0-456d-9290-49ff7cff56c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:07.715009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c0aa8-a7f0-456d-9290-49ff7cff56c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:07.717614 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c0aa8-a7f0-456d-9290-49ff7cff56c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:07.718150 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c0aa8-a7f0-456d-9290-49ff7cff56c5 admin admin] PATH_INFO: `/v3/users/90b176d19d40411ba56a084c048e7d07` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:07.724225 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c0aa8-a7f0-456d-9290-49ff7cff56c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90b176d19d40411ba56a084c048e7d07)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:07.730806 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c0aa8-a7f0-456d-9290-49ff7cff56c5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:07.871358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf75ac7-fa06-4395-8c1d-f731406be6b4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:07.896447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f8b37-04bf-4a28-92be-030e935e2066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:07.897588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8b37-04bf-4a28-92be-030e935e2066 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:07.898109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8b37-04bf-4a28-92be-030e935e2066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:07.898599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f8b37-04bf-4a28-92be-030e935e2066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:07.900115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8b37-04bf-4a28-92be-030e935e2066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:07.906716 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f8b37-04bf-4a28-92be-030e935e2066 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:07.990163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 863/1705] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:07.995438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb52b8d-f863-4808-aff0-116ded5f8725 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:07.995932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb52b8d-f863-4808-aff0-116ded5f8725 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:07.996408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb52b8d-f863-4808-aff0-116ded5f8725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:08.074062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb6c0aa8-a7f0-456d-9290-49ff7cff56c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90b176d19d40411ba56a084c048e7d07'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:08.078870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7eb52b8d-f863-4808-aff0-116ded5f8725 None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:08.081596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7eb52b8d-f863-4808-aff0-116ded5f8725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:08.154615 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb6c0aa8-a7f0-456d-9290-49ff7cff56c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90b176d19d40411ba56a084c048e7d07'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:08.156427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb6c0aa8-a7f0-456d-9290-49ff7cff56c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90b176d19d40411ba56a084c048e7d07'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:08.165718 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 864/1706] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 20 19:36:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:08.168716 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba470a5a-93ae-406f-b728-d93235bec548 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:08.169343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba470a5a-93ae-406f-b728-d93235bec548 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:08.169837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba470a5a-93ae-406f-b728-d93235bec548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:08.184358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb6c0aa8-a7f0-456d-9290-49ff7cff56c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90b176d19d40411ba56a084c048e7d07'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:08.203576 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ba470a5a-93ae-406f-b728-d93235bec548 None None] MFA Rules not processed for user `a46612adeaa0450d94c0e10eb385d083`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:08.205406 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ba470a5a-93ae-406f-b728-d93235bec548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:08.218935 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb6c0aa8-a7f0-456d-9290-49ff7cff56c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90b176d19d40411ba56a084c048e7d07'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:08.229645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 843/1707] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:07 2022] DELETE /identity/v3/users/90b176d19d40411ba56a084c048e7d07 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:08.231308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36854d4b-f7c4-44dd-a4ca-66e3155c724d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:08.231739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36854d4b-f7c4-44dd-a4ca-66e3155c724d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:08.232157 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36854d4b-f7c4-44dd-a4ca-66e3155c724d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:08.265129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:08.285801 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-36854d4b-f7c4-44dd-a4ca-66e3155c724d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:08.291779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-36854d4b-f7c4-44dd-a4ca-66e3155c724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:08.320106 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 865/1708] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:08.322785 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba470a5a-93ae-406f-b728-d93235bec548 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:08.339860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ba470a5a-93ae-406f-b728-d93235bec548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:08.391899 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba470a5a-93ae-406f-b728-d93235bec548 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:08.487044 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 844/1709] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:08.488587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34c46e-6eb5-4c7a-bf43-0e27c2915687 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:08.488874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34c46e-6eb5-4c7a-bf43-0e27c2915687 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:08.489149 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34c46e-6eb5-4c7a-bf43-0e27c2915687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:08.515144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3503f3-046b-4440-8389-eca3dde32f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:08.519226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3503f3-046b-4440-8389-eca3dde32f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:08.519548 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3503f3-046b-4440-8389-eca3dde32f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:08.520927 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3503f3-046b-4440-8389-eca3dde32f64 admin admin] PATH_INFO: `/v3/projects/84759abad9864d98af74c57d963f2204` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:08.521306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1a34c46e-6eb5-4c7a-bf43-0e27c2915687 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:08.522764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1a34c46e-6eb5-4c7a-bf43-0e27c2915687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:08.523970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3503f3-046b-4440-8389-eca3dde32f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84759abad9864d98af74c57d963f2204)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:08.527310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3503f3-046b-4440-8389-eca3dde32f64 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:08.535215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 845/1710] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:08.543302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34c46e-6eb5-4c7a-bf43-0e27c2915687 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:08.544733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1a34c46e-6eb5-4c7a-bf43-0e27c2915687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:08.561689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34c46e-6eb5-4c7a-bf43-0e27c2915687 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:08.567821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070188fd-f9b9-4e01-92f2-897b6e99eefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:08.569166 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070188fd-f9b9-4e01-92f2-897b6e99eefe admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:08.569428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070188fd-f9b9-4e01-92f2-897b6e99eefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:08.569698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070188fd-f9b9-4e01-92f2-897b6e99eefe admin admin] PATH_INFO: `/v3/projects/3dc100e7d00e46e1a8dc746302352357/users/e17762a56fce4af68e57d26716b1c6be/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:08.589439 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070188fd-f9b9-4e01-92f2-897b6e99eefe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc100e7d00e46e1a8dc746302352357, user_id=e17762a56fce4af68e57d26716b1c6be, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:08.593163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070188fd-f9b9-4e01-92f2-897b6e99eefe admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:08.700498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 846/1711] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:08 2022] PUT /identity/v3/projects/3dc100e7d00e46e1a8dc746302352357/users/e17762a56fce4af68e57d26716b1c6be/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:08.702768 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79576880-02fd-44be-a666-aae5a57812b8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:08.703345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79576880-02fd-44be-a666-aae5a57812b8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:08.703823 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79576880-02fd-44be-a666-aae5a57812b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:08.756612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-79576880-02fd-44be-a666-aae5a57812b8 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:08.758775 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-79576880-02fd-44be-a666-aae5a57812b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:08.759970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d3503f3-046b-4440-8389-eca3dde32f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84759abad9864d98af74c57d963f2204', 'request_id': 'req-6d3503f3-046b-4440-8389-eca3dde32f64'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:08.774593 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d3503f3-046b-4440-8389-eca3dde32f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84759abad9864d98af74c57d963f2204', 'request_id': 'req-6d3503f3-046b-4440-8389-eca3dde32f64'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:08.875510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d3503f3-046b-4440-8389-eca3dde32f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84759abad9864d98af74c57d963f2204', 'request_id': 'req-6d3503f3-046b-4440-8389-eca3dde32f64'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:08.892739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d3503f3-046b-4440-8389-eca3dde32f64 admin admin] The token cache is being invalidate because project 84759abad9864d98af74c57d963f2204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:08.893027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d3503f3-046b-4440-8389-eca3dde32f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:08.895049 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d3503f3-046b-4440-8389-eca3dde32f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:08.900047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 866/1712] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:08 2022] DELETE /identity/v3/projects/84759abad9864d98af74c57d963f2204 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:08.901008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3503f3-046b-4440-8389-eca3dde32f64 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:08.906438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6d3503f3-046b-4440-8389-eca3dde32f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:08.933542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 847/1713] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:08.933542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79576880-02fd-44be-a666-aae5a57812b8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:08.934193 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-79576880-02fd-44be-a666-aae5a57812b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:08.969576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:09.131714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3503f3-046b-4440-8389-eca3dde32f64 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:09.174010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dbaaa-8499-478d-8bba-be42377f6542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:09.175311 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dbaaa-8499-478d-8bba-be42377f6542 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:09.179027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dbaaa-8499-478d-8bba-be42377f6542 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:09.179789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dbaaa-8499-478d-8bba-be42377f6542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:09.193218 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a27dbaaa-8499-478d-8bba-be42377f6542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:09.215377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79576880-02fd-44be-a666-aae5a57812b8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:09.248012 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd24a6a-f01d-46d6-af1e-5662df840b4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:09.251173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd24a6a-f01d-46d6-af1e-5662df840b4e service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:09.251727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27dbaaa-8499-478d-8bba-be42377f6542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:09.252104 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd24a6a-f01d-46d6-af1e-5662df840b4e service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:09.255858 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd24a6a-f01d-46d6-af1e-5662df840b4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:09.256004 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27dbaaa-8499-478d-8bba-be42377f6542 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:09.260198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1bd24a6a-f01d-46d6-af1e-5662df840b4e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:09.303625 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 867/1714] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:09.306334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dbaaa-8499-478d-8bba-be42377f6542 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:09.310094 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a27dbaaa-8499-478d-8bba-be42377f6542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:09.338192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dbaaa-8499-478d-8bba-be42377f6542 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:09.353984 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ab8b7-7b28-47e0-ba24-66d2d43e1911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:09.355089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ab8b7-7b28-47e0-ba24-66d2d43e1911 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:09.355734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ab8b7-7b28-47e0-ba24-66d2d43e1911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:09.356025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ab8b7-7b28-47e0-ba24-66d2d43e1911 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:09.356938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ab8b7-7b28-47e0-ba24-66d2d43e1911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:09.410513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ab8b7-7b28-47e0-ba24-66d2d43e1911 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:09.443167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd24a6a-f01d-46d6-af1e-5662df840b4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:09.461777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd24a6a-f01d-46d6-af1e-5662df840b4e service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:09.468671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 868/1715] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:09.468671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ab8b7-7b28-47e0-ba24-66d2d43e1911 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:09.478996 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f56ab8b7-7b28-47e0-ba24-66d2d43e1911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:09.491621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 848/1716] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:36:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:36:09.493961 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd24a6a-f01d-46d6-af1e-5662df840b4e service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:09.529315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd24a6a-f01d-46d6-af1e-5662df840b4e service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:09.547824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d05ad9-cd0d-4e4f-8342-02cd40ddf9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:09.549008 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d05ad9-cd0d-4e4f-8342-02cd40ddf9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:09.549341 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d05ad9-cd0d-4e4f-8342-02cd40ddf9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:09.549822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d05ad9-cd0d-4e4f-8342-02cd40ddf9c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:09.552727 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d05ad9-cd0d-4e4f-8342-02cd40ddf9c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:09.553122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d05ad9-cd0d-4e4f-8342-02cd40ddf9c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:09.556388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d05ad9-cd0d-4e4f-8342-02cd40ddf9c2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:09.589482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ab8b7-7b28-47e0-ba24-66d2d43e1911 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:09.606051 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a064d-1676-40d3-a42b-95a224515f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:09.607390 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a064d-1676-40d3-a42b-95a224515f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:09.607926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a064d-1676-40d3-a42b-95a224515f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:09.608985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a064d-1676-40d3-a42b-95a224515f1f admin admin] PATH_INFO: `/v3/users/4e02355dec5d4bc38e6c5176a4c9977b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:09.610771 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a064d-1676-40d3-a42b-95a224515f1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e02355dec5d4bc38e6c5176a4c9977b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:09.619142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a064d-1676-40d3-a42b-95a224515f1f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:09.629052 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 849/1717] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:09.631619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d05ad9-cd0d-4e4f-8342-02cd40ddf9c2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:09.689273 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d05ad9-cd0d-4e4f-8342-02cd40ddf9c2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:09.722523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03598fa3-36d0-461e-8182-bd324b204b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:09.726174 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03598fa3-36d0-461e-8182-bd324b204b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:09.732335 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03598fa3-36d0-461e-8182-bd324b204b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:09.733404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03598fa3-36d0-461e-8182-bd324b204b82 admin admin] PATH_INFO: `/v3/projects/3dc100e7d00e46e1a8dc746302352357/users/e17762a56fce4af68e57d26716b1c6be/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:09.742915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03598fa3-36d0-461e-8182-bd324b204b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc100e7d00e46e1a8dc746302352357, user_id=e17762a56fce4af68e57d26716b1c6be, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:09.750888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03598fa3-36d0-461e-8182-bd324b204b82 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:09.785205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 850/1718] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:09 2022] PUT /identity/v3/projects/3dc100e7d00e46e1a8dc746302352357/users/e17762a56fce4af68e57d26716b1c6be/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:09.796579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03598fa3-36d0-461e-8182-bd324b204b82 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:09.806548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-03598fa3-36d0-461e-8182-bd324b204b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:09.931348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-487a064d-1676-40d3-a42b-95a224515f1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e02355dec5d4bc38e6c5176a4c9977b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:10.046325 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-487a064d-1676-40d3-a42b-95a224515f1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e02355dec5d4bc38e6c5176a4c9977b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:10.057548 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-487a064d-1676-40d3-a42b-95a224515f1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e02355dec5d4bc38e6c5176a4c9977b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:10.105053 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-487a064d-1676-40d3-a42b-95a224515f1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e02355dec5d4bc38e6c5176a4c9977b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:10.121467 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-487a064d-1676-40d3-a42b-95a224515f1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e02355dec5d4bc38e6c5176a4c9977b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:10.128896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 869/1719] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:09 2022] DELETE /identity/v3/users/4e02355dec5d4bc38e6c5176a4c9977b => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:10.137528 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a064d-1676-40d3-a42b-95a224515f1f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:10.157079 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-487a064d-1676-40d3-a42b-95a224515f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:10.189152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03598fa3-36d0-461e-8182-bd324b204b82 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:10.353612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:10.381288 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8970f-92e5-471c-bbdf-6e442249ad57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:10.383475 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8970f-92e5-471c-bbdf-6e442249ad57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:10.385433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8970f-92e5-471c-bbdf-6e442249ad57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:10.386370 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8970f-92e5-471c-bbdf-6e442249ad57 admin admin] PATH_INFO: `/v3/projects/15a70b7b93264315a7ce7ae3480f6080` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:10.392411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a064d-1676-40d3-a42b-95a224515f1f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:10.398106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8970f-92e5-471c-bbdf-6e442249ad57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a70b7b93264315a7ce7ae3480f6080)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:10.404822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8970f-92e5-471c-bbdf-6e442249ad57 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:10.407391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc4590-c3c6-4732-b4a0-8e3cada93740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:10.408209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc4590-c3c6-4732-b4a0-8e3cada93740 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:10.408598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc4590-c3c6-4732-b4a0-8e3cada93740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:10.408976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc4590-c3c6-4732-b4a0-8e3cada93740 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:10.409922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc4590-c3c6-4732-b4a0-8e3cada93740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:10.421976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc4590-c3c6-4732-b4a0-8e3cada93740 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:10.631049 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:10.653639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 870/1720] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:10 2022] POST /identity/v3/projects => generated 373 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:10.653639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d392ba0-a591-4a51-95d6-0f98ad2d40ea None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:10.653639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d392ba0-a591-4a51-95d6-0f98ad2d40ea None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:10.653639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d392ba0-a591-4a51-95d6-0f98ad2d40ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:10.724483 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4cb8970f-92e5-471c-bbdf-6e442249ad57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a70b7b93264315a7ce7ae3480f6080', 'request_id': 'req-4cb8970f-92e5-471c-bbdf-6e442249ad57'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:10.739739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6d392ba0-a591-4a51-95d6-0f98ad2d40ea None None] MFA Rules not processed for user `e17762a56fce4af68e57d26716b1c6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:10.743017 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6d392ba0-a591-4a51-95d6-0f98ad2d40ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:10.832005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4cb8970f-92e5-471c-bbdf-6e442249ad57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a70b7b93264315a7ce7ae3480f6080', 'request_id': 'req-4cb8970f-92e5-471c-bbdf-6e442249ad57'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:10.844853 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4cb8970f-92e5-471c-bbdf-6e442249ad57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a70b7b93264315a7ce7ae3480f6080', 'request_id': 'req-4cb8970f-92e5-471c-bbdf-6e442249ad57'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:10.922560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4cb8970f-92e5-471c-bbdf-6e442249ad57 admin admin] The token cache is being invalidate because project 15a70b7b93264315a7ce7ae3480f6080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:10.922995 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4cb8970f-92e5-471c-bbdf-6e442249ad57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:10.924967 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4cb8970f-92e5-471c-bbdf-6e442249ad57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:10.926893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 851/1721] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:09 2022] DELETE /identity/v3/projects/15a70b7b93264315a7ce7ae3480f6080 => generated 0 bytes in 1131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:10.928671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b8d2d-bdae-4582-b3ca-dd3819c78bd5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:10.928947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b8d2d-bdae-4582-b3ca-dd3819c78bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:10.929221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b8d2d-bdae-4582-b3ca-dd3819c78bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:10.980143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-966b8d2d-bdae-4582-b3ca-dd3819c78bd5 None None] MFA Rules not processed for user `454b9259519c4332a8a36131c8273786`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:10.986539 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-966b8d2d-bdae-4582-b3ca-dd3819c78bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:10.986795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 871/1722] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:10.986898 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9522e64-2085-454b-a87f-9287c7fe59c6 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:10.987328 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9522e64-2085-454b-a87f-9287c7fe59c6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:10.987753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9522e64-2085-454b-a87f-9287c7fe59c6 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:10.991180 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 872/1723] 10.222.0.16 () {54 vars in 912 bytes} [Wed Jul 20 19:36:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:36:10.993685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9522e64-2085-454b-a87f-9287c7fe59c6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:10.996339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c9522e64-2085-454b-a87f-9287c7fe59c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:11.176872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 852/1724] 10.222.0.91 () {58 vars in 1015 bytes} [Wed Jul 20 19:36:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:11.178084 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b8d2d-bdae-4582-b3ca-dd3819c78bd5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:11.182340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-966b8d2d-bdae-4582-b3ca-dd3819c78bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:11.255484 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9522e64-2085-454b-a87f-9287c7fe59c6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:11.279471 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb538d2f-ee72-46bb-a8e3-81139a797bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:11.281188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb538d2f-ee72-46bb-a8e3-81139a797bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:11.284459 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb538d2f-ee72-46bb-a8e3-81139a797bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:11.288506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb538d2f-ee72-46bb-a8e3-81139a797bc1 admin admin] PATH_INFO: `/v3/projects/c9a20009561f45868949046fd68c7847` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:11.291929 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb538d2f-ee72-46bb-a8e3-81139a797bc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a20009561f45868949046fd68c7847)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:11.305826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb538d2f-ee72-46bb-a8e3-81139a797bc1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:11.445887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b8d2d-bdae-4582-b3ca-dd3819c78bd5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:11.457343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243688f4-cf1d-49b8-b334-57bf25ef42cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:11.473269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243688f4-cf1d-49b8-b334-57bf25ef42cf admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:11.473602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243688f4-cf1d-49b8-b334-57bf25ef42cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:11.473903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243688f4-cf1d-49b8-b334-57bf25ef42cf admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:11.474705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243688f4-cf1d-49b8-b334-57bf25ef42cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:11.485028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243688f4-cf1d-49b8-b334-57bf25ef42cf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:11.556121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bb538d2f-ee72-46bb-a8e3-81139a797bc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a20009561f45868949046fd68c7847', 'request_id': 'req-bb538d2f-ee72-46bb-a8e3-81139a797bc1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:11.597909 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bb538d2f-ee72-46bb-a8e3-81139a797bc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a20009561f45868949046fd68c7847', 'request_id': 'req-bb538d2f-ee72-46bb-a8e3-81139a797bc1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:11.678594 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 853/1725] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:11 2022] POST /identity/v3/users => generated 287 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:11.680923 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466aae23-1d57-4b45-a90e-97a49351ba22 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:11.684572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466aae23-1d57-4b45-a90e-97a49351ba22 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:11.690028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466aae23-1d57-4b45-a90e-97a49351ba22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:11.715292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bb538d2f-ee72-46bb-a8e3-81139a797bc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a20009561f45868949046fd68c7847', 'request_id': 'req-bb538d2f-ee72-46bb-a8e3-81139a797bc1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:11.736275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bb538d2f-ee72-46bb-a8e3-81139a797bc1 admin admin] The token cache is being invalidate because project c9a20009561f45868949046fd68c7847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:11.736566 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bb538d2f-ee72-46bb-a8e3-81139a797bc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:11.738131 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bb538d2f-ee72-46bb-a8e3-81139a797bc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:11.745356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 873/1726] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:10 2022] DELETE /identity/v3/projects/c9a20009561f45868949046fd68c7847 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:11.747378 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb538d2f-ee72-46bb-a8e3-81139a797bc1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:11.750352 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bb538d2f-ee72-46bb-a8e3-81139a797bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:11.753906 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-466aae23-1d57-4b45-a90e-97a49351ba22 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:11.756433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-466aae23-1d57-4b45-a90e-97a49351ba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:11.892627 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:11.974073 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 854/1727] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:11.981860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb538d2f-ee72-46bb-a8e3-81139a797bc1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:11.987813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf95abe-1458-49a8-83d9-aff3f82f50f5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:11.989318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf95abe-1458-49a8-83d9-aff3f82f50f5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:11.991878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf95abe-1458-49a8-83d9-aff3f82f50f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:12.022304 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d50b3c-2211-4983-82a0-d2863b602a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:12.026338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d50b3c-2211-4983-82a0-d2863b602a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:12.026338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d50b3c-2211-4983-82a0-d2863b602a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:12.031942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d50b3c-2211-4983-82a0-d2863b602a4f admin admin] PATH_INFO: `/v3/projects/06cb9060f2774a7a82696a1cf48fd738` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:12.043753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d50b3c-2211-4983-82a0-d2863b602a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=06cb9060f2774a7a82696a1cf48fd738)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:12.055182 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8cf95abe-1458-49a8-83d9-aff3f82f50f5 None None] MFA Rules not processed for user `454b9259519c4332a8a36131c8273786`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:12.056902 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8cf95abe-1458-49a8-83d9-aff3f82f50f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:12.059458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d50b3c-2211-4983-82a0-d2863b602a4f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:12.179840 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 855/1728] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 20 19:36:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:12.181864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf95abe-1458-49a8-83d9-aff3f82f50f5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:12.184056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8cf95abe-1458-49a8-83d9-aff3f82f50f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:12.349360 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-93d50b3c-2211-4983-82a0-d2863b602a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06cb9060f2774a7a82696a1cf48fd738', 'request_id': 'req-93d50b3c-2211-4983-82a0-d2863b602a4f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:12.356792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-93d50b3c-2211-4983-82a0-d2863b602a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06cb9060f2774a7a82696a1cf48fd738', 'request_id': 'req-93d50b3c-2211-4983-82a0-d2863b602a4f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:12.360794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf95abe-1458-49a8-83d9-aff3f82f50f5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:12.426018 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:12.476529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-93d50b3c-2211-4983-82a0-d2863b602a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06cb9060f2774a7a82696a1cf48fd738', 'request_id': 'req-93d50b3c-2211-4983-82a0-d2863b602a4f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:12.501510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-93d50b3c-2211-4983-82a0-d2863b602a4f admin admin] The token cache is being invalidate because project 06cb9060f2774a7a82696a1cf48fd738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:12.501895 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-93d50b3c-2211-4983-82a0-d2863b602a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:12.503534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-93d50b3c-2211-4983-82a0-d2863b602a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:12.505997 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 874/1729] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:11 2022] DELETE /identity/v3/projects/06cb9060f2774a7a82696a1cf48fd738 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:12.509005 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d50b3c-2211-4983-82a0-d2863b602a4f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:12.514480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-93d50b3c-2211-4983-82a0-d2863b602a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:12.519521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a6e87-557a-4832-9bb2-db7b7d06f995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:12.520499 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a6e87-557a-4832-9bb2-db7b7d06f995 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:12.522300 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a6e87-557a-4832-9bb2-db7b7d06f995 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:12.522811 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a6e87-557a-4832-9bb2-db7b7d06f995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:12.528347 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9f1a6e87-557a-4832-9bb2-db7b7d06f995 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:12.684126 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a6e87-557a-4832-9bb2-db7b7d06f995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:12.686654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a6e87-557a-4832-9bb2-db7b7d06f995 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:12.697076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d50b3c-2211-4983-82a0-d2863b602a4f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:12.700342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 856/1730] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:12.702219 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a6e87-557a-4832-9bb2-db7b7d06f995 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:12.704096 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9f1a6e87-557a-4832-9bb2-db7b7d06f995 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:12.715926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f05a6c-0452-4298-aa66-756b68940724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:12.720456 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f05a6c-0452-4298-aa66-756b68940724 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:12.720456 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f05a6c-0452-4298-aa66-756b68940724 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:12.720456 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f05a6c-0452-4298-aa66-756b68940724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:12.725617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f8f05a6c-0452-4298-aa66-756b68940724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:12.767728 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f05a6c-0452-4298-aa66-756b68940724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:12.769239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f05a6c-0452-4298-aa66-756b68940724 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:12.819129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 875/1731] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:12.823392 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f05a6c-0452-4298-aa66-756b68940724 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:12.831217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f8f05a6c-0452-4298-aa66-756b68940724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:12.938799 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a6e87-557a-4832-9bb2-db7b7d06f995 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:12.959556 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cedfc-ca0e-4141-92ea-6e265d172d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:12.960090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cedfc-ca0e-4141-92ea-6e265d172d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:12.960377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cedfc-ca0e-4141-92ea-6e265d172d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:12.960671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cedfc-ca0e-4141-92ea-6e265d172d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:12.961469 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cedfc-ca0e-4141-92ea-6e265d172d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:12.966035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cedfc-ca0e-4141-92ea-6e265d172d3b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:13.012928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 857/1732] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:13.030554 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d618a-d4a5-4348-8218-18e207957f4b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:13.036660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d618a-d4a5-4348-8218-18e207957f4b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:13.037071 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d618a-d4a5-4348-8218-18e207957f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:13.088997 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f05a6c-0452-4298-aa66-756b68940724 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:13.104461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0f3d618a-d4a5-4348-8218-18e207957f4b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:13.105723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0f3d618a-d4a5-4348-8218-18e207957f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:13.115536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81df003-f7ce-4765-88dc-0ac67b4915cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:13.116443 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81df003-f7ce-4765-88dc-0ac67b4915cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:13.116919 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81df003-f7ce-4765-88dc-0ac67b4915cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:13.120985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81df003-f7ce-4765-88dc-0ac67b4915cf admin admin] PATH_INFO: `/v3/users/90bb72f63f7943a3a7a0e0aedfe17e17` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:13.122655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81df003-f7ce-4765-88dc-0ac67b4915cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=90bb72f63f7943a3a7a0e0aedfe17e17)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:13.125079 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81df003-f7ce-4765-88dc-0ac67b4915cf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:13.134708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 858/1733] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:13.142230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d618a-d4a5-4348-8218-18e207957f4b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:13.163461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d618a-d4a5-4348-8218-18e207957f4b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:13.171357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ebca2-d5db-4005-9c0f-64cd33da30a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:13.173006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ebca2-d5db-4005-9c0f-64cd33da30a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:13.173709 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ebca2-d5db-4005-9c0f-64cd33da30a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:13.174629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ebca2-d5db-4005-9c0f-64cd33da30a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:13.178874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-649ebca2-d5db-4005-9c0f-64cd33da30a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:13.198031 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ebca2-d5db-4005-9c0f-64cd33da30a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:13.199885 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ebca2-d5db-4005-9c0f-64cd33da30a9 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:13.219160 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 859/1734] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:13.221677 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4f039-a4c8-41b3-b6e4-52c34a47c13e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:13.222708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4f039-a4c8-41b3-b6e4-52c34a47c13e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:13.223299 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4f039-a4c8-41b3-b6e4-52c34a47c13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:13.296546 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-baa4f039-a4c8-41b3-b6e4-52c34a47c13e None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:13.323445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-baa4f039-a4c8-41b3-b6e4-52c34a47c13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:13.351024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 860/1735] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:13.351024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4f039-a4c8-41b3-b6e4-52c34a47c13e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:13.351024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-baa4f039-a4c8-41b3-b6e4-52c34a47c13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:13.380209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4f039-a4c8-41b3-b6e4-52c34a47c13e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:13.387411 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22646671-c59e-4e47-bbf8-f22c12065b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:13.390383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22646671-c59e-4e47-bbf8-f22c12065b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:13.395395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22646671-c59e-4e47-bbf8-f22c12065b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:13.396070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22646671-c59e-4e47-bbf8-f22c12065b27 admin admin] PATH_INFO: `/v3/users/6154489f911d4bd69497da4f9a0d04be` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:13.397794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22646671-c59e-4e47-bbf8-f22c12065b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6154489f911d4bd69497da4f9a0d04be)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:13.405491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22646671-c59e-4e47-bbf8-f22c12065b27 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:13.474933 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b81df003-f7ce-4765-88dc-0ac67b4915cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90bb72f63f7943a3a7a0e0aedfe17e17'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:13.591524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b81df003-f7ce-4765-88dc-0ac67b4915cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90bb72f63f7943a3a7a0e0aedfe17e17'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:13.623035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b81df003-f7ce-4765-88dc-0ac67b4915cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90bb72f63f7943a3a7a0e0aedfe17e17'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:13.689157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b81df003-f7ce-4765-88dc-0ac67b4915cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90bb72f63f7943a3a7a0e0aedfe17e17'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:13.691294 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-22646671-c59e-4e47-bbf8-f22c12065b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6154489f911d4bd69497da4f9a0d04be'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:13.692246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b81df003-f7ce-4765-88dc-0ac67b4915cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90bb72f63f7943a3a7a0e0aedfe17e17'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:13.728505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:13.748248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 876/1736] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:12 2022] DELETE /identity/v3/users/90bb72f63f7943a3a7a0e0aedfe17e17 => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:13.759622 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81df003-f7ce-4765-88dc-0ac67b4915cf admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:13.761248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b81df003-f7ce-4765-88dc-0ac67b4915cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:13.785963 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-22646671-c59e-4e47-bbf8-f22c12065b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6154489f911d4bd69497da4f9a0d04be'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:13.790515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-22646671-c59e-4e47-bbf8-f22c12065b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6154489f911d4bd69497da4f9a0d04be'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:13.843857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-22646671-c59e-4e47-bbf8-f22c12065b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6154489f911d4bd69497da4f9a0d04be'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:13.873966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-22646671-c59e-4e47-bbf8-f22c12065b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6154489f911d4bd69497da4f9a0d04be'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:13.886325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 861/1737] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:13 2022] DELETE /identity/v3/users/6154489f911d4bd69497da4f9a0d04be => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:13.890788 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22646671-c59e-4e47-bbf8-f22c12065b27 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:13.892920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-22646671-c59e-4e47-bbf8-f22c12065b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:14.014445 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:14.029914 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22646671-c59e-4e47-bbf8-f22c12065b27 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:14.038354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03deb253-1dc2-47b9-aaf5-e166d5c38f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:14.038943 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deb253-1dc2-47b9-aaf5-e166d5c38f5f admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:14.039355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deb253-1dc2-47b9-aaf5-e166d5c38f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:14.039699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deb253-1dc2-47b9-aaf5-e166d5c38f5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:14.040606 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03deb253-1dc2-47b9-aaf5-e166d5c38f5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:14.040927 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03deb253-1dc2-47b9-aaf5-e166d5c38f5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:14.042764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03deb253-1dc2-47b9-aaf5-e166d5c38f5f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:14.108937 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81df003-f7ce-4765-88dc-0ac67b4915cf admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:14.119109 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 862/1738] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:14.120187 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a8c58-14be-463e-8cdd-7eda1ffbf037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:14.121104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a8c58-14be-463e-8cdd-7eda1ffbf037 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:14.121358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a8c58-14be-463e-8cdd-7eda1ffbf037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:14.121855 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a8c58-14be-463e-8cdd-7eda1ffbf037 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:14.123058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a4157-1cc7-482d-8f7f-c4a9692b0c45 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:14.123376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a8c58-14be-463e-8cdd-7eda1ffbf037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:14.126512 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a8c58-14be-463e-8cdd-7eda1ffbf037 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:14.126760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a4157-1cc7-482d-8f7f-c4a9692b0c45 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:14.127190 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a4157-1cc7-482d-8f7f-c4a9692b0c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:14.176004 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 877/1739] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:14.177854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e70a8-36d8-4c5b-a033-67e23c6373ab None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:14.177959 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-405a4157-1cc7-482d-8f7f-c4a9692b0c45 None None] MFA Rules not processed for user `27e9d71846d840c4899ab2cbcd773a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:14.178438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e70a8-36d8-4c5b-a033-67e23c6373ab None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:14.178912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e70a8-36d8-4c5b-a033-67e23c6373ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:14.180445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-405a4157-1cc7-482d-8f7f-c4a9692b0c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:14.228673 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-706e70a8-36d8-4c5b-a033-67e23c6373ab None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:14.230966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-706e70a8-36d8-4c5b-a033-67e23c6373ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:14.241953 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 878/1740] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:14.243480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95797af5-2318-4ca7-aaa1-9c11bda0e87e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:14.243917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95797af5-2318-4ca7-aaa1-9c11bda0e87e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:14.244333 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95797af5-2318-4ca7-aaa1-9c11bda0e87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:14.273212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-95797af5-2318-4ca7-aaa1-9c11bda0e87e None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:14.274790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-95797af5-2318-4ca7-aaa1-9c11bda0e87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:14.288688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 863/1741] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:14.290064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a4157-1cc7-482d-8f7f-c4a9692b0c45 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:14.304205 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 879/1742] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:14.308009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95797af5-2318-4ca7-aaa1-9c11bda0e87e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:14.314896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-95797af5-2318-4ca7-aaa1-9c11bda0e87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:14.315535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a4157-1cc7-482d-8f7f-c4a9692b0c45 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:14.318428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce17ce-8540-4c8d-9514-23ff6513d152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:14.319283 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce17ce-8540-4c8d-9514-23ff6513d152 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:14.319696 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce17ce-8540-4c8d-9514-23ff6513d152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:14.320164 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce17ce-8540-4c8d-9514-23ff6513d152 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:14.321390 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce17ce-8540-4c8d-9514-23ff6513d152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:14.323982 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce17ce-8540-4c8d-9514-23ff6513d152 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:14.357705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95797af5-2318-4ca7-aaa1-9c11bda0e87e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:14.365104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57fa79-39c0-4c55-9b78-261c579b4980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:14.369580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57fa79-39c0-4c55-9b78-261c579b4980 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:14.369580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57fa79-39c0-4c55-9b78-261c579b4980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:14.369580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57fa79-39c0-4c55-9b78-261c579b4980 admin admin] PATH_INFO: `/v3/projects/8d68870c0912470e89c4e5845bc9ccca/users/392d29208db14149ae9dbbe7c1998787/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:14.435448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57fa79-39c0-4c55-9b78-261c579b4980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d68870c0912470e89c4e5845bc9ccca, user_id=392d29208db14149ae9dbbe7c1998787, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:14.442191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57fa79-39c0-4c55-9b78-261c579b4980 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:14.468353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 864/1743] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:14 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:14.472079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce17ce-8540-4c8d-9514-23ff6513d152 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:14.559150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 880/1744] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:14 2022] PUT /identity/v3/projects/8d68870c0912470e89c4e5845bc9ccca/users/392d29208db14149ae9dbbe7c1998787/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:14.583447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57fa79-39c0-4c55-9b78-261c579b4980 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:14.588978 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4b57fa79-39c0-4c55-9b78-261c579b4980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:14.765774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce17ce-8540-4c8d-9514-23ff6513d152 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:14.823114 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57fa79-39c0-4c55-9b78-261c579b4980 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:14.838403 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec126-640d-4922-b5c7-4c27f769c95a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:14.839115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec126-640d-4922-b5c7-4c27f769c95a service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:14.840488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec126-640d-4922-b5c7-4c27f769c95a service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:14.842622 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec126-640d-4922-b5c7-4c27f769c95a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:15.065853 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce40045-efdf-42cc-8ebf-ed403bed9396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:15.071878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce40045-efdf-42cc-8ebf-ed403bed9396 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:15.071878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce40045-efdf-42cc-8ebf-ed403bed9396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:15.081327 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce40045-efdf-42cc-8ebf-ed403bed9396 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:15.084251 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce40045-efdf-42cc-8ebf-ed403bed9396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:15.084648 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce40045-efdf-42cc-8ebf-ed403bed9396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:15.092546 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce40045-efdf-42cc-8ebf-ed403bed9396 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:15.107868 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:15.140586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ec126-640d-4922-b5c7-4c27f769c95a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:15.150828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ec126-640d-4922-b5c7-4c27f769c95a service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:15.183393 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 865/1745] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 711 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:15.184187 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce40045-efdf-42cc-8ebf-ed403bed9396 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:15.199414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 881/1746] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:15.199414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be505c0-1f77-4c4c-b0cd-0dfc98950d63 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:15.199414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be505c0-1f77-4c4c-b0cd-0dfc98950d63 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:15.200442 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce40045-efdf-42cc-8ebf-ed403bed9396 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:15.209024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758abb-538f-4d20-9954-a9b9d8fc4947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:15.209757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758abb-538f-4d20-9954-a9b9d8fc4947 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:15.210232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758abb-538f-4d20-9954-a9b9d8fc4947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:15.210575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758abb-538f-4d20-9954-a9b9d8fc4947 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:15.211476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46758abb-538f-4d20-9954-a9b9d8fc4947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:15.213948 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46758abb-538f-4d20-9954-a9b9d8fc4947 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:15.216041 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be505c0-1f77-4c4c-b0cd-0dfc98950d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:15.352642 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 866/1747] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:15 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:15.353997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758abb-538f-4d20-9954-a9b9d8fc4947 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:15.364265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4be505c0-1f77-4c4c-b0cd-0dfc98950d63 None None] MFA Rules not processed for user `392d29208db14149ae9dbbe7c1998787`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:15.368291 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4be505c0-1f77-4c4c-b0cd-0dfc98950d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:15.398435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758abb-538f-4d20-9954-a9b9d8fc4947 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:15.416688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa343c1-7ab3-47c0-9ff6-3f6904c458ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:15.417511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa343c1-7ab3-47c0-9ff6-3f6904c458ec admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:15.418404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa343c1-7ab3-47c0-9ff6-3f6904c458ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:15.420427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa343c1-7ab3-47c0-9ff6-3f6904c458ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:15.425631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa343c1-7ab3-47c0-9ff6-3f6904c458ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:15.430285 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa343c1-7ab3-47c0-9ff6-3f6904c458ec admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:15.465528 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:15.681138 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 867/1748] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:15 2022] POST /identity/v3/projects => generated 363 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:15.682774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa343c1-7ab3-47c0-9ff6-3f6904c458ec admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:15.744072 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 882/1749] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 545 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:15.745072 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be505c0-1f77-4c4c-b0cd-0dfc98950d63 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:15.753713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4be505c0-1f77-4c4c-b0cd-0dfc98950d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:15.806428 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be505c0-1f77-4c4c-b0cd-0dfc98950d63 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:15.873374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa343c1-7ab3-47c0-9ff6-3f6904c458ec admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:15.887369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51314164-46f1-4317-8d23-d081ba85ffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:15.888066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51314164-46f1-4317-8d23-d081ba85ffc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:15.895096 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51314164-46f1-4317-8d23-d081ba85ffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:15.895096 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51314164-46f1-4317-8d23-d081ba85ffc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:15.895096 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51314164-46f1-4317-8d23-d081ba85ffc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:15.896851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51314164-46f1-4317-8d23-d081ba85ffc3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:15.937929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 868/1750] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:15.937929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51314164-46f1-4317-8d23-d081ba85ffc3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:15.954552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:15.974707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51314164-46f1-4317-8d23-d081ba85ffc3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:15.997770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe2c8e-611e-4124-a74d-a9b0f29cf0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:15.998482 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe2c8e-611e-4124-a74d-a9b0f29cf0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:15.998792 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe2c8e-611e-4124-a74d-a9b0f29cf0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:15.999097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe2c8e-611e-4124-a74d-a9b0f29cf0e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:15.999871 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe2c8e-611e-4124-a74d-a9b0f29cf0e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:16.005127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187d07b-b04f-43a7-9740-9d1cee995ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:16.006083 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187d07b-b04f-43a7-9740-9d1cee995ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:16.006366 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187d07b-b04f-43a7-9740-9d1cee995ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:16.006643 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187d07b-b04f-43a7-9740-9d1cee995ef0 admin admin] PATH_INFO: `/v3/projects/afa164c9dc0e41549ce4e20f5b2018a7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:16.009484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe2c8e-611e-4124-a74d-a9b0f29cf0e3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:16.011604 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187d07b-b04f-43a7-9740-9d1cee995ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa164c9dc0e41549ce4e20f5b2018a7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:16.014214 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187d07b-b04f-43a7-9740-9d1cee995ef0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:16.177173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 869/1751] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:15 2022] POST /identity/v3/users => generated 282 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:16.177173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe2c8e-611e-4124-a74d-a9b0f29cf0e3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:16.219954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe2c8e-611e-4124-a74d-a9b0f29cf0e3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:16.224241 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b187d07b-b04f-43a7-9740-9d1cee995ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa164c9dc0e41549ce4e20f5b2018a7', 'request_id': 'req-b187d07b-b04f-43a7-9740-9d1cee995ef0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:16.239387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b187d07b-b04f-43a7-9740-9d1cee995ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa164c9dc0e41549ce4e20f5b2018a7', 'request_id': 'req-b187d07b-b04f-43a7-9740-9d1cee995ef0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:16.368736 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6e9cc-6f05-4972-a041-e9d8b45b22dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:16.369325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e9cc-6f05-4972-a041-e9d8b45b22dc admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:16.370337 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e9cc-6f05-4972-a041-e9d8b45b22dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:16.370754 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e9cc-6f05-4972-a041-e9d8b45b22dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:16.372033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6e9cc-6f05-4972-a041-e9d8b45b22dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:16.373577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6e9cc-6f05-4972-a041-e9d8b45b22dc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:16.381170 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b187d07b-b04f-43a7-9740-9d1cee995ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa164c9dc0e41549ce4e20f5b2018a7', 'request_id': 'req-b187d07b-b04f-43a7-9740-9d1cee995ef0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:16.403841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b187d07b-b04f-43a7-9740-9d1cee995ef0 admin admin] The token cache is being invalidate because project afa164c9dc0e41549ce4e20f5b2018a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:16.404162 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b187d07b-b04f-43a7-9740-9d1cee995ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:16.406424 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b187d07b-b04f-43a7-9740-9d1cee995ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:16.413650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 883/1752] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:15 2022] DELETE /identity/v3/projects/afa164c9dc0e41549ce4e20f5b2018a7 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:16.413650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187d07b-b04f-43a7-9740-9d1cee995ef0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:16.419220 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b187d07b-b04f-43a7-9740-9d1cee995ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:16.421893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 870/1753] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:16.427483 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c35cfe-ee66-4ecf-9aa8-2e2f32ef922f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:16.428539 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c35cfe-ee66-4ecf-9aa8-2e2f32ef922f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:16.429264 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c35cfe-ee66-4ecf-9aa8-2e2f32ef922f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:16.456573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187d07b-b04f-43a7-9740-9d1cee995ef0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:16.481162 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e85b6-2f7d-43cc-b37e-f6479c327f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:16.484399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-11c35cfe-ee66-4ecf-9aa8-2e2f32ef922f None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:16.490622 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e85b6-2f7d-43cc-b37e-f6479c327f5a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:16.490622 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e85b6-2f7d-43cc-b37e-f6479c327f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:16.490622 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e85b6-2f7d-43cc-b37e-f6479c327f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:16.494041 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e85b6-2f7d-43cc-b37e-f6479c327f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:16.500290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-11c35cfe-ee66-4ecf-9aa8-2e2f32ef922f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:16.503759 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e85b6-2f7d-43cc-b37e-f6479c327f5a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:16.523673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 871/1754] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:16.526096 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c35cfe-ee66-4ecf-9aa8-2e2f32ef922f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:16.530442 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-11c35cfe-ee66-4ecf-9aa8-2e2f32ef922f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:16.547088 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 884/1755] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:16.550705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9429c23-1d71-41f8-9357-904037183b7a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:16.553648 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9429c23-1d71-41f8-9357-904037183b7a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:16.554142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9429c23-1d71-41f8-9357-904037183b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:16.574477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c35cfe-ee66-4ecf-9aa8-2e2f32ef922f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:16.586725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a9429c23-1d71-41f8-9357-904037183b7a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:16.586725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a9429c23-1d71-41f8-9357-904037183b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:16.604210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 885/1756] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:16.610611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9429c23-1d71-41f8-9357-904037183b7a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:16.613675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816a5b-c020-4170-8547-bfc983aa26ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:16.615175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816a5b-c020-4170-8547-bfc983aa26ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:16.620228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816a5b-c020-4170-8547-bfc983aa26ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:16.620228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816a5b-c020-4170-8547-bfc983aa26ed admin admin] PATH_INFO: `/v3/projects/1af4dd68fcd04edd8e81ff3f899725f4/users/b41bd781bd4849b4b8de37d70ae89154/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:16.627770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9429c23-1d71-41f8-9357-904037183b7a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:16.634917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47cfcb-726f-4df2-9c18-af10007fd734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:16.636549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47cfcb-726f-4df2-9c18-af10007fd734 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:16.636879 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47cfcb-726f-4df2-9c18-af10007fd734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:16.637156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47cfcb-726f-4df2-9c18-af10007fd734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:16.638025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47cfcb-726f-4df2-9c18-af10007fd734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:16.640614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47cfcb-726f-4df2-9c18-af10007fd734 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:16.653974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65816a5b-c020-4170-8547-bfc983aa26ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af4dd68fcd04edd8e81ff3f899725f4, user_id=b41bd781bd4849b4b8de37d70ae89154, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:16.660443 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 886/1757] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:16.661598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47cfcb-726f-4df2-9c18-af10007fd734 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:16.664250 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:16.664827 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65816a5b-c020-4170-8547-bfc983aa26ed admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:16.695898 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47cfcb-726f-4df2-9c18-af10007fd734 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:16.701938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf68636-6d22-48a6-8da4-eea0d305d5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:16.704091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf68636-6d22-48a6-8da4-eea0d305d5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:16.704422 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf68636-6d22-48a6-8da4-eea0d305d5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:16.704881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf68636-6d22-48a6-8da4-eea0d305d5a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:16.706513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf68636-6d22-48a6-8da4-eea0d305d5a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:16.707154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf68636-6d22-48a6-8da4-eea0d305d5a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:16.709851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf68636-6d22-48a6-8da4-eea0d305d5a8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:16.733726 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 887/1758] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:16.734896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf68636-6d22-48a6-8da4-eea0d305d5a8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:16.736906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7bf68636-6d22-48a6-8da4-eea0d305d5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:16.756340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf68636-6d22-48a6-8da4-eea0d305d5a8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:16.778335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:16.779274 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:16.779542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:16.779818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73 admin admin] PATH_INFO: `/v3/projects/13c29f233e6749169f48efe00e6531c7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:16.783139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c29f233e6749169f48efe00e6531c7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:16.790693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:16.795545 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 872/1759] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:16 2022] PUT /identity/v3/projects/1af4dd68fcd04edd8e81ff3f899725f4/users/b41bd781bd4849b4b8de37d70ae89154/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:16.796962 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816a5b-c020-4170-8547-bfc983aa26ed admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:17.015402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c29f233e6749169f48efe00e6531c7', 'request_id': 'req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:17.040506 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816a5b-c020-4170-8547-bfc983aa26ed admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:17.041757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c29f233e6749169f48efe00e6531c7', 'request_id': 'req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:17.138418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c29f233e6749169f48efe00e6531c7', 'request_id': 'req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:17.166485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73 admin admin] The token cache is being invalidate because project 13c29f233e6749169f48efe00e6531c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:17.167115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:17.168072 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:17.172769 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 888/1760] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:16 2022] DELETE /identity/v3/projects/13c29f233e6749169f48efe00e6531c7 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:17.173730 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:17.175640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:17.339148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9af692-591d-4024-8ca0-d42059332a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:17.343657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9af692-591d-4024-8ca0-d42059332a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:17.344061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9af692-591d-4024-8ca0-d42059332a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:17.344402 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9af692-591d-4024-8ca0-d42059332a25 admin admin] PATH_INFO: `/v3/projects/51e8188e8d6d45f9b18b9f8798c62796/users/64fb6c38ab0d4becacc51b740da794ec/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:17.387277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827b2c8-a70d-4364-8cb5-2ce95fd2fa73 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:17.388214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:17.419591 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321edaa8-d617-4ccc-b7c2-946c4dba933e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:17.420368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321edaa8-d617-4ccc-b7c2-946c4dba933e service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:17.420653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321edaa8-d617-4ccc-b7c2-946c4dba933e service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:17.420929 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321edaa8-d617-4ccc-b7c2-946c4dba933e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:17.421037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9af692-591d-4024-8ca0-d42059332a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e8188e8d6d45f9b18b9f8798c62796, user_id=64fb6c38ab0d4becacc51b740da794ec, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:17.425705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-321edaa8-d617-4ccc-b7c2-946c4dba933e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:17.438651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9af692-591d-4024-8ca0-d42059332a25 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:17.565958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 873/1761] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:16 2022] PUT /identity/v3/projects/51e8188e8d6d45f9b18b9f8798c62796/users/64fb6c38ab0d4becacc51b740da794ec/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:17.565958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9af692-591d-4024-8ca0-d42059332a25 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:17.567622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4a9af692-591d-4024-8ca0-d42059332a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:17.624617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321edaa8-d617-4ccc-b7c2-946c4dba933e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:17.642548 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321edaa8-d617-4ccc-b7c2-946c4dba933e service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:17.655159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 889/1762] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:17.657572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288500d4-9364-4990-b7b8-56e1a459ad8e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:17.657572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288500d4-9364-4990-b7b8-56e1a459ad8e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:17.657572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288500d4-9364-4990-b7b8-56e1a459ad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:17.683785 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:17.740773 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-288500d4-9364-4990-b7b8-56e1a459ad8e None None] MFA Rules not processed for user `b41bd781bd4849b4b8de37d70ae89154`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:17.742012 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-288500d4-9364-4990-b7b8-56e1a459ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:17.851666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9af692-591d-4024-8ca0-d42059332a25 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:17.863719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af033257-9b11-4687-b294-8801919888a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:17.864358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af033257-9b11-4687-b294-8801919888a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:17.864637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af033257-9b11-4687-b294-8801919888a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:17.864911 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af033257-9b11-4687-b294-8801919888a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:17.865653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af033257-9b11-4687-b294-8801919888a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:17.867640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af033257-9b11-4687-b294-8801919888a0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:17.918580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 890/1763] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:17.919513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288500d4-9364-4990-b7b8-56e1a459ad8e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:17.921383 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-288500d4-9364-4990-b7b8-56e1a459ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:17.958659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288500d4-9364-4990-b7b8-56e1a459ad8e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:17.974476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7a6d6-baa0-4158-ace2-95ba46b39a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:17.974476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a6d6-baa0-4158-ace2-95ba46b39a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:17.974476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a6d6-baa0-4158-ace2-95ba46b39a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:17.975958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a6d6-baa0-4158-ace2-95ba46b39a88 admin admin] PATH_INFO: `/v3/users/e17762a56fce4af68e57d26716b1c6be` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:17.978973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7a6d6-baa0-4158-ace2-95ba46b39a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17762a56fce4af68e57d26716b1c6be)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:17.984523 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7a6d6-baa0-4158-ace2-95ba46b39a88 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:17.993065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:18.012884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 874/1764] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:17 2022] POST /identity/v3/projects => generated 393 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:18.019394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd58f4a-7e52-435e-bcc3-711224c75d1f None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:18.019703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd58f4a-7e52-435e-bcc3-711224c75d1f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:18.019984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd58f4a-7e52-435e-bcc3-711224c75d1f None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:18.028484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 875/1765] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 20 19:36:18 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:36:18.034455 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee18f2-206d-42ab-8120-9c77c272193a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:18.034946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee18f2-206d-42ab-8120-9c77c272193a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:18.035471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee18f2-206d-42ab-8120-9c77c272193a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:18.124933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-87ee18f2-206d-42ab-8120-9c77c272193a None None] MFA Rules not processed for user `64fb6c38ab0d4becacc51b740da794ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:18.128931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-87ee18f2-206d-42ab-8120-9c77c272193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:18.273584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 876/1766] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:18.276340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ea61f-aa00-441b-a404-d8b844aa615c None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:18.276340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ea61f-aa00-441b-a404-d8b844aa615c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:18.276340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ea61f-aa00-441b-a404-d8b844aa615c None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:18.277551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 877/1767] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 20 19:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:36:18.278640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ea61f-aa00-441b-a404-d8b844aa615c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:18.286861 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f61ea61f-aa00-441b-a404-d8b844aa615c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:18.318157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-73c7a6d6-baa0-4158-ace2-95ba46b39a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17762a56fce4af68e57d26716b1c6be'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:18.362809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:18.422349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-73c7a6d6-baa0-4158-ace2-95ba46b39a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17762a56fce4af68e57d26716b1c6be'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:18.435804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-73c7a6d6-baa0-4158-ace2-95ba46b39a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17762a56fce4af68e57d26716b1c6be'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:18.446437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ea61f-aa00-441b-a404-d8b844aa615c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:18.452561 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2aeb4-1e41-49e1-88a9-3835a456b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:18.453636 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2aeb4-1e41-49e1-88a9-3835a456b3bf admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:18.454093 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2aeb4-1e41-49e1-88a9-3835a456b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:18.454504 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2aeb4-1e41-49e1-88a9-3835a456b3bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:18.455441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2aeb4-1e41-49e1-88a9-3835a456b3bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:18.459006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2aeb4-1e41-49e1-88a9-3835a456b3bf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:18.498133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-73c7a6d6-baa0-4158-ace2-95ba46b39a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17762a56fce4af68e57d26716b1c6be'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:18.498955 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-73c7a6d6-baa0-4158-ace2-95ba46b39a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17762a56fce4af68e57d26716b1c6be'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:18.532175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 891/1768] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:17 2022] DELETE /identity/v3/users/e17762a56fce4af68e57d26716b1c6be => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:18.533048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7a6d6-baa0-4158-ace2-95ba46b39a88 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:18.537440 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-73c7a6d6-baa0-4158-ace2-95ba46b39a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:18.585611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 878/1769] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:18 2022] POST /identity/v3/projects => generated 383 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:18.588222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5ecf0-3776-426f-9c3e-32ca05cfe0e0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:18.590064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5ecf0-3776-426f-9c3e-32ca05cfe0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:18.595773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5ecf0-3776-426f-9c3e-32ca05cfe0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:18.617885 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0fb5ecf0-3776-426f-9c3e-32ca05cfe0e0 None None] MFA Rules not processed for user `e3fd38ebb5514af686204d0b02a91edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:18.619165 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0fb5ecf0-3776-426f-9c3e-32ca05cfe0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:18.632286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7a6d6-baa0-4158-ace2-95ba46b39a88 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:18.764417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 879/1770] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 20 19:36:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:18.765356 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5ecf0-3776-426f-9c3e-32ca05cfe0e0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:18.766630 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0fb5ecf0-3776-426f-9c3e-32ca05cfe0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:18.791163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:18.805726 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd2118-66f5-4a79-bc02-e2bf9c21a588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:18.808025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd2118-66f5-4a79-bc02-e2bf9c21a588 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:18.809038 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd2118-66f5-4a79-bc02-e2bf9c21a588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:18.809866 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd2118-66f5-4a79-bc02-e2bf9c21a588 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:18.810718 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd2118-66f5-4a79-bc02-e2bf9c21a588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:18.819886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd2118-66f5-4a79-bc02-e2bf9c21a588 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:18.945993 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5ecf0-3776-426f-9c3e-32ca05cfe0e0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:18.954577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4ce4e-653a-4f95-a253-5b16ef4a93de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:18.955327 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4ce4e-653a-4f95-a253-5b16ef4a93de admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:18.959106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4ce4e-653a-4f95-a253-5b16ef4a93de admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:18.959390 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4ce4e-653a-4f95-a253-5b16ef4a93de admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:18.960128 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4ce4e-653a-4f95-a253-5b16ef4a93de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:18.963206 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 892/1771] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:18 2022] POST /identity/v3/users => generated 297 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:18.964936 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0608a0-5ca4-476c-b2b2-19986852805e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:18.965857 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0608a0-5ca4-476c-b2b2-19986852805e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:18.966983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4ce4e-653a-4f95-a253-5b16ef4a93de admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:18.967933 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0608a0-5ca4-476c-b2b2-19986852805e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:19.021580 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cf0608a0-5ca4-476c-b2b2-19986852805e None None] MFA Rules not processed for user `e3fd38ebb5514af686204d0b02a91edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:19.022849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cf0608a0-5ca4-476c-b2b2-19986852805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:19.044120 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 893/1772] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 20 19:36:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:19.045244 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0608a0-5ca4-476c-b2b2-19986852805e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:19.046731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cf0608a0-5ca4-476c-b2b2-19986852805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:19.063418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0608a0-5ca4-476c-b2b2-19986852805e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:19.069906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e1b7a-f09c-4d40-9fdf-23d56c58e3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:19.070598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e1b7a-f09c-4d40-9fdf-23d56c58e3aa admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:19.071049 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e1b7a-f09c-4d40-9fdf-23d56c58e3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:19.071327 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e1b7a-f09c-4d40-9fdf-23d56c58e3aa admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:19.072311 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e1b7a-f09c-4d40-9fdf-23d56c58e3aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:19.074317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e1b7a-f09c-4d40-9fdf-23d56c58e3aa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:19.163310 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 880/1773] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:18 2022] POST /identity/v3/projects => generated 361 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:19.163310 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4ce4e-653a-4f95-a253-5b16ef4a93de admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:19.167222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f6e4ce4e-653a-4f95-a253-5b16ef4a93de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:19.170482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 894/1774] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:19 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:19.171429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e1b7a-f09c-4d40-9fdf-23d56c58e3aa admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:19.192650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e1b7a-f09c-4d40-9fdf-23d56c58e3aa admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:19.273561 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4ce4e-653a-4f95-a253-5b16ef4a93de admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:19.276385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f39106-db2f-41ed-9dff-0c1b469b0703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:19.277065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f39106-db2f-41ed-9dff-0c1b469b0703 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:19.277402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f39106-db2f-41ed-9dff-0c1b469b0703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:19.277671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f39106-db2f-41ed-9dff-0c1b469b0703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:19.278411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f39106-db2f-41ed-9dff-0c1b469b0703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:19.282944 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f39106-db2f-41ed-9dff-0c1b469b0703 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:19.291946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f91d7-3ed2-46e1-833c-44f3e6f9f073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:19.292646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f91d7-3ed2-46e1-833c-44f3e6f9f073 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:19.292933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f91d7-3ed2-46e1-833c-44f3e6f9f073 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:19.293214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f91d7-3ed2-46e1-833c-44f3e6f9f073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:19.295564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 895/1775] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:19.296454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f39106-db2f-41ed-9dff-0c1b469b0703 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:19.301151 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-96f39106-db2f-41ed-9dff-0c1b469b0703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:19.323142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:19.328726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f91d7-3ed2-46e1-833c-44f3e6f9f073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:19.330843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f91d7-3ed2-46e1-833c-44f3e6f9f073 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:19.332550 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f39106-db2f-41ed-9dff-0c1b469b0703 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:19.348213 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b6b7c-37ef-4e88-bdbb-0a6ee4bc5f5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:19.349147 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b6b7c-37ef-4e88-bdbb-0a6ee4bc5f5e service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:19.349596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b6b7c-37ef-4e88-bdbb-0a6ee4bc5f5e service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:19.350014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b6b7c-37ef-4e88-bdbb-0a6ee4bc5f5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:19.362227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b6b7c-37ef-4e88-bdbb-0a6ee4bc5f5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:19.364765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b6b7c-37ef-4e88-bdbb-0a6ee4bc5f5e service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:19.365313 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 881/1776] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:19.381543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 896/1777] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:19.382457 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b6b7c-37ef-4e88-bdbb-0a6ee4bc5f5e service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:19.383970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f91d7-3ed2-46e1-833c-44f3e6f9f073 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:19.395261 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b6b7c-37ef-4e88-bdbb-0a6ee4bc5f5e service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:19.406829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f02b89-db9a-4e92-8144-0058d5620d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:19.407586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f02b89-db9a-4e92-8144-0058d5620d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:19.408522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f02b89-db9a-4e92-8144-0058d5620d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:19.410075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f02b89-db9a-4e92-8144-0058d5620d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:19.414829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f02b89-db9a-4e92-8144-0058d5620d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:19.416113 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f02b89-db9a-4e92-8144-0058d5620d4d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:19.432292 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f91d7-3ed2-46e1-833c-44f3e6f9f073 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:19.440269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5753c8-ff02-4bea-88e2-209d3a9d1c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:19.449246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5753c8-ff02-4bea-88e2-209d3a9d1c55 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:19.449664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5753c8-ff02-4bea-88e2-209d3a9d1c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:19.449951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5753c8-ff02-4bea-88e2-209d3a9d1c55 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:19.450733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5753c8-ff02-4bea-88e2-209d3a9d1c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:19.453069 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5753c8-ff02-4bea-88e2-209d3a9d1c55 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:19.457568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 897/1778] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:19.458527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f02b89-db9a-4e92-8144-0058d5620d4d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:19.480325 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f02b89-db9a-4e92-8144-0058d5620d4d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:19.497646 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ae876-9f15-4b7c-aa2f-17345b6046f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:19.499613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ae876-9f15-4b7c-aa2f-17345b6046f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:19.499896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ae876-9f15-4b7c-aa2f-17345b6046f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:19.500166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ae876-9f15-4b7c-aa2f-17345b6046f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:19.501024 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ae876-9f15-4b7c-aa2f-17345b6046f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:19.510758 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ae876-9f15-4b7c-aa2f-17345b6046f6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:19.531217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 898/1779] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:19.531217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ae876-9f15-4b7c-aa2f-17345b6046f6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:19.532913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e80ae876-9f15-4b7c-aa2f-17345b6046f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:19.555036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ae876-9f15-4b7c-aa2f-17345b6046f6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:19.561721 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da885d-497c-40f6-922e-0c1015f66475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:19.563017 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da885d-497c-40f6-922e-0c1015f66475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:19.563486 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da885d-497c-40f6-922e-0c1015f66475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:19.570459 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da885d-497c-40f6-922e-0c1015f66475 admin admin] PATH_INFO: `/v3/projects/3dc100e7d00e46e1a8dc746302352357` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:19.570459 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da885d-497c-40f6-922e-0c1015f66475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc100e7d00e46e1a8dc746302352357)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:19.570459 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da885d-497c-40f6-922e-0c1015f66475 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:19.606513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 882/1780] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:19 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:19.607670 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5753c8-ff02-4bea-88e2-209d3a9d1c55 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:19.623699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5753c8-ff02-4bea-88e2-209d3a9d1c55 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:19.630247 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187d3dd-ee39-465f-bcd1-1ab4249bae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:19.631499 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187d3dd-ee39-465f-bcd1-1ab4249bae82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:19.632175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187d3dd-ee39-465f-bcd1-1ab4249bae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:19.632722 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187d3dd-ee39-465f-bcd1-1ab4249bae82 admin admin] PATH_INFO: `/v3/projects/bd5a1187b5574ecc8d056e5182865381/users/56c28268dfb64a2e842c5a16c41db3d7/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:19.659127 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187d3dd-ee39-465f-bcd1-1ab4249bae82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5a1187b5574ecc8d056e5182865381, user_id=56c28268dfb64a2e842c5a16c41db3d7, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:19.662537 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187d3dd-ee39-465f-bcd1-1ab4249bae82 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:19.942410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:20.201521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 883/1781] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:19 2022] PUT /identity/v3/projects/bd5a1187b5574ecc8d056e5182865381/users/56c28268dfb64a2e842c5a16c41db3d7/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:20.201521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187d3dd-ee39-465f-bcd1-1ab4249bae82 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:20.202108 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03da885d-497c-40f6-922e-0c1015f66475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc100e7d00e46e1a8dc746302352357', 'request_id': 'req-03da885d-497c-40f6-922e-0c1015f66475'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:20.202108 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03da885d-497c-40f6-922e-0c1015f66475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc100e7d00e46e1a8dc746302352357', 'request_id': 'req-03da885d-497c-40f6-922e-0c1015f66475'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:20.260584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187d3dd-ee39-465f-bcd1-1ab4249bae82 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:20.392850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235556e8-4a21-4b07-9c72-5cfa520950e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:20.393855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235556e8-4a21-4b07-9c72-5cfa520950e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:20.394272 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235556e8-4a21-4b07-9c72-5cfa520950e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:20.395298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235556e8-4a21-4b07-9c72-5cfa520950e2 admin admin] PATH_INFO: `/v3/projects/4c20e7faa0354ec5a5fe65c3feef969c/users/738549e56f364b4eb4d2561b431eb428/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:20.413981 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235556e8-4a21-4b07-9c72-5cfa520950e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c20e7faa0354ec5a5fe65c3feef969c, user_id=738549e56f364b4eb4d2561b431eb428, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:20.421889 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235556e8-4a21-4b07-9c72-5cfa520950e2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:20.836989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03da885d-497c-40f6-922e-0c1015f66475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc100e7d00e46e1a8dc746302352357', 'request_id': 'req-03da885d-497c-40f6-922e-0c1015f66475'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:20.838863 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:20.854200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 884/1782] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:20 2022] PUT /identity/v3/projects/4c20e7faa0354ec5a5fe65c3feef969c/users/738549e56f364b4eb4d2561b431eb428/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:20.858803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235556e8-4a21-4b07-9c72-5cfa520950e2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:20.861497 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03da885d-497c-40f6-922e-0c1015f66475 admin admin] The token cache is being invalidate because project 3dc100e7d00e46e1a8dc746302352357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:20.861804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03da885d-497c-40f6-922e-0c1015f66475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:20.865730 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03da885d-497c-40f6-922e-0c1015f66475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:20.870270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 899/1783] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:19 2022] DELETE /identity/v3/projects/3dc100e7d00e46e1a8dc746302352357 => generated 0 bytes in 1342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:20.872963 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da885d-497c-40f6-922e-0c1015f66475 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:20.880574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-03da885d-497c-40f6-922e-0c1015f66475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:20.898693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da885d-497c-40f6-922e-0c1015f66475 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:21.016761 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235556e8-4a21-4b07-9c72-5cfa520950e2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:21.019189 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f3458-2039-43d6-ba1d-d7b5b495a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:21.020261 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f3458-2039-43d6-ba1d-d7b5b495a632 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.020616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f3458-2039-43d6-ba1d-d7b5b495a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.024838 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f3458-2039-43d6-ba1d-d7b5b495a632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.025672 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f3458-2039-43d6-ba1d-d7b5b495a632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:21.027215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c39ebf-21c9-41f2-a044-800a736be2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:21.027628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f3458-2039-43d6-ba1d-d7b5b495a632 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:21.031600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c39ebf-21c9-41f2-a044-800a736be2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.031875 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c39ebf-21c9-41f2-a044-800a736be2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.032752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c39ebf-21c9-41f2-a044-800a736be2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.033611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c39ebf-21c9-41f2-a044-800a736be2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:21.036654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c39ebf-21c9-41f2-a044-800a736be2a7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:21.053854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 885/1784] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:21.055444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb49d3-d5ad-4fb6-b817-fe3476bf97af None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.055740 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb49d3-d5ad-4fb6-b817-fe3476bf97af None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.056169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb49d3-d5ad-4fb6-b817-fe3476bf97af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.064570 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 900/1785] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:21.066747 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a6b7-a9ae-4072-a314-1407a8ebb631 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.066747 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a6b7-a9ae-4072-a314-1407a8ebb631 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.066985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a6b7-a9ae-4072-a314-1407a8ebb631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.094637 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0424a6b7-a9ae-4072-a314-1407a8ebb631 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:21.097057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-22bb49d3-d5ad-4fb6-b817-fe3476bf97af None None] MFA Rules not processed for user `738549e56f364b4eb4d2561b431eb428`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:21.097197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0424a6b7-a9ae-4072-a314-1407a8ebb631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:21.097292 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-22bb49d3-d5ad-4fb6-b817-fe3476bf97af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:21.106298 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 901/1786] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:21.116841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424a6b7-a9ae-4072-a314-1407a8ebb631 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:21.119088 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0424a6b7-a9ae-4072-a314-1407a8ebb631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:21.134541 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424a6b7-a9ae-4072-a314-1407a8ebb631 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:21.147904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28af98-438a-4c0c-b873-9e56cc756c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:21.148811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28af98-438a-4c0c-b873-9e56cc756c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.149096 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28af98-438a-4c0c-b873-9e56cc756c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.149727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28af98-438a-4c0c-b873-9e56cc756c62 admin admin] PATH_INFO: `/v3/projects/ef8ba5a0f3da4844b2c9f4ecfa1b3a74/users/712dcb455a0446479b40e31431b232ff/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.173933 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28af98-438a-4c0c-b873-9e56cc756c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8ba5a0f3da4844b2c9f4ecfa1b3a74, user_id=712dcb455a0446479b40e31431b232ff, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:21.178044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28af98-438a-4c0c-b873-9e56cc756c62 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:21.197999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 886/1787] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:21.199444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb49d3-d5ad-4fb6-b817-fe3476bf97af None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:21.212218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:21.223801 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb49d3-d5ad-4fb6-b817-fe3476bf97af None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:21.230435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189a3f2-47d4-4eb8-91f3-7ef3a5621ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:21.231797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189a3f2-47d4-4eb8-91f3-7ef3a5621ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.232217 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189a3f2-47d4-4eb8-91f3-7ef3a5621ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.235706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189a3f2-47d4-4eb8-91f3-7ef3a5621ff2 admin admin] PATH_INFO: `/v3/projects/bd5a1187b5574ecc8d056e5182865381/users/56c28268dfb64a2e842c5a16c41db3d7/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.239369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189a3f2-47d4-4eb8-91f3-7ef3a5621ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5a1187b5574ecc8d056e5182865381, user_id=56c28268dfb64a2e842c5a16c41db3d7, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:21.242186 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189a3f2-47d4-4eb8-91f3-7ef3a5621ff2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:21.248726 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 902/1788] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:21 2022] PUT /identity/v3/projects/ef8ba5a0f3da4844b2c9f4ecfa1b3a74/users/712dcb455a0446479b40e31431b232ff/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:21.250364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f9f39-8d9e-424d-a085-dfe59bf5681f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.252849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f9f39-8d9e-424d-a085-dfe59bf5681f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.252849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f9f39-8d9e-424d-a085-dfe59bf5681f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.264544 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 887/1789] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:21 2022] PUT /identity/v3/projects/bd5a1187b5574ecc8d056e5182865381/users/56c28268dfb64a2e842c5a16c41db3d7/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:21.265810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189a3f2-47d4-4eb8-91f3-7ef3a5621ff2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:21.275248 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b189a3f2-47d4-4eb8-91f3-7ef3a5621ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:21.276290 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ed6f9f39-8d9e-424d-a085-dfe59bf5681f None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:21.278087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ed6f9f39-8d9e-424d-a085-dfe59bf5681f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:21.315420 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:21.421211 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189a3f2-47d4-4eb8-91f3-7ef3a5621ff2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:21.431474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d796c70-7336-4457-849d-4849d6a523bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:21.434071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 903/1790] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:21.434810 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f9f39-8d9e-424d-a085-dfe59bf5681f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:21.437437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:21.442404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d796c70-7336-4457-849d-4849d6a523bf admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.444619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d796c70-7336-4457-849d-4849d6a523bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.444619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d796c70-7336-4457-849d-4849d6a523bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.444619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d796c70-7336-4457-849d-4849d6a523bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:21.445939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d796c70-7336-4457-849d-4849d6a523bf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:21.450200 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f9f39-8d9e-424d-a085-dfe59bf5681f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:21.460261 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e8b4a-1424-4765-ba1b-e9df76ed4066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:21.461010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e8b4a-1424-4765-ba1b-e9df76ed4066 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.461470 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e8b4a-1424-4765-ba1b-e9df76ed4066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.461748 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e8b4a-1424-4765-ba1b-e9df76ed4066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.462526 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e8b4a-1424-4765-ba1b-e9df76ed4066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:21.464676 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e8b4a-1424-4765-ba1b-e9df76ed4066 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:21.486525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 904/1791] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:21.486525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e19fb4-e11d-4ca9-9c3c-10749c928699 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.486525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e19fb4-e11d-4ca9-9c3c-10749c928699 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.486525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e19fb4-e11d-4ca9-9c3c-10749c928699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.532560 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-59e19fb4-e11d-4ca9-9c3c-10749c928699 None None] MFA Rules not processed for user `56c28268dfb64a2e842c5a16c41db3d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:21.533799 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-59e19fb4-e11d-4ca9-9c3c-10749c928699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:21.564799 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 888/1792] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:21 2022] POST /identity/v3/projects => generated 391 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:21.565539 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d796c70-7336-4457-849d-4849d6a523bf admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:21.653974 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 905/1793] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:21.655488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e19fb4-e11d-4ca9-9c3c-10749c928699 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:21.659558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d796c70-7336-4457-849d-4849d6a523bf admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:21.667073 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36d85f-ee2e-4ad2-a980-2f67478eb32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:21.667314 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e19fb4-e11d-4ca9-9c3c-10749c928699 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:21.667701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d85f-ee2e-4ad2-a980-2f67478eb32b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.667988 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d85f-ee2e-4ad2-a980-2f67478eb32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.668343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d85f-ee2e-4ad2-a980-2f67478eb32b admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.669210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36d85f-ee2e-4ad2-a980-2f67478eb32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:21.669616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36d85f-ee2e-4ad2-a980-2f67478eb32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:21.671574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36d85f-ee2e-4ad2-a980-2f67478eb32b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:21.684619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768e39a-fd6a-462a-9212-ea4de8e0b497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:21.685660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768e39a-fd6a-462a-9212-ea4de8e0b497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.690298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 889/1794] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:21.690474 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768e39a-fd6a-462a-9212-ea4de8e0b497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.690474 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768e39a-fd6a-462a-9212-ea4de8e0b497 admin admin] PATH_INFO: `/v3/projects/ef8ba5a0f3da4844b2c9f4ecfa1b3a74/users/712dcb455a0446479b40e31431b232ff/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.690656 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36d85f-ee2e-4ad2-a980-2f67478eb32b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:21.697640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768e39a-fd6a-462a-9212-ea4de8e0b497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8ba5a0f3da4844b2c9f4ecfa1b3a74, user_id=712dcb455a0446479b40e31431b232ff, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:21.700993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768e39a-fd6a-462a-9212-ea4de8e0b497 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:21.701764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36d85f-ee2e-4ad2-a980-2f67478eb32b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:21.726988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 906/1795] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:21 2022] PUT /identity/v3/projects/ef8ba5a0f3da4844b2c9f4ecfa1b3a74/users/712dcb455a0446479b40e31431b232ff/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:21.737437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01177c0d-063a-49e5-a89e-73c91d7b4678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:21.737437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01177c0d-063a-49e5-a89e-73c91d7b4678 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.737664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:21.737739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01177c0d-063a-49e5-a89e-73c91d7b4678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.737739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01177c0d-063a-49e5-a89e-73c91d7b4678 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.737739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01177c0d-063a-49e5-a89e-73c91d7b4678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:21.737943 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768e39a-fd6a-462a-9212-ea4de8e0b497 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:21.737943 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e768e39a-fd6a-462a-9212-ea4de8e0b497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:21.738072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01177c0d-063a-49e5-a89e-73c91d7b4678 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:21.811062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768e39a-fd6a-462a-9212-ea4de8e0b497 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:21.814778 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb95f51-526c-4e65-8ff3-c86880ec6621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:21.815434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb95f51-526c-4e65-8ff3-c86880ec6621 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.815718 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb95f51-526c-4e65-8ff3-c86880ec6621 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.815988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb95f51-526c-4e65-8ff3-c86880ec6621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.831961 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:21.839519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 890/1796] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:21 2022] POST /identity/v3/users => generated 302 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:21.840629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01177c0d-063a-49e5-a89e-73c91d7b4678 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:21.861893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01177c0d-063a-49e5-a89e-73c91d7b4678 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:21.904510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb95f51-526c-4e65-8ff3-c86880ec6621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:21.906214 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb95f51-526c-4e65-8ff3-c86880ec6621 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:21.920864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 907/1797] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:21.923208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb41f4-8d2b-4158-b953-885fa5d59aa3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.923208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb41f4-8d2b-4158-b953-885fa5d59aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.932462 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb41f4-8d2b-4158-b953-885fa5d59aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.962046 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7898c-6e32-4478-a38f-df7fb4a75f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:21.962823 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7898c-6e32-4478-a38f-df7fb4a75f4f admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:21.963113 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7898c-6e32-4478-a38f-df7fb4a75f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:21.963388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7898c-6e32-4478-a38f-df7fb4a75f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:21.964083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7898c-6e32-4478-a38f-df7fb4a75f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:21.966332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7898c-6e32-4478-a38f-df7fb4a75f4f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:21.985993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-35fb41f4-8d2b-4158-b953-885fa5d59aa3 None None] MFA Rules not processed for user `712dcb455a0446479b40e31431b232ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:21.988407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-35fb41f4-8d2b-4158-b953-885fa5d59aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:22.072592 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 908/1798] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:21 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:22.073446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb41f4-8d2b-4158-b953-885fa5d59aa3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:22.085158 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb41f4-8d2b-4158-b953-885fa5d59aa3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:22.090247 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531042e0-9496-4044-a3a2-b4632c755643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:22.090954 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531042e0-9496-4044-a3a2-b4632c755643 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:22.091288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531042e0-9496-4044-a3a2-b4632c755643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:22.091566 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531042e0-9496-4044-a3a2-b4632c755643 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:22.092330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531042e0-9496-4044-a3a2-b4632c755643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:22.093960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531042e0-9496-4044-a3a2-b4632c755643 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:22.105095 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 909/1799] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:22.105989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531042e0-9496-4044-a3a2-b4632c755643 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:22.115824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531042e0-9496-4044-a3a2-b4632c755643 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:22.124221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 891/1800] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:21 2022] POST /identity/v3/projects => generated 387 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:22.124352 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0436b78-1ed4-4858-98be-189235254728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:22.124463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7898c-6e32-4478-a38f-df7fb4a75f4f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:22.124554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0436b78-1ed4-4858-98be-189235254728 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:22.124554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0436b78-1ed4-4858-98be-189235254728 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:22.124554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0436b78-1ed4-4858-98be-189235254728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:22.131306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0436b78-1ed4-4858-98be-189235254728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:22.132977 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0436b78-1ed4-4858-98be-189235254728 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:22.146839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 910/1801] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:22 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:22.147840 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0436b78-1ed4-4858-98be-189235254728 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:22.159005 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0436b78-1ed4-4858-98be-189235254728 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:22.192524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:22.248509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7898c-6e32-4478-a38f-df7fb4a75f4f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:22.253739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9b6b2-e5da-4dd3-91ff-0658ff598c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:22.255236 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9b6b2-e5da-4dd3-91ff-0658ff598c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:22.255509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9b6b2-e5da-4dd3-91ff-0658ff598c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:22.255875 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9b6b2-e5da-4dd3-91ff-0658ff598c4d admin admin] PATH_INFO: `/v3/projects/d3b9df204f0c4ddfb6ac2ccaf173d3b1/users/6970a64892a1479587a821025d40c0fe/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:22.257409 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af145ad-c114-4242-b947-479e14cfd321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:22.258086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af145ad-c114-4242-b947-479e14cfd321 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:22.258374 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af145ad-c114-4242-b947-479e14cfd321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:22.258645 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af145ad-c114-4242-b947-479e14cfd321 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:22.259398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af145ad-c114-4242-b947-479e14cfd321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:22.261512 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af145ad-c114-4242-b947-479e14cfd321 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:22.277613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9b6b2-e5da-4dd3-91ff-0658ff598c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b9df204f0c4ddfb6ac2ccaf173d3b1, user_id=6970a64892a1479587a821025d40c0fe, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:22.288793 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9b6b2-e5da-4dd3-91ff-0658ff598c4d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:22.312094 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:22.374981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 911/1802] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:22 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:22.375852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af145ad-c114-4242-b947-479e14cfd321 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:22.377605 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9af145ad-c114-4242-b947-479e14cfd321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:22.410022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 892/1803] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:22 2022] PUT /identity/v3/projects/d3b9df204f0c4ddfb6ac2ccaf173d3b1/users/6970a64892a1479587a821025d40c0fe/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:22.410022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9b6b2-e5da-4dd3-91ff-0658ff598c4d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:22.464788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af145ad-c114-4242-b947-479e14cfd321 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:22.498318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9b6b2-e5da-4dd3-91ff-0658ff598c4d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:22.505186 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170eaec-456d-4555-8360-b732f91a93b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:22.506008 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170eaec-456d-4555-8360-b732f91a93b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:22.506466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170eaec-456d-4555-8360-b732f91a93b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:22.506772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170eaec-456d-4555-8360-b732f91a93b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:22.507550 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170eaec-456d-4555-8360-b732f91a93b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:22.509258 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170eaec-456d-4555-8360-b732f91a93b6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:22.523037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 893/1804] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:22.523037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170eaec-456d-4555-8360-b732f91a93b6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:22.535047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475065b5-3529-40aa-892c-8ea655df9f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:22.537217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475065b5-3529-40aa-892c-8ea655df9f6c service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:22.537500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170eaec-456d-4555-8360-b732f91a93b6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:22.537617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475065b5-3529-40aa-892c-8ea655df9f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:22.537921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475065b5-3529-40aa-892c-8ea655df9f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:22.540211 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-475065b5-3529-40aa-892c-8ea655df9f6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:22.550159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb73f8-cac0-438c-a640-7472b33416a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:22.550159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb73f8-cac0-438c-a640-7472b33416a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:22.550159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb73f8-cac0-438c-a640-7472b33416a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:22.550159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb73f8-cac0-438c-a640-7472b33416a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:22.550437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb73f8-cac0-438c-a640-7472b33416a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:22.550510 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb73f8-cac0-438c-a640-7472b33416a8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:22.563359 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 894/1805] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:22.564328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb73f8-cac0-438c-a640-7472b33416a8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:22.574508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb73f8-cac0-438c-a640-7472b33416a8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:22.578456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27423bc8-ddb1-400c-b553-6cfec8ebc33f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:22.579126 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27423bc8-ddb1-400c-b553-6cfec8ebc33f service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:22.579404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27423bc8-ddb1-400c-b553-6cfec8ebc33f service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:22.579676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27423bc8-ddb1-400c-b553-6cfec8ebc33f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:22.581475 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-27423bc8-ddb1-400c-b553-6cfec8ebc33f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:22.611960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475065b5-3529-40aa-892c-8ea655df9f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:22.613685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475065b5-3529-40aa-892c-8ea655df9f6c service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:22.627039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 912/1806] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:22.628150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475065b5-3529-40aa-892c-8ea655df9f6c service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:22.642192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475065b5-3529-40aa-892c-8ea655df9f6c service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:22.648305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdb6b0-81c5-4781-9e26-0a9b47a3aaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:22.649558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdb6b0-81c5-4781-9e26-0a9b47a3aaeb admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:22.650092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdb6b0-81c5-4781-9e26-0a9b47a3aaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:22.650519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdb6b0-81c5-4781-9e26-0a9b47a3aaeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:22.651681 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdb6b0-81c5-4781-9e26-0a9b47a3aaeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:22.654161 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdb6b0-81c5-4781-9e26-0a9b47a3aaeb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:22.680009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27423bc8-ddb1-400c-b553-6cfec8ebc33f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:22.680009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27423bc8-ddb1-400c-b553-6cfec8ebc33f service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:22.682763 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 913/1807] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:22.683904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdb6b0-81c5-4781-9e26-0a9b47a3aaeb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:22.697329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 895/1808] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:22 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:22.698452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27423bc8-ddb1-400c-b553-6cfec8ebc33f service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:22.713493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27423bc8-ddb1-400c-b553-6cfec8ebc33f service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:22.720498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d5256-c228-4065-82ac-69c6c23514e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:22.721801 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d5256-c228-4065-82ac-69c6c23514e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:22.722258 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d5256-c228-4065-82ac-69c6c23514e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:22.722634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d5256-c228-4065-82ac-69c6c23514e5 admin admin] PATH_INFO: `/v3/projects/1eee980cf14b43858dfe52db6d935808/users/e21ba9cbdf574511a3110bf93d2662ab/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:22.729051 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdb6b0-81c5-4781-9e26-0a9b47a3aaeb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:22.744685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc54f5-1cd8-48e3-99c6-497c1e947428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:22.745886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d5256-c228-4065-82ac-69c6c23514e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eee980cf14b43858dfe52db6d935808, user_id=e21ba9cbdf574511a3110bf93d2662ab, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:22.750715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc54f5-1cd8-48e3-99c6-497c1e947428 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:22.750715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc54f5-1cd8-48e3-99c6-497c1e947428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:22.750969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc54f5-1cd8-48e3-99c6-497c1e947428 admin admin] PATH_INFO: `/v3/projects/d3b9df204f0c4ddfb6ac2ccaf173d3b1/users/6970a64892a1479587a821025d40c0fe/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:22.752989 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d5256-c228-4065-82ac-69c6c23514e5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:22.757597 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc54f5-1cd8-48e3-99c6-497c1e947428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b9df204f0c4ddfb6ac2ccaf173d3b1, user_id=6970a64892a1479587a821025d40c0fe, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:22.761540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc54f5-1cd8-48e3-99c6-497c1e947428 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:22.790784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 914/1809] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:22 2022] PUT /identity/v3/projects/d3b9df204f0c4ddfb6ac2ccaf173d3b1/users/6970a64892a1479587a821025d40c0fe/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:22.795818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168be58-1d1c-4351-9061-70362aba375e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:22.796397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168be58-1d1c-4351-9061-70362aba375e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:22.796850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168be58-1d1c-4351-9061-70362aba375e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:22.797582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:22.852446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1168be58-1d1c-4351-9061-70362aba375e None None] MFA Rules not processed for user `6970a64892a1479587a821025d40c0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:22.853958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1168be58-1d1c-4351-9061-70362aba375e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:22.874787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 896/1810] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:22 2022] PUT /identity/v3/projects/1eee980cf14b43858dfe52db6d935808/users/e21ba9cbdf574511a3110bf93d2662ab/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:22.885284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848724d6-07bd-42da-82ed-2f7e11f638b2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:22.886250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848724d6-07bd-42da-82ed-2f7e11f638b2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:22.886560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848724d6-07bd-42da-82ed-2f7e11f638b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:23.000030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-848724d6-07bd-42da-82ed-2f7e11f638b2 None None] MFA Rules not processed for user `e21ba9cbdf574511a3110bf93d2662ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:23.001699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-848724d6-07bd-42da-82ed-2f7e11f638b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:23.057596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:23.078641 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 915/1811] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:23.080893 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168be58-1d1c-4351-9061-70362aba375e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:23.087375 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1168be58-1d1c-4351-9061-70362aba375e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:23.162931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:23.213378 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 897/1812] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:23.214380 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848724d6-07bd-42da-82ed-2f7e11f638b2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:23.319790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168be58-1d1c-4351-9061-70362aba375e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:23.324614 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848724d6-07bd-42da-82ed-2f7e11f638b2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:23.330028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead8b9c-fc0f-43a8-aaec-c8b441a425c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:23.330920 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead8b9c-fc0f-43a8-aaec-c8b441a425c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:23.331202 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead8b9c-fc0f-43a8-aaec-c8b441a425c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:23.331481 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead8b9c-fc0f-43a8-aaec-c8b441a425c6 admin admin] PATH_INFO: `/v3/users/392d29208db14149ae9dbbe7c1998787` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:23.333776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead8b9c-fc0f-43a8-aaec-c8b441a425c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=392d29208db14149ae9dbbe7c1998787)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:23.338718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146498-25e2-4f3b-8159-1e78f04b0c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:23.338940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146498-25e2-4f3b-8159-1e78f04b0c41 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:23.339952 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146498-25e2-4f3b-8159-1e78f04b0c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:23.339952 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146498-25e2-4f3b-8159-1e78f04b0c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:23.340159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3146498-25e2-4f3b-8159-1e78f04b0c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:23.342005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3146498-25e2-4f3b-8159-1e78f04b0c41 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:23.343794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead8b9c-fc0f-43a8-aaec-c8b441a425c6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:23.365256 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:23.519646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 898/1813] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:23 2022] POST /identity/v3/projects => generated 385 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:23.519646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146498-25e2-4f3b-8159-1e78f04b0c41 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:23.596697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146498-25e2-4f3b-8159-1e78f04b0c41 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:23.602579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99e849-9f81-41f0-a68c-f2e71c958a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:23.603475 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99e849-9f81-41f0-a68c-f2e71c958a30 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:23.603825 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99e849-9f81-41f0-a68c-f2e71c958a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:23.604203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99e849-9f81-41f0-a68c-f2e71c958a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:23.681316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bead8b9c-fc0f-43a8-aaec-c8b441a425c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392d29208db14149ae9dbbe7c1998787'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:23.707389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99e849-9f81-41f0-a68c-f2e71c958a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:23.709627 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99e849-9f81-41f0-a68c-f2e71c958a30 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:23.727261 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 899/1814] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:23.728296 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99e849-9f81-41f0-a68c-f2e71c958a30 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:23.759956 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:23.782083 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bead8b9c-fc0f-43a8-aaec-c8b441a425c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392d29208db14149ae9dbbe7c1998787'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:23.790856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bead8b9c-fc0f-43a8-aaec-c8b441a425c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392d29208db14149ae9dbbe7c1998787'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:23.800444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99e849-9f81-41f0-a68c-f2e71c958a30 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:23.806050 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a36a7-90b8-416c-b28f-42d8d9a5cc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:23.806813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bead8b9c-fc0f-43a8-aaec-c8b441a425c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392d29208db14149ae9dbbe7c1998787'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:23.806949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a36a7-90b8-416c-b28f-42d8d9a5cc24 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:23.807207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a36a7-90b8-416c-b28f-42d8d9a5cc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:23.807510 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a36a7-90b8-416c-b28f-42d8d9a5cc24 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:23.807821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bead8b9c-fc0f-43a8-aaec-c8b441a425c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392d29208db14149ae9dbbe7c1998787'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:23.808219 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a36a7-90b8-416c-b28f-42d8d9a5cc24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:23.810165 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a36a7-90b8-416c-b28f-42d8d9a5cc24 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:23.814989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 916/1815] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:23 2022] DELETE /identity/v3/users/392d29208db14149ae9dbbe7c1998787 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:23.815839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead8b9c-fc0f-43a8-aaec-c8b441a425c6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:23.817466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bead8b9c-fc0f-43a8-aaec-c8b441a425c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:23.884146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead8b9c-fc0f-43a8-aaec-c8b441a425c6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:23.884777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 900/1816] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:23 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:23.884896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a36a7-90b8-416c-b28f-42d8d9a5cc24 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:23.888057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ac6a36a7-90b8-416c-b28f-42d8d9a5cc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:23.891318 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5282392-29a7-4e9e-b2e0-8579267782d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:23.892237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5282392-29a7-4e9e-b2e0-8579267782d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:23.892543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5282392-29a7-4e9e-b2e0-8579267782d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:23.892837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5282392-29a7-4e9e-b2e0-8579267782d1 admin admin] PATH_INFO: `/v3/users/b41bd781bd4849b4b8de37d70ae89154` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:23.894151 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5282392-29a7-4e9e-b2e0-8579267782d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41bd781bd4849b4b8de37d70ae89154)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:23.896771 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5282392-29a7-4e9e-b2e0-8579267782d1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:23.914734 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a36a7-90b8-416c-b28f-42d8d9a5cc24 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:23.968178 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec3ca1-1527-4cd4-aa0a-56a86254a152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:23.968832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec3ca1-1527-4cd4-aa0a-56a86254a152 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:23.969117 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec3ca1-1527-4cd4-aa0a-56a86254a152 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:23.969393 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec3ca1-1527-4cd4-aa0a-56a86254a152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:23.971262 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-10ec3ca1-1527-4cd4-aa0a-56a86254a152 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:24.031587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec3ca1-1527-4cd4-aa0a-56a86254a152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:24.033273 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec3ca1-1527-4cd4-aa0a-56a86254a152 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:24.045149 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 901/1817] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:24.046591 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2125b-e0e6-4a2d-861c-eea9012496c0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:24.047423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2125b-e0e6-4a2d-861c-eea9012496c0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:24.047767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2125b-e0e6-4a2d-861c-eea9012496c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:24.065671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-06b2125b-e0e6-4a2d-861c-eea9012496c0 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:24.066921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-06b2125b-e0e6-4a2d-861c-eea9012496c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:24.076229 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 902/1818] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:24.077417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2125b-e0e6-4a2d-861c-eea9012496c0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:24.080904 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-06b2125b-e0e6-4a2d-861c-eea9012496c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:24.094891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2125b-e0e6-4a2d-861c-eea9012496c0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:24.100715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d5874-3fde-4fca-8e9b-6287b4dfcd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:24.101389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d5874-3fde-4fca-8e9b-6287b4dfcd6c admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:24.101672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d5874-3fde-4fca-8e9b-6287b4dfcd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:24.101951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d5874-3fde-4fca-8e9b-6287b4dfcd6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:24.102765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d5874-3fde-4fca-8e9b-6287b4dfcd6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:24.104379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d5874-3fde-4fca-8e9b-6287b4dfcd6c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:24.115376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 903/1819] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:24.120253 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d5874-3fde-4fca-8e9b-6287b4dfcd6c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:24.120253 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-363d5874-3fde-4fca-8e9b-6287b4dfcd6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:24.155898 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5282392-29a7-4e9e-b2e0-8579267782d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41bd781bd4849b4b8de37d70ae89154'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:24.199123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d5874-3fde-4fca-8e9b-6287b4dfcd6c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:24.203166 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2724ff5-1cc1-46ed-ad54-61e769cd299a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:24.204183 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2724ff5-1cc1-46ed-ad54-61e769cd299a service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:24.204183 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2724ff5-1cc1-46ed-ad54-61e769cd299a service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:24.204397 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2724ff5-1cc1-46ed-ad54-61e769cd299a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:24.215388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2724ff5-1cc1-46ed-ad54-61e769cd299a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:24.216934 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2724ff5-1cc1-46ed-ad54-61e769cd299a service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:24.222707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5282392-29a7-4e9e-b2e0-8579267782d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41bd781bd4849b4b8de37d70ae89154'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:24.228816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 904/1820] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:24.230153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2724ff5-1cc1-46ed-ad54-61e769cd299a service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:24.241322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5282392-29a7-4e9e-b2e0-8579267782d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41bd781bd4849b4b8de37d70ae89154'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:24.241580 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2724ff5-1cc1-46ed-ad54-61e769cd299a service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:24.249849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50affb71-42e6-4aac-8942-dc4377ae5ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:24.250717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50affb71-42e6-4aac-8942-dc4377ae5ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:24.251063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50affb71-42e6-4aac-8942-dc4377ae5ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:24.251342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50affb71-42e6-4aac-8942-dc4377ae5ee1 admin admin] PATH_INFO: `/v3/projects/5f996ca7bb5e4e97ad10ad0dabe8bb13/users/87e3f3096c1d42038b5a0d4f4f821077/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:24.261498 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5282392-29a7-4e9e-b2e0-8579267782d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41bd781bd4849b4b8de37d70ae89154'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:24.262424 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5282392-29a7-4e9e-b2e0-8579267782d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41bd781bd4849b4b8de37d70ae89154'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:24.269834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50affb71-42e6-4aac-8942-dc4377ae5ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f996ca7bb5e4e97ad10ad0dabe8bb13, user_id=87e3f3096c1d42038b5a0d4f4f821077, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:24.270384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 917/1821] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:23 2022] DELETE /identity/v3/users/b41bd781bd4849b4b8de37d70ae89154 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:24.274773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50affb71-42e6-4aac-8942-dc4377ae5ee1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:24.278478 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf249359-c366-4f2f-ae43-60dd652c461e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:24.280124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf249359-c366-4f2f-ae43-60dd652c461e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:24.281134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf249359-c366-4f2f-ae43-60dd652c461e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:24.303050 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cf249359-c366-4f2f-ae43-60dd652c461e None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:24.304454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cf249359-c366-4f2f-ae43-60dd652c461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:24.341676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:24.348731 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 905/1822] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:24 2022] PUT /identity/v3/projects/5f996ca7bb5e4e97ad10ad0dabe8bb13/users/87e3f3096c1d42038b5a0d4f4f821077/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:24.353402 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50affb71-42e6-4aac-8942-dc4377ae5ee1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:24.355172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-50affb71-42e6-4aac-8942-dc4377ae5ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:24.377253 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 918/1823] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:36:24.388272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf249359-c366-4f2f-ae43-60dd652c461e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:24.389816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cf249359-c366-4f2f-ae43-60dd652c461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:24.425647 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50affb71-42e6-4aac-8942-dc4377ae5ee1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:24.434939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91414b62-4a4a-4afc-b71c-099d944a9f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:24.437478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91414b62-4a4a-4afc-b71c-099d944a9f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:24.437975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91414b62-4a4a-4afc-b71c-099d944a9f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:24.438467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91414b62-4a4a-4afc-b71c-099d944a9f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:24.441303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91414b62-4a4a-4afc-b71c-099d944a9f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:24.443199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:24.444567 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91414b62-4a4a-4afc-b71c-099d944a9f28 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:24.470967 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 906/1824] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:36:24.480496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91414b62-4a4a-4afc-b71c-099d944a9f28 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:24.480672 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf249359-c366-4f2f-ae43-60dd652c461e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:24.491480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91414b62-4a4a-4afc-b71c-099d944a9f28 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:24.498455 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edf686-02c8-4f46-b32f-7c67d81ccbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:24.499869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edf686-02c8-4f46-b32f-7c67d81ccbe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:24.500275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edf686-02c8-4f46-b32f-7c67d81ccbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:24.501050 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edf686-02c8-4f46-b32f-7c67d81ccbe9 admin admin] PATH_INFO: `/v3/projects/5f996ca7bb5e4e97ad10ad0dabe8bb13/users/87e3f3096c1d42038b5a0d4f4f821077/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:24.503448 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edf686-02c8-4f46-b32f-7c67d81ccbe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f996ca7bb5e4e97ad10ad0dabe8bb13, user_id=87e3f3096c1d42038b5a0d4f4f821077, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:24.507619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edf686-02c8-4f46-b32f-7c67d81ccbe9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:24.521496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 907/1825] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:24 2022] PUT /identity/v3/projects/5f996ca7bb5e4e97ad10ad0dabe8bb13/users/87e3f3096c1d42038b5a0d4f4f821077/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:24.532757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a7265-85a7-490d-8fc8-cc68c721d577 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:24.533336 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a7265-85a7-490d-8fc8-cc68c721d577 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:24.534353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a7265-85a7-490d-8fc8-cc68c721d577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:24.562354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8501d-474b-4ac7-820d-601a09a46346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:24.562939 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8501d-474b-4ac7-820d-601a09a46346 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:24.563276 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8501d-474b-4ac7-820d-601a09a46346 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:24.563551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8501d-474b-4ac7-820d-601a09a46346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:24.568607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-303a7265-85a7-490d-8fc8-cc68c721d577 None None] MFA Rules not processed for user `87e3f3096c1d42038b5a0d4f4f821077`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:24.570033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-303a7265-85a7-490d-8fc8-cc68c721d577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:24.575822 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8501d-474b-4ac7-820d-601a09a46346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:24.577466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8501d-474b-4ac7-820d-601a09a46346 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:24.592277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 919/1826] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:36:24.674133 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 908/1827] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:36:24.815243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8501d-474b-4ac7-820d-601a09a46346 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:24.818316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0cb8501d-474b-4ac7-820d-601a09a46346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:24.921329 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8501d-474b-4ac7-820d-601a09a46346 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:25.012671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e443204-c43c-4071-bbe2-765530cd3564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:25.013667 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e443204-c43c-4071-bbe2-765530cd3564 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:25.014055 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e443204-c43c-4071-bbe2-765530cd3564 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:25.014227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e443204-c43c-4071-bbe2-765530cd3564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:25.026600 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e443204-c43c-4071-bbe2-765530cd3564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:25.028172 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e443204-c43c-4071-bbe2-765530cd3564 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:25.061450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 920/1828] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:25.071235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a7265-85a7-490d-8fc8-cc68c721d577 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:25.072890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-303a7265-85a7-490d-8fc8-cc68c721d577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:25.147875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e443204-c43c-4071-bbe2-765530cd3564 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:25.194409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a7265-85a7-490d-8fc8-cc68c721d577 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:25.201678 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876c292-6794-4b2f-abe5-460733c1877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:25.203132 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876c292-6794-4b2f-abe5-460733c1877b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:25.203698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876c292-6794-4b2f-abe5-460733c1877b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:25.204217 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876c292-6794-4b2f-abe5-460733c1877b admin admin] PATH_INFO: `/v3/projects/8d68870c0912470e89c4e5845bc9ccca` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:25.207123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876c292-6794-4b2f-abe5-460733c1877b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d68870c0912470e89c4e5845bc9ccca)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:25.210616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876c292-6794-4b2f-abe5-460733c1877b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:25.301789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e443204-c43c-4071-bbe2-765530cd3564 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:25.310996 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca741112-146d-4edf-a0d3-1d5f4db00946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:25.312229 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca741112-146d-4edf-a0d3-1d5f4db00946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:25.313221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca741112-146d-4edf-a0d3-1d5f4db00946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:25.313497 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca741112-146d-4edf-a0d3-1d5f4db00946 admin admin] PATH_INFO: `/v3/users/e21ba9cbdf574511a3110bf93d2662ab` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:25.314856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca741112-146d-4edf-a0d3-1d5f4db00946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21ba9cbdf574511a3110bf93d2662ab)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:25.316943 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca741112-146d-4edf-a0d3-1d5f4db00946 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:25.385655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b876c292-6794-4b2f-abe5-460733c1877b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d68870c0912470e89c4e5845bc9ccca', 'request_id': 'req-b876c292-6794-4b2f-abe5-460733c1877b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:25.392824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:25.493670 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b876c292-6794-4b2f-abe5-460733c1877b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d68870c0912470e89c4e5845bc9ccca', 'request_id': 'req-b876c292-6794-4b2f-abe5-460733c1877b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:25.498198 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:25.501805 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b876c292-6794-4b2f-abe5-460733c1877b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d68870c0912470e89c4e5845bc9ccca', 'request_id': 'req-b876c292-6794-4b2f-abe5-460733c1877b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:25.513731 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b876c292-6794-4b2f-abe5-460733c1877b admin admin] The token cache is being invalidate because project 8d68870c0912470e89c4e5845bc9ccca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:25.514120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b876c292-6794-4b2f-abe5-460733c1877b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:25.514697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b876c292-6794-4b2f-abe5-460733c1877b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:25.517126 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 909/1829] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:25 2022] DELETE /identity/v3/projects/8d68870c0912470e89c4e5845bc9ccca => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:25.521255 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b29197-88d2-4570-a9f0-7971fae8bb9d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:25.521614 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b29197-88d2-4570-a9f0-7971fae8bb9d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:25.521903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b29197-88d2-4570-a9f0-7971fae8bb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:25.534877 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ca741112-146d-4edf-a0d3-1d5f4db00946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21ba9cbdf574511a3110bf93d2662ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:25.547563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-14b29197-88d2-4570-a9f0-7971fae8bb9d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:25.549431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-14b29197-88d2-4570-a9f0-7971fae8bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:25.616195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ca741112-146d-4edf-a0d3-1d5f4db00946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21ba9cbdf574511a3110bf93d2662ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:25.626834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 910/1830] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:25.627912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b29197-88d2-4570-a9f0-7971fae8bb9d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:25.628891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ca741112-146d-4edf-a0d3-1d5f4db00946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21ba9cbdf574511a3110bf93d2662ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:25.632253 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-14b29197-88d2-4570-a9f0-7971fae8bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:25.644248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ca741112-146d-4edf-a0d3-1d5f4db00946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21ba9cbdf574511a3110bf93d2662ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:25.645119 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ca741112-146d-4edf-a0d3-1d5f4db00946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21ba9cbdf574511a3110bf93d2662ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:25.657166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 921/1831] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:25 2022] DELETE /identity/v3/users/e21ba9cbdf574511a3110bf93d2662ab => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:25.657166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026d82b-94a7-4c3e-9a2a-29d05453aa86 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:25.657166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026d82b-94a7-4c3e-9a2a-29d05453aa86 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:25.657166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026d82b-94a7-4c3e-9a2a-29d05453aa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:25.662371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b29197-88d2-4570-a9f0-7971fae8bb9d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:25.678865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1026d82b-94a7-4c3e-9a2a-29d05453aa86 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:25.680816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1026d82b-94a7-4c3e-9a2a-29d05453aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:25.724043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb05f07-39ea-49c7-8a8c-8d902da42479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:25.725036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb05f07-39ea-49c7-8a8c-8d902da42479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:25.725320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb05f07-39ea-49c7-8a8c-8d902da42479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:25.725631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb05f07-39ea-49c7-8a8c-8d902da42479 admin admin] PATH_INFO: `/v3/projects/1af4dd68fcd04edd8e81ff3f899725f4` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:25.727072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb05f07-39ea-49c7-8a8c-8d902da42479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af4dd68fcd04edd8e81ff3f899725f4)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:25.729186 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb05f07-39ea-49c7-8a8c-8d902da42479 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:25.745878 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 922/1832] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:25.747960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a6e78-b240-490b-b4bc-668c9ab81114 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:25.748723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a6e78-b240-490b-b4bc-668c9ab81114 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:25.748723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a6e78-b240-490b-b4bc-668c9ab81114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:25.769797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4d3a6e78-b240-490b-b4bc-668c9ab81114 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:25.771175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4d3a6e78-b240-490b-b4bc-668c9ab81114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:25.780075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 923/1833] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:25.780800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a6e78-b240-490b-b4bc-668c9ab81114 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:25.792430 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a6e78-b240-490b-b4bc-668c9ab81114 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:25.807608 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1d989-0e3d-454e-a698-7bc9120682ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:25.808756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1d989-0e3d-454e-a698-7bc9120682ca admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:25.809145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1d989-0e3d-454e-a698-7bc9120682ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:25.809660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1d989-0e3d-454e-a698-7bc9120682ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:25.810844 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1d989-0e3d-454e-a698-7bc9120682ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:25.811265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1d989-0e3d-454e-a698-7bc9120682ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:25.817114 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1d989-0e3d-454e-a698-7bc9120682ca admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:25.833225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 924/1834] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:25.836021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1d989-0e3d-454e-a698-7bc9120682ca admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:25.839738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-74b1d989-0e3d-454e-a698-7bc9120682ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:25.915831 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aeb05f07-39ea-49c7-8a8c-8d902da42479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af4dd68fcd04edd8e81ff3f899725f4', 'request_id': 'req-aeb05f07-39ea-49c7-8a8c-8d902da42479'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:25.967617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1d989-0e3d-454e-a698-7bc9120682ca admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:26.045422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aeb05f07-39ea-49c7-8a8c-8d902da42479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af4dd68fcd04edd8e81ff3f899725f4', 'request_id': 'req-aeb05f07-39ea-49c7-8a8c-8d902da42479'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:26.054508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadd231-46bf-445c-9933-6cf842d9e89d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:26.064200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aeb05f07-39ea-49c7-8a8c-8d902da42479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af4dd68fcd04edd8e81ff3f899725f4', 'request_id': 'req-aeb05f07-39ea-49c7-8a8c-8d902da42479'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:26.067509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadd231-46bf-445c-9933-6cf842d9e89d service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.067843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadd231-46bf-445c-9933-6cf842d9e89d service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.068125 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadd231-46bf-445c-9933-6cf842d9e89d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.120697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aeb05f07-39ea-49c7-8a8c-8d902da42479 admin admin] The token cache is being invalidate because project 1af4dd68fcd04edd8e81ff3f899725f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:26.122087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aeb05f07-39ea-49c7-8a8c-8d902da42479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:26.123612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aeb05f07-39ea-49c7-8a8c-8d902da42479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:26.125773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 911/1835] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:25 2022] DELETE /identity/v3/projects/1af4dd68fcd04edd8e81ff3f899725f4 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:26.133401 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb05f07-39ea-49c7-8a8c-8d902da42479 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:26.136051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-aeb05f07-39ea-49c7-8a8c-8d902da42479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:26.218311 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadd231-46bf-445c-9933-6cf842d9e89d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:26.221200 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadd231-46bf-445c-9933-6cf842d9e89d service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:26.246612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 925/1836] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:26.248243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadd231-46bf-445c-9933-6cf842d9e89d service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:26.250148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ccadd231-46bf-445c-9933-6cf842d9e89d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:26.276259 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadd231-46bf-445c-9933-6cf842d9e89d service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:26.293202 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5379d5-d757-4241-b9b0-8ea01553285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:26.295298 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5379d5-d757-4241-b9b0-8ea01553285d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.295814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5379d5-d757-4241-b9b0-8ea01553285d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.296295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5379d5-d757-4241-b9b0-8ea01553285d admin admin] PATH_INFO: `/v3/users/56c28268dfb64a2e842c5a16c41db3d7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.298318 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5379d5-d757-4241-b9b0-8ea01553285d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56c28268dfb64a2e842c5a16c41db3d7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:26.302590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5379d5-d757-4241-b9b0-8ea01553285d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:26.315329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb05f07-39ea-49c7-8a8c-8d902da42479 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:26.321449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095001d-1284-4553-bf72-cca61a411ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:26.321945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095001d-1284-4553-bf72-cca61a411ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.322230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095001d-1284-4553-bf72-cca61a411ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.322726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095001d-1284-4553-bf72-cca61a411ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.323858 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095001d-1284-4553-bf72-cca61a411ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:26.326511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095001d-1284-4553-bf72-cca61a411ec5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:26.456394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:26.501323 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 912/1837] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:26 2022] POST /identity/v3/projects => generated 381 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:26.505234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095001d-1284-4553-bf72-cca61a411ec5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:26.616849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a5379d5-d757-4241-b9b0-8ea01553285d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c28268dfb64a2e842c5a16c41db3d7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:26.670196 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095001d-1284-4553-bf72-cca61a411ec5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:26.677992 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f93ed-830a-4f0f-bedf-f5baca799c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:26.678866 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f93ed-830a-4f0f-bedf-f5baca799c55 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.679406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f93ed-830a-4f0f-bedf-f5baca799c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.679763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f93ed-830a-4f0f-bedf-f5baca799c55 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.680813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f93ed-830a-4f0f-bedf-f5baca799c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:26.683773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f93ed-830a-4f0f-bedf-f5baca799c55 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:26.696351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a5379d5-d757-4241-b9b0-8ea01553285d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c28268dfb64a2e842c5a16c41db3d7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:26.713802 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a5379d5-d757-4241-b9b0-8ea01553285d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c28268dfb64a2e842c5a16c41db3d7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:26.743354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:26.758340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a5379d5-d757-4241-b9b0-8ea01553285d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c28268dfb64a2e842c5a16c41db3d7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:26.758340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a5379d5-d757-4241-b9b0-8ea01553285d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c28268dfb64a2e842c5a16c41db3d7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:26.770796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 926/1838] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:26 2022] DELETE /identity/v3/users/56c28268dfb64a2e842c5a16c41db3d7 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:26.825785 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 913/1839] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:26 2022] POST /identity/v3/users => generated 291 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:26.830178 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5379d5-d757-4241-b9b0-8ea01553285d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:26.831664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5a5379d5-d757-4241-b9b0-8ea01553285d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:26.935837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5379d5-d757-4241-b9b0-8ea01553285d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:26.943297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c695180-9067-41cb-81cb-eed46fead1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:26.943297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c695180-9067-41cb-81cb-eed46fead1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.943297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c695180-9067-41cb-81cb-eed46fead1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.944903 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c695180-9067-41cb-81cb-eed46fead1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.945437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c695180-9067-41cb-81cb-eed46fead1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:26.947394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c695180-9067-41cb-81cb-eed46fead1a3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:26.962064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f93ed-830a-4f0f-bedf-f5baca799c55 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:26.964356 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-596f93ed-830a-4f0f-bedf-f5baca799c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:26.969248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 927/1840] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:26.974960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c695180-9067-41cb-81cb-eed46fead1a3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:26.994694 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c695180-9067-41cb-81cb-eed46fead1a3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:27.012085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac2b05-96a0-4456-ba4b-7be2b691158f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:27.012929 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac2b05-96a0-4456-ba4b-7be2b691158f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.013516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac2b05-96a0-4456-ba4b-7be2b691158f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.013516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac2b05-96a0-4456-ba4b-7be2b691158f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.014265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac2b05-96a0-4456-ba4b-7be2b691158f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:27.015971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac2b05-96a0-4456-ba4b-7be2b691158f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:27.020252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f93ed-830a-4f0f-bedf-f5baca799c55 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:27.040900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 928/1841] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:27.045063 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac2b05-96a0-4456-ba4b-7be2b691158f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:27.063027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0352d1-2270-437d-ba2c-133122cb9e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:27.063431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0352d1-2270-437d-ba2c-133122cb9e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.063756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0352d1-2270-437d-ba2c-133122cb9e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.064038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0352d1-2270-437d-ba2c-133122cb9e30 admin admin] PATH_INFO: `/v3/users/64fb6c38ab0d4becacc51b740da794ec` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.067352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0352d1-2270-437d-ba2c-133122cb9e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64fb6c38ab0d4becacc51b740da794ec)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:27.069998 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0352d1-2270-437d-ba2c-133122cb9e30 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:27.076019 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac2b05-96a0-4456-ba4b-7be2b691158f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:27.107526 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af3adb-a576-44f2-ab06-a7557ffc2624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:27.108478 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af3adb-a576-44f2-ab06-a7557ffc2624 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.108760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af3adb-a576-44f2-ab06-a7557ffc2624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.109099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af3adb-a576-44f2-ab06-a7557ffc2624 admin admin] PATH_INFO: `/v3/projects/9dada0a2186f4d939a1100222a3e962e/users/71b0f686cee04064a3523fffdb9232d4/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.139396 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af3adb-a576-44f2-ab06-a7557ffc2624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dada0a2186f4d939a1100222a3e962e, user_id=71b0f686cee04064a3523fffdb9232d4, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:27.143568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af3adb-a576-44f2-ab06-a7557ffc2624 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:27.316173 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 929/1842] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:27 2022] PUT /identity/v3/projects/9dada0a2186f4d939a1100222a3e962e/users/71b0f686cee04064a3523fffdb9232d4/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:27.316923 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af3adb-a576-44f2-ab06-a7557ffc2624 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:27.326864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f5af3adb-a576-44f2-ab06-a7557ffc2624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:27.394482 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2f0352d1-2270-437d-ba2c-133122cb9e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64fb6c38ab0d4becacc51b740da794ec'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:27.438085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af3adb-a576-44f2-ab06-a7557ffc2624 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:27.446104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0499434-868e-41e8-ae72-75eba9eed71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:27.447287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0499434-868e-41e8-ae72-75eba9eed71b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.447672 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0499434-868e-41e8-ae72-75eba9eed71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.448145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0499434-868e-41e8-ae72-75eba9eed71b admin admin] PATH_INFO: `/v3/projects/1eee980cf14b43858dfe52db6d935808` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.449813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0499434-868e-41e8-ae72-75eba9eed71b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eee980cf14b43858dfe52db6d935808)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:27.452296 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0499434-868e-41e8-ae72-75eba9eed71b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:27.463120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2f0352d1-2270-437d-ba2c-133122cb9e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64fb6c38ab0d4becacc51b740da794ec'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:27.465087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2f0352d1-2270-437d-ba2c-133122cb9e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64fb6c38ab0d4becacc51b740da794ec'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:27.485928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2f0352d1-2270-437d-ba2c-133122cb9e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64fb6c38ab0d4becacc51b740da794ec'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:27.495333 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2f0352d1-2270-437d-ba2c-133122cb9e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64fb6c38ab0d4becacc51b740da794ec'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:27.507120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 914/1843] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:26 2022] DELETE /identity/v3/users/64fb6c38ab0d4becacc51b740da794ec => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:27.508044 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b6823-ef07-490a-9688-d97c4ac4e8d3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.508352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b6823-ef07-490a-9688-d97c4ac4e8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.509311 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b6823-ef07-490a-9688-d97c4ac4e8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.545994 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-116b6823-ef07-490a-9688-d97c4ac4e8d3 None None] MFA Rules not processed for user `71b0f686cee04064a3523fffdb9232d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:27.547347 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-116b6823-ef07-490a-9688-d97c4ac4e8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:27.639405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d0499434-868e-41e8-ae72-75eba9eed71b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eee980cf14b43858dfe52db6d935808', 'request_id': 'req-d0499434-868e-41e8-ae72-75eba9eed71b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:27.651280 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d0499434-868e-41e8-ae72-75eba9eed71b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eee980cf14b43858dfe52db6d935808', 'request_id': 'req-d0499434-868e-41e8-ae72-75eba9eed71b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:27.651783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 915/1844] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:27.654586 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5dec0-4ed1-4651-a813-7890de50a0fd None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.655143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5dec0-4ed1-4651-a813-7890de50a0fd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.656491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5dec0-4ed1-4651-a813-7890de50a0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.685521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-96b5dec0-4ed1-4651-a813-7890de50a0fd None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:27.686823 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-96b5dec0-4ed1-4651-a813-7890de50a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:27.748164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d0499434-868e-41e8-ae72-75eba9eed71b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eee980cf14b43858dfe52db6d935808', 'request_id': 'req-d0499434-868e-41e8-ae72-75eba9eed71b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:27.765155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d0499434-868e-41e8-ae72-75eba9eed71b admin admin] The token cache is being invalidate because project 1eee980cf14b43858dfe52db6d935808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:27.765875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d0499434-868e-41e8-ae72-75eba9eed71b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:27.767205 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d0499434-868e-41e8-ae72-75eba9eed71b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:27.770212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 930/1845] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:27 2022] DELETE /identity/v3/projects/1eee980cf14b43858dfe52db6d935808 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:27.771982 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0499434-868e-41e8-ae72-75eba9eed71b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:27.775143 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d0499434-868e-41e8-ae72-75eba9eed71b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:27.790731 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 916/1846] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:27.792593 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5dec0-4ed1-4651-a813-7890de50a0fd None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:27.794156 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-96b5dec0-4ed1-4651-a813-7890de50a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:27.799143 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0499434-868e-41e8-ae72-75eba9eed71b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:27.806848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc57acb-f42b-4643-8ef8-556a2c864648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:27.808078 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc57acb-f42b-4643-8ef8-556a2c864648 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.808583 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc57acb-f42b-4643-8ef8-556a2c864648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.809048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc57acb-f42b-4643-8ef8-556a2c864648 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.809386 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5dec0-4ed1-4651-a813-7890de50a0fd None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:27.810387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc57acb-f42b-4643-8ef8-556a2c864648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:27.813925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc57acb-f42b-4643-8ef8-556a2c864648 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:27.816963 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23b8a6-d7be-4330-86e9-9dd9403e85ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:27.818867 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23b8a6-d7be-4330-86e9-9dd9403e85ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.826586 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23b8a6-d7be-4330-86e9-9dd9403e85ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.826586 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23b8a6-d7be-4330-86e9-9dd9403e85ae admin admin] PATH_INFO: `/v3/users/87e3f3096c1d42038b5a0d4f4f821077` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.829451 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23b8a6-d7be-4330-86e9-9dd9403e85ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e3f3096c1d42038b5a0d4f4f821077)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:27.832060 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23b8a6-d7be-4330-86e9-9dd9403e85ae admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:27.980971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 931/1847] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:27 2022] POST /identity/v3/projects => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:27.981156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc57acb-f42b-4643-8ef8-556a2c864648 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:27.983884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ccc57acb-f42b-4643-8ef8-556a2c864648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:28.049029 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc57acb-f42b-4643-8ef8-556a2c864648 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:28.054529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d315cc-e552-47f2-ad24-474d2312ff65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:28.055054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d315cc-e552-47f2-ad24-474d2312ff65 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:28.055302 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d315cc-e552-47f2-ad24-474d2312ff65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:28.055553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d315cc-e552-47f2-ad24-474d2312ff65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:28.160519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ec23b8a6-d7be-4330-86e9-9dd9403e85ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e3f3096c1d42038b5a0d4f4f821077'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.245876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d315cc-e552-47f2-ad24-474d2312ff65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:28.251214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ec23b8a6-d7be-4330-86e9-9dd9403e85ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e3f3096c1d42038b5a0d4f4f821077'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.251891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ec23b8a6-d7be-4330-86e9-9dd9403e85ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e3f3096c1d42038b5a0d4f4f821077'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.252136 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d315cc-e552-47f2-ad24-474d2312ff65 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:28.271971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 932/1848] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:28.275260 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d315cc-e552-47f2-ad24-474d2312ff65 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:28.276063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ec23b8a6-d7be-4330-86e9-9dd9403e85ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e3f3096c1d42038b5a0d4f4f821077'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.297199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ec23b8a6-d7be-4330-86e9-9dd9403e85ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e3f3096c1d42038b5a0d4f4f821077'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.305043 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d315cc-e552-47f2-ad24-474d2312ff65 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:28.313406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 917/1849] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:27 2022] DELETE /identity/v3/users/87e3f3096c1d42038b5a0d4f4f821077 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:28.320432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810f58b-ceef-4e6d-925f-ca311b4d1ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:28.322113 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810f58b-ceef-4e6d-925f-ca311b4d1ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:28.322614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810f58b-ceef-4e6d-925f-ca311b4d1ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:28.323122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810f58b-ceef-4e6d-925f-ca311b4d1ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:28.324251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810f58b-ceef-4e6d-925f-ca311b4d1ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:28.326846 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810f58b-ceef-4e6d-925f-ca311b4d1ed7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:28.333240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:28.426283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 933/1850] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:28 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:28.427908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23b8a6-d7be-4330-86e9-9dd9403e85ae admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:28.430584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ec23b8a6-d7be-4330-86e9-9dd9403e85ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:28.516950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23b8a6-d7be-4330-86e9-9dd9403e85ae admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:28.523786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd169-a90b-4c6e-8785-30fce04e9278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:28.524868 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd169-a90b-4c6e-8785-30fce04e9278 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:28.525157 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd169-a90b-4c6e-8785-30fce04e9278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:28.525431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd169-a90b-4c6e-8785-30fce04e9278 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:28.526216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affd169-a90b-4c6e-8785-30fce04e9278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:28.528018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affd169-a90b-4c6e-8785-30fce04e9278 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:28.539706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810f58b-ceef-4e6d-925f-ca311b4d1ed7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:28.539938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 918/1851] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:28.541638 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3810f58b-ceef-4e6d-925f-ca311b4d1ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:28.543755 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd169-a90b-4c6e-8785-30fce04e9278 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:28.557183 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd169-a90b-4c6e-8785-30fce04e9278 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:28.561108 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810f58b-ceef-4e6d-925f-ca311b4d1ed7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:28.565009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7185e5-04b9-4c0d-b4ec-fde9aae89d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:28.566243 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7185e5-04b9-4c0d-b4ec-fde9aae89d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:28.566958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7185e5-04b9-4c0d-b4ec-fde9aae89d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:28.567632 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7185e5-04b9-4c0d-b4ec-fde9aae89d15 admin admin] PATH_INFO: `/v3/projects/d1d1f4d93d794d2081311d781fe5abb5/users/8fc0738f05204f3baabf67131efa6e15/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:28.570546 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fe4a9-ec3c-45e3-8870-f26c745c8b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:28.572480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fe4a9-ec3c-45e3-8870-f26c745c8b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:28.573159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fe4a9-ec3c-45e3-8870-f26c745c8b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:28.573458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fe4a9-ec3c-45e3-8870-f26c745c8b94 admin admin] PATH_INFO: `/v3/projects/bd5a1187b5574ecc8d056e5182865381` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:28.575057 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fe4a9-ec3c-45e3-8870-f26c745c8b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd5a1187b5574ecc8d056e5182865381)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:28.588578 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7185e5-04b9-4c0d-b4ec-fde9aae89d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d1f4d93d794d2081311d781fe5abb5, user_id=8fc0738f05204f3baabf67131efa6e15, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:28.590494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fe4a9-ec3c-45e3-8870-f26c745c8b94 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:28.596942 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7185e5-04b9-4c0d-b4ec-fde9aae89d15 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:28.740556 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 919/1852] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:28 2022] PUT /identity/v3/projects/d1d1f4d93d794d2081311d781fe5abb5/users/8fc0738f05204f3baabf67131efa6e15/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:28.742607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7185e5-04b9-4c0d-b4ec-fde9aae89d15 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:28.807811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a36fe4a9-ec3c-45e3-8870-f26c745c8b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd5a1187b5574ecc8d056e5182865381', 'request_id': 'req-a36fe4a9-ec3c-45e3-8870-f26c745c8b94'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.830578 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a36fe4a9-ec3c-45e3-8870-f26c745c8b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd5a1187b5574ecc8d056e5182865381', 'request_id': 'req-a36fe4a9-ec3c-45e3-8870-f26c745c8b94'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.884422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7185e5-04b9-4c0d-b4ec-fde9aae89d15 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:28.943011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a36fe4a9-ec3c-45e3-8870-f26c745c8b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd5a1187b5574ecc8d056e5182865381', 'request_id': 'req-a36fe4a9-ec3c-45e3-8870-f26c745c8b94'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.962018 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a36fe4a9-ec3c-45e3-8870-f26c745c8b94 admin admin] The token cache is being invalidate because project bd5a1187b5574ecc8d056e5182865381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:28.962384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a36fe4a9-ec3c-45e3-8870-f26c745c8b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.966569 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a36fe4a9-ec3c-45e3-8870-f26c745c8b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.969047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 934/1853] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:28 2022] DELETE /identity/v3/projects/bd5a1187b5574ecc8d056e5182865381 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:28.973768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796d86a-9dd8-4f88-b880-2da9d6512f2b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:28.974066 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796d86a-9dd8-4f88-b880-2da9d6512f2b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:28.974347 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796d86a-9dd8-4f88-b880-2da9d6512f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:28.975792 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bd358-3eaf-4725-9bb7-e21be3a975fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:28.976601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bd358-3eaf-4725-9bb7-e21be3a975fb admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:28.977045 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bd358-3eaf-4725-9bb7-e21be3a975fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:28.977420 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bd358-3eaf-4725-9bb7-e21be3a975fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:28.978259 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bd358-3eaf-4725-9bb7-e21be3a975fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:28.980543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bd358-3eaf-4725-9bb7-e21be3a975fb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.005126 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 920/1854] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:29.010726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:29.014040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bd358-3eaf-4725-9bb7-e21be3a975fb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.015465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c796d86a-9dd8-4f88-b880-2da9d6512f2b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:29.016248 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-574bd358-3eaf-4725-9bb7-e21be3a975fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:29.017044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c796d86a-9dd8-4f88-b880-2da9d6512f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:29.029607 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 935/1855] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:36:29.039378 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d123f-1141-46c4-815a-172bc8337e8e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.039846 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d123f-1141-46c4-815a-172bc8337e8e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.040705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d123f-1141-46c4-815a-172bc8337e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.047011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bd358-3eaf-4725-9bb7-e21be3a975fb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.052608 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef6d0d-1bc2-4421-84ce-3c9e0491c670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.053567 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef6d0d-1bc2-4421-84ce-3c9e0491c670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.053857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef6d0d-1bc2-4421-84ce-3c9e0491c670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.055189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef6d0d-1bc2-4421-84ce-3c9e0491c670 admin admin] PATH_INFO: `/v3/projects/d1d1f4d93d794d2081311d781fe5abb5/users/8fc0738f05204f3baabf67131efa6e15/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.057855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef6d0d-1bc2-4421-84ce-3c9e0491c670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d1f4d93d794d2081311d781fe5abb5, user_id=8fc0738f05204f3baabf67131efa6e15, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.061175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef6d0d-1bc2-4421-84ce-3c9e0491c670 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.077304 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-151d123f-1141-46c4-815a-172bc8337e8e None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:29.081049 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 921/1856] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:29 2022] PUT /identity/v3/projects/d1d1f4d93d794d2081311d781fe5abb5/users/8fc0738f05204f3baabf67131efa6e15/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:29.082272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-151d123f-1141-46c4-815a-172bc8337e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:29.094285 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de27fe-d122-4865-88be-56efcfbb881e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.097353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de27fe-d122-4865-88be-56efcfbb881e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.099974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de27fe-d122-4865-88be-56efcfbb881e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.202296 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-11de27fe-d122-4865-88be-56efcfbb881e None None] MFA Rules not processed for user `8fc0738f05204f3baabf67131efa6e15`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:29.203582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-11de27fe-d122-4865-88be-56efcfbb881e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:29.286354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 936/1857] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:36:29.291428 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d123f-1141-46c4-815a-172bc8337e8e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.312391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d123f-1141-46c4-815a-172bc8337e8e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.324386 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c54ae-3e2b-4c86-9145-c812e00f99c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.326192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c54ae-3e2b-4c86-9145-c812e00f99c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.326481 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c54ae-3e2b-4c86-9145-c812e00f99c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.326801 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c54ae-3e2b-4c86-9145-c812e00f99c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.330404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c54ae-3e2b-4c86-9145-c812e00f99c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:29.330894 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c54ae-3e2b-4c86-9145-c812e00f99c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.332618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c54ae-3e2b-4c86-9145-c812e00f99c3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.368571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 937/1858] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:29.373034 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c54ae-3e2b-4c86-9145-c812e00f99c3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.380983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 922/1859] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:29.395534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c54ae-3e2b-4c86-9145-c812e00f99c3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.401214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de27fe-d122-4865-88be-56efcfbb881e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.402047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-11de27fe-d122-4865-88be-56efcfbb881e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:29.404615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8cb65-e3bf-46b6-a0e5-f519113e8e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.407988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8cb65-e3bf-46b6-a0e5-f519113e8e5a admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.408537 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8cb65-e3bf-46b6-a0e5-f519113e8e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.409035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8cb65-e3bf-46b6-a0e5-f519113e8e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.409981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8cb65-e3bf-46b6-a0e5-f519113e8e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.416199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8cb65-e3bf-46b6-a0e5-f519113e8e5a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.559080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de27fe-d122-4865-88be-56efcfbb881e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.564296 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 938/1860] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:29 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:36:29.568927 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c6e0c-28cc-4164-aacc-1f0ce95c6c85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.569697 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8cb65-e3bf-46b6-a0e5-f519113e8e5a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.569832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c6e0c-28cc-4164-aacc-1f0ce95c6c85 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.571049 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c6e0c-28cc-4164-aacc-1f0ce95c6c85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.571340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c6e0c-28cc-4164-aacc-1f0ce95c6c85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.588435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3fc8cb65-e3bf-46b6-a0e5-f519113e8e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:29.620270 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c6e0c-28cc-4164-aacc-1f0ce95c6c85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.626540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c6e0c-28cc-4164-aacc-1f0ce95c6c85 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.649130 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 923/1861] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:29.649130 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c6e0c-28cc-4164-aacc-1f0ce95c6c85 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.650227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1d1c6e0c-28cc-4164-aacc-1f0ce95c6c85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:29.699597 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c6e0c-28cc-4164-aacc-1f0ce95c6c85 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.768596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8cb65-e3bf-46b6-a0e5-f519113e8e5a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.783079 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fb89c-b357-44ca-8240-0d43794fc6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.783837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fb89c-b357-44ca-8240-0d43794fc6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.784211 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fb89c-b357-44ca-8240-0d43794fc6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.784493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fb89c-b357-44ca-8240-0d43794fc6ae admin admin] PATH_INFO: `/v3/projects/51e8188e8d6d45f9b18b9f8798c62796` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.790268 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fb89c-b357-44ca-8240-0d43794fc6ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e8188e8d6d45f9b18b9f8798c62796)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.792488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fb89c-b357-44ca-8240-0d43794fc6ae admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.826209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd228338-1f21-4893-9417-4d2359c4b57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.827192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd228338-1f21-4893-9417-4d2359c4b57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.827476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd228338-1f21-4893-9417-4d2359c4b57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.827746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd228338-1f21-4893-9417-4d2359c4b57f admin admin] PATH_INFO: `/v3/projects/5f996ca7bb5e4e97ad10ad0dabe8bb13` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.831590 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd228338-1f21-4893-9417-4d2359c4b57f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f996ca7bb5e4e97ad10ad0dabe8bb13)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.833777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd228338-1f21-4893-9417-4d2359c4b57f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.982632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-654fb89c-b357-44ca-8240-0d43794fc6ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e8188e8d6d45f9b18b9f8798c62796', 'request_id': 'req-654fb89c-b357-44ca-8240-0d43794fc6ae'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:29.986659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fd228338-1f21-4893-9417-4d2359c4b57f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f996ca7bb5e4e97ad10ad0dabe8bb13', 'request_id': 'req-fd228338-1f21-4893-9417-4d2359c4b57f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:29.990316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-654fb89c-b357-44ca-8240-0d43794fc6ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e8188e8d6d45f9b18b9f8798c62796', 'request_id': 'req-654fb89c-b357-44ca-8240-0d43794fc6ae'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.059407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fd228338-1f21-4893-9417-4d2359c4b57f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f996ca7bb5e4e97ad10ad0dabe8bb13', 'request_id': 'req-fd228338-1f21-4893-9417-4d2359c4b57f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.071727 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fd228338-1f21-4893-9417-4d2359c4b57f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f996ca7bb5e4e97ad10ad0dabe8bb13', 'request_id': 'req-fd228338-1f21-4893-9417-4d2359c4b57f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.088869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fd228338-1f21-4893-9417-4d2359c4b57f admin admin] The token cache is being invalidate because project 5f996ca7bb5e4e97ad10ad0dabe8bb13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:30.089160 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fd228338-1f21-4893-9417-4d2359c4b57f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.089893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fd228338-1f21-4893-9417-4d2359c4b57f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.091750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 924/1862] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:29 2022] DELETE /identity/v3/projects/5f996ca7bb5e4e97ad10ad0dabe8bb13 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:30.092512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd228338-1f21-4893-9417-4d2359c4b57f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:30.097689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fd228338-1f21-4893-9417-4d2359c4b57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:30.168635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd228338-1f21-4893-9417-4d2359c4b57f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:30.174348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67246d02-d7df-4710-ba61-6de69e3102f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:30.175066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67246d02-d7df-4710-ba61-6de69e3102f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:30.175478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67246d02-d7df-4710-ba61-6de69e3102f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:30.175757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67246d02-d7df-4710-ba61-6de69e3102f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:30.176459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67246d02-d7df-4710-ba61-6de69e3102f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:30.178657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67246d02-d7df-4710-ba61-6de69e3102f0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:30.183187 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-654fb89c-b357-44ca-8240-0d43794fc6ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e8188e8d6d45f9b18b9f8798c62796', 'request_id': 'req-654fb89c-b357-44ca-8240-0d43794fc6ae'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.195284 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-654fb89c-b357-44ca-8240-0d43794fc6ae admin admin] The token cache is being invalidate because project 51e8188e8d6d45f9b18b9f8798c62796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:30.202192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-654fb89c-b357-44ca-8240-0d43794fc6ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.202192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-654fb89c-b357-44ca-8240-0d43794fc6ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.202192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 939/1863] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:29 2022] DELETE /identity/v3/projects/51e8188e8d6d45f9b18b9f8798c62796 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:30.202192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb76881-5c9d-4bb0-a9b1-217fd34da934 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:30.202192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb76881-5c9d-4bb0-a9b1-217fd34da934 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:30.202192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb76881-5c9d-4bb0-a9b1-217fd34da934 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:30.202712 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 940/1864] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 20 19:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:36:30.202712 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb76881-5c9d-4bb0-a9b1-217fd34da934 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:30.204202 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cbb76881-5c9d-4bb0-a9b1-217fd34da934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:30.284878 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb76881-5c9d-4bb0-a9b1-217fd34da934 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:30.292009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee5e0d-b122-4aa7-bd9b-6cb8e3c16211 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:30.292009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee5e0d-b122-4aa7-bd9b-6cb8e3c16211 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:30.292009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee5e0d-b122-4aa7-bd9b-6cb8e3c16211 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:30.292392 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee5e0d-b122-4aa7-bd9b-6cb8e3c16211 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:30.292965 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 925/1865] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:30 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:30.294081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67246d02-d7df-4710-ba61-6de69e3102f0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:30.295868 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-aeee5e0d-b122-4aa7-bd9b-6cb8e3c16211 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:30.296739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-67246d02-d7df-4710-ba61-6de69e3102f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:30.312375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67246d02-d7df-4710-ba61-6de69e3102f0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:30.317741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebb220-2f5b-48c1-ba56-c34ab516f674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:30.319289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebb220-2f5b-48c1-ba56-c34ab516f674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:30.319587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebb220-2f5b-48c1-ba56-c34ab516f674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:30.319868 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebb220-2f5b-48c1-ba56-c34ab516f674 admin admin] PATH_INFO: `/v3/users/738549e56f364b4eb4d2561b431eb428` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:30.321663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebb220-2f5b-48c1-ba56-c34ab516f674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=738549e56f364b4eb4d2561b431eb428)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:30.323748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebb220-2f5b-48c1-ba56-c34ab516f674 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:30.364094 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee5e0d-b122-4aa7-bd9b-6cb8e3c16211 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:30.365649 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee5e0d-b122-4aa7-bd9b-6cb8e3c16211 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:30.375713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 941/1866] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:30.377262 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be4944-c0a5-4830-bc7c-52e01613e65b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:30.377554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be4944-c0a5-4830-bc7c-52e01613e65b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:30.377827 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be4944-c0a5-4830-bc7c-52e01613e65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:30.410940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-17be4944-c0a5-4830-bc7c-52e01613e65b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:30.412403 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-17be4944-c0a5-4830-bc7c-52e01613e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:30.424636 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 942/1867] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:30.425868 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be4944-c0a5-4830-bc7c-52e01613e65b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:30.428062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-17be4944-c0a5-4830-bc7c-52e01613e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:30.442366 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be4944-c0a5-4830-bc7c-52e01613e65b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:30.447681 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d792b-b118-4f16-95c9-02515db85809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:30.448655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d792b-b118-4f16-95c9-02515db85809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:30.448939 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d792b-b118-4f16-95c9-02515db85809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:30.452411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d792b-b118-4f16-95c9-02515db85809 admin admin] PATH_INFO: `/v3/users/712dcb455a0446479b40e31431b232ff` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:30.452411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d792b-b118-4f16-95c9-02515db85809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=712dcb455a0446479b40e31431b232ff)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:30.452581 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d792b-b118-4f16-95c9-02515db85809 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:30.487868 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b6ebb220-2f5b-48c1-ba56-c34ab516f674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738549e56f364b4eb4d2561b431eb428'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.601269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b6ebb220-2f5b-48c1-ba56-c34ab516f674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738549e56f364b4eb4d2561b431eb428'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.603157 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b6ebb220-2f5b-48c1-ba56-c34ab516f674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738549e56f364b4eb4d2561b431eb428'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.616708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b6ebb220-2f5b-48c1-ba56-c34ab516f674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738549e56f364b4eb4d2561b431eb428'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.624956 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b6ebb220-2f5b-48c1-ba56-c34ab516f674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738549e56f364b4eb4d2561b431eb428'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.631322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 926/1868] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:30 2022] DELETE /identity/v3/users/738549e56f364b4eb4d2561b431eb428 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:30.632719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54e3d5-2199-4697-a1b8-e5ced4f7d81b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:30.633575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54e3d5-2199-4697-a1b8-e5ced4f7d81b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:30.633842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54e3d5-2199-4697-a1b8-e5ced4f7d81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:30.653240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-df54e3d5-2199-4697-a1b8-e5ced4f7d81b None None] MFA Rules not processed for user `e3fd38ebb5514af686204d0b02a91edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:30.654455 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-df54e3d5-2199-4697-a1b8-e5ced4f7d81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:30.743936 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 927/1869] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 20 19:36:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:30.744859 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54e3d5-2199-4697-a1b8-e5ced4f7d81b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:30.748294 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-df54e3d5-2199-4697-a1b8-e5ced4f7d81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:30.782503 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a43d792b-b118-4f16-95c9-02515db85809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712dcb455a0446479b40e31431b232ff'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.837319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54e3d5-2199-4697-a1b8-e5ced4f7d81b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:30.842473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c4b5d-c93b-4554-8a16-cd58020503d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:30.843448 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c4b5d-c93b-4554-8a16-cd58020503d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:30.843878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c4b5d-c93b-4554-8a16-cd58020503d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:30.844154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c4b5d-c93b-4554-8a16-cd58020503d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:30.844971 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c4b5d-c93b-4554-8a16-cd58020503d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:30.846583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c4b5d-c93b-4554-8a16-cd58020503d5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:30.857886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 928/1870] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:30.859278 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af538a38-664d-42c4-ab52-7ecf51fb1513 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:30.859563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af538a38-664d-42c4-ab52-7ecf51fb1513 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:30.859835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af538a38-664d-42c4-ab52-7ecf51fb1513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:30.879529 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-af538a38-664d-42c4-ab52-7ecf51fb1513 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:30.880733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-af538a38-664d-42c4-ab52-7ecf51fb1513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:30.890702 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 929/1871] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:30.895269 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a43d792b-b118-4f16-95c9-02515db85809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712dcb455a0446479b40e31431b232ff'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.903075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748da954-e267-4e88-a48b-9511a9fa3427 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:30.903660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748da954-e267-4e88-a48b-9511a9fa3427 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:30.903946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748da954-e267-4e88-a48b-9511a9fa3427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:30.904845 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a43d792b-b118-4f16-95c9-02515db85809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712dcb455a0446479b40e31431b232ff'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.931127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a43d792b-b118-4f16-95c9-02515db85809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712dcb455a0446479b40e31431b232ff'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.932225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a43d792b-b118-4f16-95c9-02515db85809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712dcb455a0446479b40e31431b232ff'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:30.938592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-748da954-e267-4e88-a48b-9511a9fa3427 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:30.940823 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-748da954-e267-4e88-a48b-9511a9fa3427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:30.943655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 943/1872] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:30 2022] DELETE /identity/v3/users/712dcb455a0446479b40e31431b232ff => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:30.945613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d792b-b118-4f16-95c9-02515db85809 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:30.960548 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a43d792b-b118-4f16-95c9-02515db85809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:31.053284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 930/1873] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:31.053284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748da954-e267-4e88-a48b-9511a9fa3427 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:31.054810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-748da954-e267-4e88-a48b-9511a9fa3427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:31.069674 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748da954-e267-4e88-a48b-9511a9fa3427 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:31.082522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d09a0-6691-4fa4-85e1-550fb2158bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:31.082858 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d09a0-6691-4fa4-85e1-550fb2158bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:31.083144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d09a0-6691-4fa4-85e1-550fb2158bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:31.083416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d09a0-6691-4fa4-85e1-550fb2158bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:31.084558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d09a0-6691-4fa4-85e1-550fb2158bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:31.090898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d09a0-6691-4fa4-85e1-550fb2158bb6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:31.119823 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 931/1874] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:31.120615 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d09a0-6691-4fa4-85e1-550fb2158bb6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:31.125070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-eb3d09a0-6691-4fa4-85e1-550fb2158bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:31.157744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d09a0-6691-4fa4-85e1-550fb2158bb6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:31.157979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d792b-b118-4f16-95c9-02515db85809 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:31.163068 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899467ab-e3c7-4cd9-8e68-6df8ad2be557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:31.163748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899467ab-e3c7-4cd9-8e68-6df8ad2be557 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:31.164027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899467ab-e3c7-4cd9-8e68-6df8ad2be557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:31.164336 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899467ab-e3c7-4cd9-8e68-6df8ad2be557 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:31.165355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899467ab-e3c7-4cd9-8e68-6df8ad2be557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:31.166004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899467ab-e3c7-4cd9-8e68-6df8ad2be557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:31.167674 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899467ab-e3c7-4cd9-8e68-6df8ad2be557 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:31.175838 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9a639-bb98-4f13-a739-569c0a45ef10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:31.176525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9a639-bb98-4f13-a739-569c0a45ef10 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:31.176803 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9a639-bb98-4f13-a739-569c0a45ef10 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:31.177076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9a639-bb98-4f13-a739-569c0a45ef10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:31.179320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9fc9a639-bb98-4f13-a739-569c0a45ef10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:31.185392 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 932/1875] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:31.187148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899467ab-e3c7-4cd9-8e68-6df8ad2be557 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:31.189070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-899467ab-e3c7-4cd9-8e68-6df8ad2be557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:31.216630 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9a639-bb98-4f13-a739-569c0a45ef10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:31.220631 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9a639-bb98-4f13-a739-569c0a45ef10 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:31.253753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 944/1876] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:31.254727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9a639-bb98-4f13-a739-569c0a45ef10 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:31.287684 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9a639-bb98-4f13-a739-569c0a45ef10 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:31.305735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeda6b3-8723-41a6-bfeb-a25cd0f4d47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:31.307810 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeda6b3-8723-41a6-bfeb-a25cd0f4d47b admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:31.308107 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeda6b3-8723-41a6-bfeb-a25cd0f4d47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:31.308380 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeda6b3-8723-41a6-bfeb-a25cd0f4d47b admin admin] PATH_INFO: `/v3/projects/ea0a1b559d44495b843f4d10ec8e925e/users/36b97ff6cf984c4a8dfbdf288651f234/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:31.314507 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899467ab-e3c7-4cd9-8e68-6df8ad2be557 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:31.321291 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be18ce7-6280-4eae-b531-7fee72e76caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:31.323214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be18ce7-6280-4eae-b531-7fee72e76caf service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:31.323372 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be18ce7-6280-4eae-b531-7fee72e76caf service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:31.323624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be18ce7-6280-4eae-b531-7fee72e76caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:31.337213 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeda6b3-8723-41a6-bfeb-a25cd0f4d47b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0a1b559d44495b843f4d10ec8e925e, user_id=36b97ff6cf984c4a8dfbdf288651f234, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:31.341730 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeda6b3-8723-41a6-bfeb-a25cd0f4d47b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:31.353604 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be18ce7-6280-4eae-b531-7fee72e76caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:31.355912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be18ce7-6280-4eae-b531-7fee72e76caf service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:31.388751 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 933/1877] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:31.390616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be18ce7-6280-4eae-b531-7fee72e76caf service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:31.403563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be18ce7-6280-4eae-b531-7fee72e76caf service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:31.409479 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53881e6-4528-4264-945b-71c70c79c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:31.410275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53881e6-4528-4264-945b-71c70c79c7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:31.410667 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53881e6-4528-4264-945b-71c70c79c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:31.411077 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53881e6-4528-4264-945b-71c70c79c7b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:31.411843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53881e6-4528-4264-945b-71c70c79c7b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:31.413756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53881e6-4528-4264-945b-71c70c79c7b2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:31.464641 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 945/1878] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:31 2022] PUT /identity/v3/projects/ea0a1b559d44495b843f4d10ec8e925e/users/36b97ff6cf984c4a8dfbdf288651f234/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:31.479111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a026f-92c0-4e26-b0fc-4707837599f4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:31.480101 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a026f-92c0-4e26-b0fc-4707837599f4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:31.480690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a026f-92c0-4e26-b0fc-4707837599f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:31.516214 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d64a026f-92c0-4e26-b0fc-4707837599f4 None None] MFA Rules not processed for user `36b97ff6cf984c4a8dfbdf288651f234`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:31.517471 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d64a026f-92c0-4e26-b0fc-4707837599f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:31.531972 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 934/1879] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:31 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:31.532912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53881e6-4528-4264-945b-71c70c79c7b2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:31.623124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 946/1880] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:31.632903 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a026f-92c0-4e26-b0fc-4707837599f4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:31.635091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d64a026f-92c0-4e26-b0fc-4707837599f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:31.640052 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53881e6-4528-4264-945b-71c70c79c7b2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:31.647349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff9b28-e4f4-4b85-a3b6-b562dff47861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:31.647349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff9b28-e4f4-4b85-a3b6-b562dff47861 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:31.647349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff9b28-e4f4-4b85-a3b6-b562dff47861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:31.647349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff9b28-e4f4-4b85-a3b6-b562dff47861 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:31.648042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff9b28-e4f4-4b85-a3b6-b562dff47861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:31.649894 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff9b28-e4f4-4b85-a3b6-b562dff47861 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:31.726996 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a026f-92c0-4e26-b0fc-4707837599f4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:31.777969 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 935/1881] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:31 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:31.778860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff9b28-e4f4-4b85-a3b6-b562dff47861 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:31.782332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ecff9b28-e4f4-4b85-a3b6-b562dff47861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:31.809054 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff9b28-e4f4-4b85-a3b6-b562dff47861 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:31.815929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:31.827887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:31.828180 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:31.828544 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1 admin admin] PATH_INFO: `/v3/projects/ef8ba5a0f3da4844b2c9f4ecfa1b3a74` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:31.829949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef8ba5a0f3da4844b2c9f4ecfa1b3a74)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:31.832706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:31.853229 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58d321-5277-4170-b1d3-fa3d2a905bac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:31.853812 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58d321-5277-4170-b1d3-fa3d2a905bac service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:31.853812 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58d321-5277-4170-b1d3-fa3d2a905bac service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:31.857007 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58d321-5277-4170-b1d3-fa3d2a905bac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:31.880718 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:31.938825 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58d321-5277-4170-b1d3-fa3d2a905bac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:31.940290 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58d321-5277-4170-b1d3-fa3d2a905bac service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:31.949703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 947/1882] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:36:31.950543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58d321-5277-4170-b1d3-fa3d2a905bac service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:31.961246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58d321-5277-4170-b1d3-fa3d2a905bac service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:31.970086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebb3e4-6c82-4f20-9c0f-ae78ebdc62bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:31.970848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebb3e4-6c82-4f20-9c0f-ae78ebdc62bd admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:31.971168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebb3e4-6c82-4f20-9c0f-ae78ebdc62bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:31.971404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebb3e4-6c82-4f20-9c0f-ae78ebdc62bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:31.972164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebb3e4-6c82-4f20-9c0f-ae78ebdc62bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:31.973805 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebb3e4-6c82-4f20-9c0f-ae78ebdc62bd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:31.989414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 948/1883] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:31.990511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebb3e4-6c82-4f20-9c0f-ae78ebdc62bd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:31.995214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef8ba5a0f3da4844b2c9f4ecfa1b3a74', 'request_id': 'req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:32.019607 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebb3e4-6c82-4f20-9c0f-ae78ebdc62bd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:32.141695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef8ba5a0f3da4844b2c9f4ecfa1b3a74', 'request_id': 'req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:32.153480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef8ba5a0f3da4844b2c9f4ecfa1b3a74', 'request_id': 'req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:32.179236 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1 admin admin] The token cache is being invalidate because project ef8ba5a0f3da4844b2c9f4ecfa1b3a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:32.179236 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:32.179236 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:32.179236 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 936/1884] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:31 2022] DELETE /identity/v3/projects/ef8ba5a0f3da4844b2c9f4ecfa1b3a74 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:32.179236 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:32.180084 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07548ae8-4dd2-47d2-8b78-61f578f3e166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:32.181052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07548ae8-4dd2-47d2-8b78-61f578f3e166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:32.181385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07548ae8-4dd2-47d2-8b78-61f578f3e166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:32.181610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07548ae8-4dd2-47d2-8b78-61f578f3e166 admin admin] PATH_INFO: `/v3/users/36b97ff6cf984c4a8dfbdf288651f234` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:32.184123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07548ae8-4dd2-47d2-8b78-61f578f3e166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b97ff6cf984c4a8dfbdf288651f234)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:32.185185 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:32.187612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07548ae8-4dd2-47d2-8b78-61f578f3e166 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:32.206092 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532d6cc-a48f-4fe2-8bf2-e1b983f771b1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:32.216534 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a88e5-9cf6-4379-878a-782e7be8c2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:32.217575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a88e5-9cf6-4379-878a-782e7be8c2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:32.217978 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a88e5-9cf6-4379-878a-782e7be8c2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:32.218322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a88e5-9cf6-4379-878a-782e7be8c2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:32.219281 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a88e5-9cf6-4379-878a-782e7be8c2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:32.221095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a88e5-9cf6-4379-878a-782e7be8c2e2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:32.238122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 937/1885] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:32.239323 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a88e5-9cf6-4379-878a-782e7be8c2e2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:32.243673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-176a88e5-9cf6-4379-878a-782e7be8c2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:32.257099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a88e5-9cf6-4379-878a-782e7be8c2e2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:32.264238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860c60c-2a82-45ec-a524-6e32ad53598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:32.265176 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860c60c-2a82-45ec-a524-6e32ad53598e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:32.265480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860c60c-2a82-45ec-a524-6e32ad53598e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:32.265759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860c60c-2a82-45ec-a524-6e32ad53598e admin admin] PATH_INFO: `/v3/projects/4c20e7faa0354ec5a5fe65c3feef969c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:32.267352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860c60c-2a82-45ec-a524-6e32ad53598e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c20e7faa0354ec5a5fe65c3feef969c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:32.276677 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860c60c-2a82-45ec-a524-6e32ad53598e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:32.426883 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-07548ae8-4dd2-47d2-8b78-61f578f3e166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b97ff6cf984c4a8dfbdf288651f234'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:32.428955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b860c60c-2a82-45ec-a524-6e32ad53598e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c20e7faa0354ec5a5fe65c3feef969c', 'request_id': 'req-b860c60c-2a82-45ec-a524-6e32ad53598e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:32.515802 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-07548ae8-4dd2-47d2-8b78-61f578f3e166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b97ff6cf984c4a8dfbdf288651f234'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:32.524571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-07548ae8-4dd2-47d2-8b78-61f578f3e166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b97ff6cf984c4a8dfbdf288651f234'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:32.539751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-07548ae8-4dd2-47d2-8b78-61f578f3e166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b97ff6cf984c4a8dfbdf288651f234'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:32.541225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-07548ae8-4dd2-47d2-8b78-61f578f3e166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b97ff6cf984c4a8dfbdf288651f234'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:32.547607 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 949/1886] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:31 2022] DELETE /identity/v3/users/36b97ff6cf984c4a8dfbdf288651f234 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:32.548969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa10b3-382f-460a-879b-2563bf247bee None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:32.549258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa10b3-382f-460a-879b-2563bf247bee None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:32.549538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa10b3-382f-460a-879b-2563bf247bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:32.569615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2baa10b3-382f-460a-879b-2563bf247bee None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:32.571847 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2baa10b3-382f-460a-879b-2563bf247bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:32.597993 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b860c60c-2a82-45ec-a524-6e32ad53598e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c20e7faa0354ec5a5fe65c3feef969c', 'request_id': 'req-b860c60c-2a82-45ec-a524-6e32ad53598e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:32.610018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b860c60c-2a82-45ec-a524-6e32ad53598e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c20e7faa0354ec5a5fe65c3feef969c', 'request_id': 'req-b860c60c-2a82-45ec-a524-6e32ad53598e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:32.630498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b860c60c-2a82-45ec-a524-6e32ad53598e admin admin] The token cache is being invalidate because project 4c20e7faa0354ec5a5fe65c3feef969c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:32.630498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b860c60c-2a82-45ec-a524-6e32ad53598e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:32.631465 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b860c60c-2a82-45ec-a524-6e32ad53598e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:32.634114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 938/1887] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:32 2022] DELETE /identity/v3/projects/4c20e7faa0354ec5a5fe65c3feef969c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:32.635230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860c60c-2a82-45ec-a524-6e32ad53598e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:32.637026 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b860c60c-2a82-45ec-a524-6e32ad53598e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:32.656306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 950/1888] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:32.658061 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ab787-55a3-47b6-84c7-2ee6def07319 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:32.658419 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ab787-55a3-47b6-84c7-2ee6def07319 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:32.658727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ab787-55a3-47b6-84c7-2ee6def07319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:32.682133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-853ab787-55a3-47b6-84c7-2ee6def07319 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:32.683335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-853ab787-55a3-47b6-84c7-2ee6def07319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:32.703368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 951/1889] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:32.704353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ab787-55a3-47b6-84c7-2ee6def07319 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:32.711783 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-853ab787-55a3-47b6-84c7-2ee6def07319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:32.725522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ab787-55a3-47b6-84c7-2ee6def07319 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:32.731897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ed9a6-48fb-44f3-882d-9b2fa2909dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:32.733156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ed9a6-48fb-44f3-882d-9b2fa2909dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:32.733529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ed9a6-48fb-44f3-882d-9b2fa2909dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:32.733980 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ed9a6-48fb-44f3-882d-9b2fa2909dfc admin admin] PATH_INFO: `/v3/users/6970a64892a1479587a821025d40c0fe` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:32.735436 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860c60c-2a82-45ec-a524-6e32ad53598e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:32.736067 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ed9a6-48fb-44f3-882d-9b2fa2909dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6970a64892a1479587a821025d40c0fe)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:32.740799 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ed9a6-48fb-44f3-882d-9b2fa2909dfc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:32.741552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1856444-0ca5-40d5-98dd-4343cdf7cfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:32.742436 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1856444-0ca5-40d5-98dd-4343cdf7cfea admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:32.742744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1856444-0ca5-40d5-98dd-4343cdf7cfea admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:32.743046 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1856444-0ca5-40d5-98dd-4343cdf7cfea admin admin] PATH_INFO: `/v3/projects/2f89db61c54346bebf11e0f2f0ef9dc9/users/e3c912ab62514418bbf127cd26472d01/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:32.766178 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1856444-0ca5-40d5-98dd-4343cdf7cfea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f89db61c54346bebf11e0f2f0ef9dc9, user_id=e3c912ab62514418bbf127cd26472d01, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:32.769202 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1856444-0ca5-40d5-98dd-4343cdf7cfea admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:32.964474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 939/1890] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:32 2022] PUT /identity/v3/projects/2f89db61c54346bebf11e0f2f0ef9dc9/users/e3c912ab62514418bbf127cd26472d01/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:32.965659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60dfde-30a8-4b8c-89d9-d8f9dcf93b8d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:32.966018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60dfde-30a8-4b8c-89d9-d8f9dcf93b8d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:32.966364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60dfde-30a8-4b8c-89d9-d8f9dcf93b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:32.990951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8c60dfde-30a8-4b8c-89d9-d8f9dcf93b8d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:32.992362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8c60dfde-30a8-4b8c-89d9-d8f9dcf93b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:33.082971 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:33.084876 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 940/1891] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:33.086047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60dfde-30a8-4b8c-89d9-d8f9dcf93b8d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:33.089528 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8c60dfde-30a8-4b8c-89d9-d8f9dcf93b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:33.095567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c25ed9a6-48fb-44f3-882d-9b2fa2909dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6970a64892a1479587a821025d40c0fe'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.153277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60dfde-30a8-4b8c-89d9-d8f9dcf93b8d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:33.157271 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e37d93-8e1b-4a99-826d-6d7fa933f002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:33.164850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e37d93-8e1b-4a99-826d-6d7fa933f002 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.164850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e37d93-8e1b-4a99-826d-6d7fa933f002 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.164850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e37d93-8e1b-4a99-826d-6d7fa933f002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.169189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e37d93-8e1b-4a99-826d-6d7fa933f002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:33.171037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e37d93-8e1b-4a99-826d-6d7fa933f002 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:33.181260 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 941/1892] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:33.183671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6275ba-8407-49fe-a2d1-295c17518805 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.183957 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6275ba-8407-49fe-a2d1-295c17518805 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.184232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6275ba-8407-49fe-a2d1-295c17518805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.213715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2d6275ba-8407-49fe-a2d1-295c17518805 None None] MFA Rules not processed for user `e3c912ab62514418bbf127cd26472d01`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:33.215070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2d6275ba-8407-49fe-a2d1-295c17518805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:33.272512 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c25ed9a6-48fb-44f3-882d-9b2fa2909dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6970a64892a1479587a821025d40c0fe'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.300914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c25ed9a6-48fb-44f3-882d-9b2fa2909dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6970a64892a1479587a821025d40c0fe'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.320179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c25ed9a6-48fb-44f3-882d-9b2fa2909dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6970a64892a1479587a821025d40c0fe'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.320634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 942/1893] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:33.321374 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c25ed9a6-48fb-44f3-882d-9b2fa2909dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6970a64892a1479587a821025d40c0fe'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.321574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6275ba-8407-49fe-a2d1-295c17518805 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:33.332216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 952/1894] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:32 2022] DELETE /identity/v3/users/6970a64892a1479587a821025d40c0fe => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:33.333293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6275ba-8407-49fe-a2d1-295c17518805 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:33.335272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ed9a6-48fb-44f3-882d-9b2fa2909dfc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:33.342902 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c25ed9a6-48fb-44f3-882d-9b2fa2909dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:33.431807 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17143b-18df-4265-bc25-766055c211d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:33.432469 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17143b-18df-4265-bc25-766055c211d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.432874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17143b-18df-4265-bc25-766055c211d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.433234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17143b-18df-4265-bc25-766055c211d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.434121 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17143b-18df-4265-bc25-766055c211d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:33.434649 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17143b-18df-4265-bc25-766055c211d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:33.436468 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17143b-18df-4265-bc25-766055c211d4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:33.453096 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ed9a6-48fb-44f3-882d-9b2fa2909dfc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:33.456401 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 943/1895] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:33.461049 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17143b-18df-4265-bc25-766055c211d4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:33.462947 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec4424-6e4a-416d-b0d5-1ab78d92c652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:33.463635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec4424-6e4a-416d-b0d5-1ab78d92c652 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.463916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec4424-6e4a-416d-b0d5-1ab78d92c652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.464180 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec4424-6e4a-416d-b0d5-1ab78d92c652 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.464875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec4424-6e4a-416d-b0d5-1ab78d92c652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:33.467119 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec4424-6e4a-416d-b0d5-1ab78d92c652 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:33.469075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ac17143b-18df-4265-bc25-766055c211d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:33.492829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17143b-18df-4265-bc25-766055c211d4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:33.508167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22c63d-f71f-4c5a-98ac-1c568b23ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:33.509351 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22c63d-f71f-4c5a-98ac-1c568b23ac79 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.509872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22c63d-f71f-4c5a-98ac-1c568b23ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.510353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22c63d-f71f-4c5a-98ac-1c568b23ac79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.511337 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22c63d-f71f-4c5a-98ac-1c568b23ac79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:33.515661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22c63d-f71f-4c5a-98ac-1c568b23ac79 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:33.597325 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 953/1896] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:33 2022] POST /identity/v3/projects => generated 385 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:33.598930 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec4424-6e4a-416d-b0d5-1ab78d92c652 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:33.676257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 944/1897] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:33 2022] POST /identity/v3/projects => generated 399 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:33.680928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22c63d-f71f-4c5a-98ac-1c568b23ac79 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:33.681167 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec4424-6e4a-416d-b0d5-1ab78d92c652 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:33.747482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555aa767-141d-42d8-bab7-918c2b929215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:33.748208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555aa767-141d-42d8-bab7-918c2b929215 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.748503 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555aa767-141d-42d8-bab7-918c2b929215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.748779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555aa767-141d-42d8-bab7-918c2b929215 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.749118 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22c63d-f71f-4c5a-98ac-1c568b23ac79 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:33.749649 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555aa767-141d-42d8-bab7-918c2b929215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:33.751764 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555aa767-141d-42d8-bab7-918c2b929215 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:33.754449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79933b-a87c-4e39-aa20-097569d2afd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:33.755419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79933b-a87c-4e39-aa20-097569d2afd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.755886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79933b-a87c-4e39-aa20-097569d2afd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.756168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79933b-a87c-4e39-aa20-097569d2afd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.757106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79933b-a87c-4e39-aa20-097569d2afd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:33.758850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79933b-a87c-4e39-aa20-097569d2afd7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:33.885573 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 945/1898] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:33 2022] POST /identity/v3/users => generated 300 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:36:33.885573 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79933b-a87c-4e39-aa20-097569d2afd7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:33.889155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0f79933b-a87c-4e39-aa20-097569d2afd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:33.889629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 954/1899] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:33 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:33.890739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555aa767-141d-42d8-bab7-918c2b929215 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:33.901903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79933b-a87c-4e39-aa20-097569d2afd7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:33.905359 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555aa767-141d-42d8-bab7-918c2b929215 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:33.907816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6b38a-e54e-4860-916f-56a822268e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:33.909214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6b38a-e54e-4860-916f-56a822268e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.909214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6b38a-e54e-4860-916f-56a822268e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.909431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6b38a-e54e-4860-916f-56a822268e9f admin admin] PATH_INFO: `/v3/projects/ea0a1b559d44495b843f4d10ec8e925e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.914870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6b38a-e54e-4860-916f-56a822268e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea0a1b559d44495b843f4d10ec8e925e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:33.915008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dbb9d-9c89-42c0-910d-28ef0110ecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:33.915008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dbb9d-9c89-42c0-910d-28ef0110ecf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.915008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dbb9d-9c89-42c0-910d-28ef0110ecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.915008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dbb9d-9c89-42c0-910d-28ef0110ecf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.915322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6b38a-e54e-4860-916f-56a822268e9f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:33.915421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307dbb9d-9c89-42c0-910d-28ef0110ecf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:33.915421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307dbb9d-9c89-42c0-910d-28ef0110ecf9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:33.928509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 955/1900] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:33.929852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dbb9d-9c89-42c0-910d-28ef0110ecf9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:33.940321 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dbb9d-9c89-42c0-910d-28ef0110ecf9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:33.945649 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f34dd-5f08-4750-bad8-ca63634fef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:33.946360 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f34dd-5f08-4750-bad8-ca63634fef4d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.946665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f34dd-5f08-4750-bad8-ca63634fef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.947131 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f34dd-5f08-4750-bad8-ca63634fef4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.947877 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f34dd-5f08-4750-bad8-ca63634fef4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:33.949788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f34dd-5f08-4750-bad8-ca63634fef4d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:33.961106 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 956/1901] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:33.961911 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f34dd-5f08-4750-bad8-ca63634fef4d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:33.973362 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f34dd-5f08-4750-bad8-ca63634fef4d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:33.978875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddadf2-4676-4c88-b1b0-9bcb2135ab5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:33.979466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddadf2-4676-4c88-b1b0-9bcb2135ab5e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.979743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddadf2-4676-4c88-b1b0-9bcb2135ab5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.980034 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddadf2-4676-4c88-b1b0-9bcb2135ab5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.980758 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddadf2-4676-4c88-b1b0-9bcb2135ab5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:33.982400 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddadf2-4676-4c88-b1b0-9bcb2135ab5e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:33.992959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 957/1902] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:33.994122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddadf2-4676-4c88-b1b0-9bcb2135ab5e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:34.004427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddadf2-4676-4c88-b1b0-9bcb2135ab5e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:34.009769 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ece13c-f5eb-44c0-9fba-6dc45002194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:34.010446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ece13c-f5eb-44c0-9fba-6dc45002194f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.010738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ece13c-f5eb-44c0-9fba-6dc45002194f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.011013 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ece13c-f5eb-44c0-9fba-6dc45002194f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.011794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ece13c-f5eb-44c0-9fba-6dc45002194f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:34.013373 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ece13c-f5eb-44c0-9fba-6dc45002194f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:34.038785 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 958/1903] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:34.039730 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ece13c-f5eb-44c0-9fba-6dc45002194f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:34.058451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ece13c-f5eb-44c0-9fba-6dc45002194f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:34.075113 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a3f6b38a-e54e-4860-916f-56a822268e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea0a1b559d44495b843f4d10ec8e925e', 'request_id': 'req-a3f6b38a-e54e-4860-916f-56a822268e9f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:34.130870 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb93a73-1051-404b-9279-a39b1367edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:34.131833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb93a73-1051-404b-9279-a39b1367edb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.132183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb93a73-1051-404b-9279-a39b1367edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.132522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb93a73-1051-404b-9279-a39b1367edb1 admin admin] PATH_INFO: `/v3/projects/564aa7502bac48de87b93ec4bec8222f/users/f0a279aec4da40a28c35985834c3b557/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.149233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb93a73-1051-404b-9279-a39b1367edb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=564aa7502bac48de87b93ec4bec8222f, user_id=f0a279aec4da40a28c35985834c3b557, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:34.152936 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb93a73-1051-404b-9279-a39b1367edb1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:34.196632 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a3f6b38a-e54e-4860-916f-56a822268e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea0a1b559d44495b843f4d10ec8e925e', 'request_id': 'req-a3f6b38a-e54e-4860-916f-56a822268e9f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:34.203962 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a3f6b38a-e54e-4860-916f-56a822268e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea0a1b559d44495b843f4d10ec8e925e', 'request_id': 'req-a3f6b38a-e54e-4860-916f-56a822268e9f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:34.218822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a3f6b38a-e54e-4860-916f-56a822268e9f admin admin] The token cache is being invalidate because project ea0a1b559d44495b843f4d10ec8e925e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:34.219110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a3f6b38a-e54e-4860-916f-56a822268e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:34.219858 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a3f6b38a-e54e-4860-916f-56a822268e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:34.221553 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 946/1904] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:33 2022] DELETE /identity/v3/projects/ea0a1b559d44495b843f4d10ec8e925e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:34.222343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6b38a-e54e-4860-916f-56a822268e9f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:34.223822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a3f6b38a-e54e-4860-916f-56a822268e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:34.237063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6b38a-e54e-4860-916f-56a822268e9f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:34.241799 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d48cb4-b192-4a85-9337-e7770d7df200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:34.242658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d48cb4-b192-4a85-9337-e7770d7df200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.242969 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d48cb4-b192-4a85-9337-e7770d7df200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.243245 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d48cb4-b192-4a85-9337-e7770d7df200 admin admin] PATH_INFO: `/v3/projects/d3b9df204f0c4ddfb6ac2ccaf173d3b1` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.244637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d48cb4-b192-4a85-9337-e7770d7df200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b9df204f0c4ddfb6ac2ccaf173d3b1)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:34.246843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d48cb4-b192-4a85-9337-e7770d7df200 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:34.310284 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 959/1905] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:34 2022] PUT /identity/v3/projects/564aa7502bac48de87b93ec4bec8222f/users/f0a279aec4da40a28c35985834c3b557/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:34.311360 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb93a73-1051-404b-9279-a39b1367edb1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:34.313167 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1fb93a73-1051-404b-9279-a39b1367edb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:34.381882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb93a73-1051-404b-9279-a39b1367edb1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:34.387642 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d996d-26f1-4310-8d39-5072e7698a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:34.388751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d996d-26f1-4310-8d39-5072e7698a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.389032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d996d-26f1-4310-8d39-5072e7698a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.389300 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d996d-26f1-4310-8d39-5072e7698a90 admin admin] PATH_INFO: `/v3/projects/27167cd0df1147bf9af9d3f65a408c9a/users/5c057f3124694fc3ab0adcf94d77dd1e/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.409398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d996d-26f1-4310-8d39-5072e7698a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27167cd0df1147bf9af9d3f65a408c9a, user_id=5c057f3124694fc3ab0adcf94d77dd1e, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:34.410553 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-99d48cb4-b192-4a85-9337-e7770d7df200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b9df204f0c4ddfb6ac2ccaf173d3b1', 'request_id': 'req-99d48cb4-b192-4a85-9337-e7770d7df200'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:34.412948 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d996d-26f1-4310-8d39-5072e7698a90 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:34.512069 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-99d48cb4-b192-4a85-9337-e7770d7df200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b9df204f0c4ddfb6ac2ccaf173d3b1', 'request_id': 'req-99d48cb4-b192-4a85-9337-e7770d7df200'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:34.518638 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-99d48cb4-b192-4a85-9337-e7770d7df200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b9df204f0c4ddfb6ac2ccaf173d3b1', 'request_id': 'req-99d48cb4-b192-4a85-9337-e7770d7df200'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:34.531544 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-99d48cb4-b192-4a85-9337-e7770d7df200 admin admin] The token cache is being invalidate because project d3b9df204f0c4ddfb6ac2ccaf173d3b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:34.531831 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-99d48cb4-b192-4a85-9337-e7770d7df200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:34.532525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-99d48cb4-b192-4a85-9337-e7770d7df200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:34.534515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 947/1906] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:34 2022] DELETE /identity/v3/projects/d3b9df204f0c4ddfb6ac2ccaf173d3b1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:34.535523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c88e7-cf61-4199-ae97-3f007e2c3555 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.535774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c88e7-cf61-4199-ae97-3f007e2c3555 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.536053 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c88e7-cf61-4199-ae97-3f007e2c3555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.546843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:34.564875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 960/1907] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:34 2022] PUT /identity/v3/projects/27167cd0df1147bf9af9d3f65a408c9a/users/5c057f3124694fc3ab0adcf94d77dd1e/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:34.567819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-199c88e7-cf61-4199-ae97-3f007e2c3555 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:34.569934 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-199c88e7-cf61-4199-ae97-3f007e2c3555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:34.583621 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31993711-d1b0-4ddd-8d29-5a60cb738615 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.584083 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31993711-d1b0-4ddd-8d29-5a60cb738615 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.584543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31993711-d1b0-4ddd-8d29-5a60cb738615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.631064 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-31993711-d1b0-4ddd-8d29-5a60cb738615 None None] MFA Rules not processed for user `f0a279aec4da40a28c35985834c3b557`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:34.632932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-31993711-d1b0-4ddd-8d29-5a60cb738615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:34.688425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 948/1908] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:34.688425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc7ba4-43a8-4833-bc96-56e797a7bab0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.688425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc7ba4-43a8-4833-bc96-56e797a7bab0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.688425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc7ba4-43a8-4833-bc96-56e797a7bab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.724033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ccbc7ba4-43a8-4833-bc96-56e797a7bab0 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:34.726532 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ccbc7ba4-43a8-4833-bc96-56e797a7bab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:34.747089 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 949/1909] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:34.749154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea892f2a-5770-4166-a583-740d94b21775 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.750088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea892f2a-5770-4166-a583-740d94b21775 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.750575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea892f2a-5770-4166-a583-740d94b21775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.754040 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 961/1910] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:34.756940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe12d4-ddcf-463d-a9d3-1a0c7b1625ca None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.759408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe12d4-ddcf-463d-a9d3-1a0c7b1625ca None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.759408 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe12d4-ddcf-463d-a9d3-1a0c7b1625ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.802496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-54fe12d4-ddcf-463d-a9d3-1a0c7b1625ca None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:34.812639 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-54fe12d4-ddcf-463d-a9d3-1a0c7b1625ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:34.834803 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 962/1911] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:34.835387 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ea892f2a-5770-4166-a583-740d94b21775 None None] MFA Rules not processed for user `5c057f3124694fc3ab0adcf94d77dd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:34.835493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe12d4-ddcf-463d-a9d3-1a0c7b1625ca None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:34.837679 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-54fe12d4-ddcf-463d-a9d3-1a0c7b1625ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:34.838332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ea892f2a-5770-4166-a583-740d94b21775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:34.877487 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe12d4-ddcf-463d-a9d3-1a0c7b1625ca None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:34.886488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efba4ab-1b9a-4757-a2bc-73cacb4b2a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:34.887764 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efba4ab-1b9a-4757-a2bc-73cacb4b2a95 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.888269 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efba4ab-1b9a-4757-a2bc-73cacb4b2a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.888764 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efba4ab-1b9a-4757-a2bc-73cacb4b2a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.890132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efba4ab-1b9a-4757-a2bc-73cacb4b2a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:34.895090 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efba4ab-1b9a-4757-a2bc-73cacb4b2a95 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:34.976112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 950/1912] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:34.979568 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02016b2b-8996-4a99-b82f-98705e90678a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.979568 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02016b2b-8996-4a99-b82f-98705e90678a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.979568 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02016b2b-8996-4a99-b82f-98705e90678a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.000471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-02016b2b-8996-4a99-b82f-98705e90678a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:35.001750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-02016b2b-8996-4a99-b82f-98705e90678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:35.010611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 951/1913] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:35.014876 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02016b2b-8996-4a99-b82f-98705e90678a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.026303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 963/1914] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:34 2022] POST /identity/v3/projects => generated 399 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:35.026498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02016b2b-8996-4a99-b82f-98705e90678a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.031044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efba4ab-1b9a-4757-a2bc-73cacb4b2a95 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.033800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5efba4ab-1b9a-4757-a2bc-73cacb4b2a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:35.103985 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a6bb6-4894-490b-9298-a6dadafd3606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.105240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a6bb6-4894-490b-9298-a6dadafd3606 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.105529 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a6bb6-4894-490b-9298-a6dadafd3606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.105811 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a6bb6-4894-490b-9298-a6dadafd3606 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.106553 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a6bb6-4894-490b-9298-a6dadafd3606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:35.106897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a6bb6-4894-490b-9298-a6dadafd3606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.107842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efba4ab-1b9a-4757-a2bc-73cacb4b2a95 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.108570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a6bb6-4894-490b-9298-a6dadafd3606 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.113225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351a4b7-e97b-461c-b65d-02d5eec2d8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.114353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351a4b7-e97b-461c-b65d-02d5eec2d8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.114896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351a4b7-e97b-461c-b65d-02d5eec2d8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.115656 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351a4b7-e97b-461c-b65d-02d5eec2d8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.116782 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351a4b7-e97b-461c-b65d-02d5eec2d8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.120196 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351a4b7-e97b-461c-b65d-02d5eec2d8d1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.127691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 952/1915] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:35.127691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a6bb6-4894-490b-9298-a6dadafd3606 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.138763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a6bb6-4894-490b-9298-a6dadafd3606 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.143485 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d9b2d-139c-4c5a-b41e-d6fc8f3504d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.144150 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d9b2d-139c-4c5a-b41e-d6fc8f3504d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.144431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d9b2d-139c-4c5a-b41e-d6fc8f3504d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.144703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d9b2d-139c-4c5a-b41e-d6fc8f3504d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.145466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d9b2d-139c-4c5a-b41e-d6fc8f3504d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:35.145770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d9b2d-139c-4c5a-b41e-d6fc8f3504d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.147407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d9b2d-139c-4c5a-b41e-d6fc8f3504d1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.160730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 953/1916] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:35.161669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d9b2d-139c-4c5a-b41e-d6fc8f3504d1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.171996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d9b2d-139c-4c5a-b41e-d6fc8f3504d1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.178382 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf0b56-680a-46a3-b170-aa92c98dfe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.179098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf0b56-680a-46a3-b170-aa92c98dfe9b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.179644 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf0b56-680a-46a3-b170-aa92c98dfe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.179912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf0b56-680a-46a3-b170-aa92c98dfe9b admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.183000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf0b56-680a-46a3-b170-aa92c98dfe9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.183327 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf0b56-680a-46a3-b170-aa92c98dfe9b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.291055 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 954/1917] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:35 2022] POST /identity/v3/users => generated 306 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:35.294542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 964/1918] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:35 2022] POST /identity/v3/projects => generated 385 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:35.294783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf0b56-680a-46a3-b170-aa92c98dfe9b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.294871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351a4b7-e97b-461c-b65d-02d5eec2d8d1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.302824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf0b56-680a-46a3-b170-aa92c98dfe9b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.362753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351a4b7-e97b-461c-b65d-02d5eec2d8d1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.369790 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d466ab7-998d-4c03-a534-1071d864ecd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.370951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466ab7-998d-4c03-a534-1071d864ecd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.371336 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466ab7-998d-4c03-a534-1071d864ecd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.371623 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d466ab7-998d-4c03-a534-1071d864ecd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.372397 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d466ab7-998d-4c03-a534-1071d864ecd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.373968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e98244-0872-453d-b4c8-6adb1613b918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.374339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d466ab7-998d-4c03-a534-1071d864ecd0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.374642 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e98244-0872-453d-b4c8-6adb1613b918 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.375005 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e98244-0872-453d-b4c8-6adb1613b918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.375272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e98244-0872-453d-b4c8-6adb1613b918 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.375964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e98244-0872-453d-b4c8-6adb1613b918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.378120 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e98244-0872-453d-b4c8-6adb1613b918 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.492104 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 955/1919] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:35 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:35.492970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d466ab7-998d-4c03-a534-1071d864ecd0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.493805 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 965/1920] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:35 2022] POST /identity/v3/projects => generated 409 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:35.495497 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e98244-0872-453d-b4c8-6adb1613b918 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.575553 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d466ab7-998d-4c03-a534-1071d864ecd0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.580599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8de626-e088-4328-b243-75fe4f580e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.581290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8de626-e088-4328-b243-75fe4f580e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.581571 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8de626-e088-4328-b243-75fe4f580e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.581844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8de626-e088-4328-b243-75fe4f580e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.585511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8de626-e088-4328-b243-75fe4f580e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.585627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e98244-0872-453d-b4c8-6adb1613b918 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.585709 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8de626-e088-4328-b243-75fe4f580e45 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.590503 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc99c1-a2dc-479c-be54-d9c14faed976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.591230 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc99c1-a2dc-479c-be54-d9c14faed976 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.591513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc99c1-a2dc-479c-be54-d9c14faed976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.591795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc99c1-a2dc-479c-be54-d9c14faed976 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.592498 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc99c1-a2dc-479c-be54-d9c14faed976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.594557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc99c1-a2dc-479c-be54-d9c14faed976 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.599641 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 956/1921] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:35.600535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8de626-e088-4328-b243-75fe4f580e45 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.613586 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8de626-e088-4328-b243-75fe4f580e45 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.618435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fbbed-18be-4861-a02b-1ad286528bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.619157 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fbbed-18be-4861-a02b-1ad286528bee admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.621550 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fbbed-18be-4861-a02b-1ad286528bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.621550 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fbbed-18be-4861-a02b-1ad286528bee admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.621550 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fbbed-18be-4861-a02b-1ad286528bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.623151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fbbed-18be-4861-a02b-1ad286528bee admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.718067 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 966/1922] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:35 2022] POST /identity/v3/users => generated 299 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:35.718918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc99c1-a2dc-479c-be54-d9c14faed976 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.729431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc99c1-a2dc-479c-be54-d9c14faed976 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.735591 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ab221-a557-4ffe-bab1-78f3dd0d0628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.736274 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ab221-a557-4ffe-bab1-78f3dd0d0628 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.736553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ab221-a557-4ffe-bab1-78f3dd0d0628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.736824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ab221-a557-4ffe-bab1-78f3dd0d0628 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.737527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ab221-a557-4ffe-bab1-78f3dd0d0628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.739485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ab221-a557-4ffe-bab1-78f3dd0d0628 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.740564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 957/1923] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:35 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:35.741497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fbbed-18be-4861-a02b-1ad286528bee admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.753282 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fbbed-18be-4861-a02b-1ad286528bee admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.758623 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad3d5a-92d3-4bae-82bd-c5a3d04dde5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.759570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad3d5a-92d3-4bae-82bd-c5a3d04dde5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.759852 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad3d5a-92d3-4bae-82bd-c5a3d04dde5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.760172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad3d5a-92d3-4bae-82bd-c5a3d04dde5a admin admin] PATH_INFO: `/v3/projects/61002688ce4f4cc0a1a6d3a3abde94e4/users/76d9802f234b4822a136892a9ccb5136/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.776449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad3d5a-92d3-4bae-82bd-c5a3d04dde5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61002688ce4f4cc0a1a6d3a3abde94e4, user_id=76d9802f234b4822a136892a9ccb5136, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.779273 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad3d5a-92d3-4bae-82bd-c5a3d04dde5a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.820782 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 967/1924] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:35 2022] POST /identity/v3/users => generated 305 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:35.821745 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ab221-a557-4ffe-bab1-78f3dd0d0628 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.832461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ab221-a557-4ffe-bab1-78f3dd0d0628 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.837466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc464ee5-327c-4698-b699-9edd0336807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.838494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc464ee5-327c-4698-b699-9edd0336807e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.838879 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc464ee5-327c-4698-b699-9edd0336807e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.839508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc464ee5-327c-4698-b699-9edd0336807e admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.840356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc464ee5-327c-4698-b699-9edd0336807e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.843785 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc464ee5-327c-4698-b699-9edd0336807e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.848946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 958/1925] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:35 2022] PUT /identity/v3/projects/61002688ce4f4cc0a1a6d3a3abde94e4/users/76d9802f234b4822a136892a9ccb5136/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:35.849942 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad3d5a-92d3-4bae-82bd-c5a3d04dde5a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.864403 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 968/1926] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:35.865661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc464ee5-327c-4698-b699-9edd0336807e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.889778 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc464ee5-327c-4698-b699-9edd0336807e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.925316 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:35.956142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad3d5a-92d3-4bae-82bd-c5a3d04dde5a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.962286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e74c1-0ebd-40ab-8b25-a00322401b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.963015 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e74c1-0ebd-40ab-8b25-a00322401b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.963443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e74c1-0ebd-40ab-8b25-a00322401b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.963722 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e74c1-0ebd-40ab-8b25-a00322401b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.965666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e74c1-0ebd-40ab-8b25-a00322401b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.967355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e74c1-0ebd-40ab-8b25-a00322401b64 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.983757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 959/1927] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:35.999053 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e74c1-0ebd-40ab-8b25-a00322401b64 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:36.013301 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e74c1-0ebd-40ab-8b25-a00322401b64 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:36.014798 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e78df8-0091-44ed-a3fd-172c27ccfa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:36.016002 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e78df8-0091-44ed-a3fd-172c27ccfa20 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.016266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e78df8-0091-44ed-a3fd-172c27ccfa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.016633 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e78df8-0091-44ed-a3fd-172c27ccfa20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.017383 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e78df8-0091-44ed-a3fd-172c27ccfa20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:36.019245 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e78df8-0091-44ed-a3fd-172c27ccfa20 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:36.024943 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc281f-2b2a-4f94-b62f-215259a6544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:36.025676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc281f-2b2a-4f94-b62f-215259a6544e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.026067 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc281f-2b2a-4f94-b62f-215259a6544e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.026371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc281f-2b2a-4f94-b62f-215259a6544e admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.027247 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc281f-2b2a-4f94-b62f-215259a6544e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:36.031503 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc281f-2b2a-4f94-b62f-215259a6544e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:36.049626 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 969/1928] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:36.050651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e78df8-0091-44ed-a3fd-172c27ccfa20 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:36.057847 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 960/1929] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:36.058950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc281f-2b2a-4f94-b62f-215259a6544e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:36.072405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc281f-2b2a-4f94-b62f-215259a6544e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:36.073239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e78df8-0091-44ed-a3fd-172c27ccfa20 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:36.077394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474915-d9a7-4593-8099-4bd59be27c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:36.078155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474915-d9a7-4593-8099-4bd59be27c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.078510 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474915-d9a7-4593-8099-4bd59be27c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.078895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474915-d9a7-4593-8099-4bd59be27c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.079711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f474915-d9a7-4593-8099-4bd59be27c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:36.079825 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f0f08-5f2f-41e9-ade9-4e2bc511444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:36.080774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f0f08-5f2f-41e9-ade9-4e2bc511444d admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.081765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f474915-d9a7-4593-8099-4bd59be27c09 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:36.081881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f0f08-5f2f-41e9-ade9-4e2bc511444d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.082246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f0f08-5f2f-41e9-ade9-4e2bc511444d admin admin] PATH_INFO: `/v3/projects/c0cf9c86ddc341a0a2f933e9c4fedf50/users/b42988cdc96f436e9cef1dd7ff3bdafd/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.101247 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 961/1930] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:36.101957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f0f08-5f2f-41e9-ade9-4e2bc511444d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cf9c86ddc341a0a2f933e9c4fedf50, user_id=b42988cdc96f436e9cef1dd7ff3bdafd, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:36.102773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474915-d9a7-4593-8099-4bd59be27c09 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:36.106064 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f0f08-5f2f-41e9-ade9-4e2bc511444d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:36.117344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474915-d9a7-4593-8099-4bd59be27c09 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:36.124829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab651f1-19f0-4bd1-b72d-85d34f413de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:36.125643 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab651f1-19f0-4bd1-b72d-85d34f413de8 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.125929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab651f1-19f0-4bd1-b72d-85d34f413de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.126241 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab651f1-19f0-4bd1-b72d-85d34f413de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.126962 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab651f1-19f0-4bd1-b72d-85d34f413de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:36.128620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab651f1-19f0-4bd1-b72d-85d34f413de8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:36.144040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 962/1931] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:36.144040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab651f1-19f0-4bd1-b72d-85d34f413de8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:36.152784 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab651f1-19f0-4bd1-b72d-85d34f413de8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:36.160110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637eb7c-abf2-43fe-a1e9-5ce0737afc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:36.161138 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637eb7c-abf2-43fe-a1e9-5ce0737afc81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.161424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637eb7c-abf2-43fe-a1e9-5ce0737afc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.161700 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637eb7c-abf2-43fe-a1e9-5ce0737afc81 admin admin] PATH_INFO: `/v3/projects/61002688ce4f4cc0a1a6d3a3abde94e4/users/76d9802f234b4822a136892a9ccb5136/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.168352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637eb7c-abf2-43fe-a1e9-5ce0737afc81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61002688ce4f4cc0a1a6d3a3abde94e4, user_id=76d9802f234b4822a136892a9ccb5136, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:36.168352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637eb7c-abf2-43fe-a1e9-5ce0737afc81 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:36.178034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 963/1932] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:36 2022] PUT /identity/v3/projects/61002688ce4f4cc0a1a6d3a3abde94e4/users/76d9802f234b4822a136892a9ccb5136/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:36.190984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637eb7c-abf2-43fe-a1e9-5ce0737afc81 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:36.210456 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 970/1933] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:36 2022] PUT /identity/v3/projects/c0cf9c86ddc341a0a2f933e9c4fedf50/users/b42988cdc96f436e9cef1dd7ff3bdafd/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:36.211484 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f0f08-5f2f-41e9-ade9-4e2bc511444d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:36.278293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637eb7c-abf2-43fe-a1e9-5ce0737afc81 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:36.284360 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f0f08-5f2f-41e9-ade9-4e2bc511444d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:36.289232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66f3e4-44d2-48f8-9610-b28078d1f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:36.289532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522dd8a-6026-45f2-a6af-adef106a361c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:36.290618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522dd8a-6026-45f2-a6af-adef106a361c admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.290908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66f3e4-44d2-48f8-9610-b28078d1f102 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.291021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522dd8a-6026-45f2-a6af-adef106a361c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.291196 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522dd8a-6026-45f2-a6af-adef106a361c admin admin] PATH_INFO: `/v3/projects/995cee7b69734cfcb10029c15d88d963/users/96e07fbe24b5486daa27539366665a19/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.291632 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66f3e4-44d2-48f8-9610-b28078d1f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.292065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66f3e4-44d2-48f8-9610-b28078d1f102 admin admin] PATH_INFO: `/v3/projects/a7d2a6fd8fa44586845747a54b709499/users/0745c71b74d24f9592f8b89a9eb728dc/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.312242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66f3e4-44d2-48f8-9610-b28078d1f102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d2a6fd8fa44586845747a54b709499, user_id=0745c71b74d24f9592f8b89a9eb728dc, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:36.314803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66f3e4-44d2-48f8-9610-b28078d1f102 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:36.319077 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522dd8a-6026-45f2-a6af-adef106a361c admin admin] RBAC: Authorizing `identity:create_grant(project_id=995cee7b69734cfcb10029c15d88d963, user_id=96e07fbe24b5486daa27539366665a19, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:36.321882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522dd8a-6026-45f2-a6af-adef106a361c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:36.397343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 964/1934] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:36 2022] PUT /identity/v3/projects/a7d2a6fd8fa44586845747a54b709499/users/0745c71b74d24f9592f8b89a9eb728dc/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:36.398864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77a716-398f-4752-89e1-0a4c0b6ed94b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.399185 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77a716-398f-4752-89e1-0a4c0b6ed94b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.399423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77a716-398f-4752-89e1-0a4c0b6ed94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.426466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bd77a716-398f-4752-89e1-0a4c0b6ed94b None None] MFA Rules not processed for user `76d9802f234b4822a136892a9ccb5136`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:36.427941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bd77a716-398f-4752-89e1-0a4c0b6ed94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:36.444124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 971/1935] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:36 2022] PUT /identity/v3/projects/995cee7b69734cfcb10029c15d88d963/users/96e07fbe24b5486daa27539366665a19/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:36.444980 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522dd8a-6026-45f2-a6af-adef106a361c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:36.509226 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 965/1936] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:36 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:36.511156 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ddd77-be03-456d-9c4c-e80fbb4eee86 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.511450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ddd77-be03-456d-9c4c-e80fbb4eee86 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.511725 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ddd77-be03-456d-9c4c-e80fbb4eee86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.521509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522dd8a-6026-45f2-a6af-adef106a361c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:36.526219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb25146-9e77-403c-9fe1-b28f17c73440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:36.527925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb25146-9e77-403c-9fe1-b28f17c73440 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.528209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb25146-9e77-403c-9fe1-b28f17c73440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.528483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb25146-9e77-403c-9fe1-b28f17c73440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.529276 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb25146-9e77-403c-9fe1-b28f17c73440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:36.530917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb25146-9e77-403c-9fe1-b28f17c73440 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:36.540599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-683ddd77-be03-456d-9c4c-e80fbb4eee86 None None] MFA Rules not processed for user `0745c71b74d24f9592f8b89a9eb728dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:36.542660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-683ddd77-be03-456d-9c4c-e80fbb4eee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:36.547715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 972/1937] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:36.549615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e091a6-d8fe-4c1a-8420-508e8cfb09f2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.549914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e091a6-d8fe-4c1a-8420-508e8cfb09f2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.550194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e091a6-d8fe-4c1a-8420-508e8cfb09f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.580518 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-75e091a6-d8fe-4c1a-8420-508e8cfb09f2 None None] MFA Rules not processed for user `96e07fbe24b5486daa27539366665a19`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:36.581741 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-75e091a6-d8fe-4c1a-8420-508e8cfb09f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:36.611652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 966/1938] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:36.612465 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ddd77-be03-456d-9c4c-e80fbb4eee86 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:36.624719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ddd77-be03-456d-9c4c-e80fbb4eee86 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:36.629546 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d4f06-8323-44a7-814b-63edf7c7ef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:36.630439 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d4f06-8323-44a7-814b-63edf7c7ef81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.630756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d4f06-8323-44a7-814b-63edf7c7ef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.631034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d4f06-8323-44a7-814b-63edf7c7ef81 admin admin] PATH_INFO: `/v3/projects/c0cf9c86ddc341a0a2f933e9c4fedf50/users/b42988cdc96f436e9cef1dd7ff3bdafd/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.633004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d4f06-8323-44a7-814b-63edf7c7ef81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cf9c86ddc341a0a2f933e9c4fedf50, user_id=b42988cdc96f436e9cef1dd7ff3bdafd, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:36.636112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d4f06-8323-44a7-814b-63edf7c7ef81 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:36.648104 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 967/1939] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:36 2022] PUT /identity/v3/projects/c0cf9c86ddc341a0a2f933e9c4fedf50/users/b42988cdc96f436e9cef1dd7ff3bdafd/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:36.649015 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d4f06-8323-44a7-814b-63edf7c7ef81 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:36.650610 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e99d4f06-8323-44a7-814b-63edf7c7ef81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:36.656736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 973/1940] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:36.657648 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e091a6-d8fe-4c1a-8420-508e8cfb09f2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:36.671098 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e091a6-d8fe-4c1a-8420-508e8cfb09f2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:36.715079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d4f06-8323-44a7-814b-63edf7c7ef81 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:36.719061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27495185-f867-4be6-89aa-0c03c1aa1cc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:36.719735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27495185-f867-4be6-89aa-0c03c1aa1cc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.720006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27495185-f867-4be6-89aa-0c03c1aa1cc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.720283 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27495185-f867-4be6-89aa-0c03c1aa1cc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.734023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292322e-a3aa-4929-8bac-b91b79e2e3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:36.734722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292322e-a3aa-4929-8bac-b91b79e2e3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.735671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292322e-a3aa-4929-8bac-b91b79e2e3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.735671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292322e-a3aa-4929-8bac-b91b79e2e3c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.736051 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292322e-a3aa-4929-8bac-b91b79e2e3c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:36.737995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292322e-a3aa-4929-8bac-b91b79e2e3c5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:36.785675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27495185-f867-4be6-89aa-0c03c1aa1cc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:36.787183 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27495185-f867-4be6-89aa-0c03c1aa1cc5 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:36.799259 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 968/1941] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:36 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:36.800645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18319130-50b6-4fef-b40e-651573de7927 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:36.800925 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18319130-50b6-4fef-b40e-651573de7927 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:36.801211 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18319130-50b6-4fef-b40e-651573de7927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:36.843170 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-18319130-50b6-4fef-b40e-651573de7927 None None] MFA Rules not processed for user `b42988cdc96f436e9cef1dd7ff3bdafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:36.852294 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-18319130-50b6-4fef-b40e-651573de7927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:36.906652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 974/1942] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:36 2022] POST /identity/v3/projects => generated 377 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:36.907878 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292322e-a3aa-4929-8bac-b91b79e2e3c5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:36.998829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:36.999830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 969/1943] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:37.000820 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18319130-50b6-4fef-b40e-651573de7927 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:37.014986 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18319130-50b6-4fef-b40e-651573de7927 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:37.036893 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292322e-a3aa-4929-8bac-b91b79e2e3c5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:37.043700 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0047fd4-fe9b-4684-9d0e-0acdd01c01b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:37.044584 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0047fd4-fe9b-4684-9d0e-0acdd01c01b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:37.044701 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0047fd4-fe9b-4684-9d0e-0acdd01c01b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:37.044947 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0047fd4-fe9b-4684-9d0e-0acdd01c01b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:37.045736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0047fd4-fe9b-4684-9d0e-0acdd01c01b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:37.047726 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0047fd4-fe9b-4684-9d0e-0acdd01c01b1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:37.132685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315a55f-2d7f-4dda-8c4f-60134eca5fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:37.133849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315a55f-2d7f-4dda-8c4f-60134eca5fda admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:37.137659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315a55f-2d7f-4dda-8c4f-60134eca5fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:37.137659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315a55f-2d7f-4dda-8c4f-60134eca5fda admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:37.137659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315a55f-2d7f-4dda-8c4f-60134eca5fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:37.139289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315a55f-2d7f-4dda-8c4f-60134eca5fda admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:37.167472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 975/1944] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:36 2022] POST /identity/v3/projects => generated 407 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:37.168700 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0047fd4-fe9b-4684-9d0e-0acdd01c01b1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:37.231813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0047fd4-fe9b-4684-9d0e-0acdd01c01b1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:37.235774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530ed2a-fb23-4539-a61a-92650af75d41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:37.236514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530ed2a-fb23-4539-a61a-92650af75d41 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:37.236781 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530ed2a-fb23-4539-a61a-92650af75d41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:37.236989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530ed2a-fb23-4539-a61a-92650af75d41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:37.327808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530ed2a-fb23-4539-a61a-92650af75d41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:37.329268 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530ed2a-fb23-4539-a61a-92650af75d41 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:37.340741 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 976/1945] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:37.341630 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530ed2a-fb23-4539-a61a-92650af75d41 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:37.451666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 970/1946] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:36 2022] POST /identity/v3/users => generated 289 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:37.451666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315a55f-2d7f-4dda-8c4f-60134eca5fda admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:37.453128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530ed2a-fb23-4539-a61a-92650af75d41 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:37.462451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5abaa-3a39-479d-b6a4-8798ff87d2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:37.463289 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5abaa-3a39-479d-b6a4-8798ff87d2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:37.463838 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5abaa-3a39-479d-b6a4-8798ff87d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:37.464324 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5abaa-3a39-479d-b6a4-8798ff87d2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:37.465321 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5abaa-3a39-479d-b6a4-8798ff87d2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:37.472320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5abaa-3a39-479d-b6a4-8798ff87d2e2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:37.541192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315a55f-2d7f-4dda-8c4f-60134eca5fda admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:37.546429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b47f7c-2c40-4f9f-8531-0d4e1b8707ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:37.547220 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b47f7c-2c40-4f9f-8531-0d4e1b8707ab service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:37.547690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b47f7c-2c40-4f9f-8531-0d4e1b8707ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:37.548025 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b47f7c-2c40-4f9f-8531-0d4e1b8707ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:37.586388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 977/1947] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:37 2022] POST /identity/v3/users => generated 310 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:37.587375 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5abaa-3a39-479d-b6a4-8798ff87d2e2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:37.598969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5abaa-3a39-479d-b6a4-8798ff87d2e2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:37.609717 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a1ca4-e76e-444e-9e94-24915bcd0a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:37.610976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a1ca4-e76e-444e-9e94-24915bcd0a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:37.611908 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a1ca4-e76e-444e-9e94-24915bcd0a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:37.615076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a1ca4-e76e-444e-9e94-24915bcd0a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:37.615948 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a1ca4-e76e-444e-9e94-24915bcd0a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:37.617587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a1ca4-e76e-444e-9e94-24915bcd0a86 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:37.623295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b47f7c-2c40-4f9f-8531-0d4e1b8707ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:37.626001 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b47f7c-2c40-4f9f-8531-0d4e1b8707ab service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:37.655568 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 971/1948] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:37.655568 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b47f7c-2c40-4f9f-8531-0d4e1b8707ab service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:37.656112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 978/1949] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:37.656112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a1ca4-e76e-444e-9e94-24915bcd0a86 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:37.662515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b47f7c-2c40-4f9f-8531-0d4e1b8707ab service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:37.663736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a1ca4-e76e-444e-9e94-24915bcd0a86 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:37.669450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d95665-b0ce-4141-84ec-defad89afcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:37.670236 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d95665-b0ce-4141-84ec-defad89afcce admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:37.670584 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d95665-b0ce-4141-84ec-defad89afcce admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:37.670980 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d95665-b0ce-4141-84ec-defad89afcce admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:37.671795 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1f902-ba43-40c3-9f20-523d47735071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:37.672484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1f902-ba43-40c3-9f20-523d47735071 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:37.672730 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d95665-b0ce-4141-84ec-defad89afcce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:37.672832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1f902-ba43-40c3-9f20-523d47735071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:37.673034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1f902-ba43-40c3-9f20-523d47735071 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:37.673916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1f902-ba43-40c3-9f20-523d47735071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:37.674665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d95665-b0ce-4141-84ec-defad89afcce admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:37.675712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1f902-ba43-40c3-9f20-523d47735071 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:37.687601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 979/1950] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:37.691930 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d95665-b0ce-4141-84ec-defad89afcce admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:37.695549 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 972/1951] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:37.696843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1f902-ba43-40c3-9f20-523d47735071 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:37.703151 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d95665-b0ce-4141-84ec-defad89afcce admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:37.708299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42737fbc-fb64-41ae-9c90-b240b86a7751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:37.709309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42737fbc-fb64-41ae-9c90-b240b86a7751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:37.709585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42737fbc-fb64-41ae-9c90-b240b86a7751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:37.714970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42737fbc-fb64-41ae-9c90-b240b86a7751 admin admin] PATH_INFO: `/v3/projects/1cedf7e486af4aab9ee0c0ee8d8e68a1/users/9d1d4df3493344ff9d1a2ceba765ca2c/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:37.715134 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1f902-ba43-40c3-9f20-523d47735071 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:37.722073 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d34d7-7bb1-49fd-93f2-23b7474f7470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:37.723163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d34d7-7bb1-49fd-93f2-23b7474f7470 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:37.723896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d34d7-7bb1-49fd-93f2-23b7474f7470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:37.724273 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d34d7-7bb1-49fd-93f2-23b7474f7470 admin admin] PATH_INFO: `/v3/projects/da909f6bb6cd4eb3bf80e58e82e9dd58/users/05515d6940a64fc7ae56a32a11172310/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:37.727991 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42737fbc-fb64-41ae-9c90-b240b86a7751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cedf7e486af4aab9ee0c0ee8d8e68a1, user_id=9d1d4df3493344ff9d1a2ceba765ca2c, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:37.731841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42737fbc-fb64-41ae-9c90-b240b86a7751 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:37.749231 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d34d7-7bb1-49fd-93f2-23b7474f7470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da909f6bb6cd4eb3bf80e58e82e9dd58, user_id=05515d6940a64fc7ae56a32a11172310, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:37.752709 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d34d7-7bb1-49fd-93f2-23b7474f7470 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:37.879989 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 973/1952] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:37 2022] PUT /identity/v3/projects/da909f6bb6cd4eb3bf80e58e82e9dd58/users/05515d6940a64fc7ae56a32a11172310/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:37.881427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 980/1953] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:37 2022] PUT /identity/v3/projects/1cedf7e486af4aab9ee0c0ee8d8e68a1/users/9d1d4df3493344ff9d1a2ceba765ca2c/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:37.891059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d34d7-7bb1-49fd-93f2-23b7474f7470 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:37.897241 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a3e16-caaa-4a45-bc71-1997a4137746 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:37.897734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a3e16-caaa-4a45-bc71-1997a4137746 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:37.898078 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a3e16-caaa-4a45-bc71-1997a4137746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:37.930265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cf2a3e16-caaa-4a45-bc71-1997a4137746 None None] MFA Rules not processed for user `9d1d4df3493344ff9d1a2ceba765ca2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:37.931922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cf2a3e16-caaa-4a45-bc71-1997a4137746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:37.965840 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d34d7-7bb1-49fd-93f2-23b7474f7470 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:37.970510 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cfa2d-36a2-47c1-8b3c-eab454bac51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:37.971217 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cfa2d-36a2-47c1-8b3c-eab454bac51b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:37.971492 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cfa2d-36a2-47c1-8b3c-eab454bac51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:37.971763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cfa2d-36a2-47c1-8b3c-eab454bac51b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:37.972502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cfa2d-36a2-47c1-8b3c-eab454bac51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:37.974168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cfa2d-36a2-47c1-8b3c-eab454bac51b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:37.991031 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 974/1954] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:37.995361 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cfa2d-36a2-47c1-8b3c-eab454bac51b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:38.006509 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cfa2d-36a2-47c1-8b3c-eab454bac51b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:38.007468 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 981/1955] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:36:38.012200 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a3e16-caaa-4a45-bc71-1997a4137746 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:38.021768 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeac17-9332-461e-a2de-3143add06bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:38.023294 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeac17-9332-461e-a2de-3143add06bac admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:38.023294 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeac17-9332-461e-a2de-3143add06bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:38.027019 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeac17-9332-461e-a2de-3143add06bac admin admin] PATH_INFO: `/v3/projects/da909f6bb6cd4eb3bf80e58e82e9dd58/users/05515d6940a64fc7ae56a32a11172310/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:38.029116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a3e16-caaa-4a45-bc71-1997a4137746 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:38.030562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baeac17-9332-461e-a2de-3143add06bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=da909f6bb6cd4eb3bf80e58e82e9dd58, user_id=05515d6940a64fc7ae56a32a11172310, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:38.032967 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a27392-b287-49b5-8516-4736507d7502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:38.033628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baeac17-9332-461e-a2de-3143add06bac admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:38.033760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a27392-b287-49b5-8516-4736507d7502 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:38.033961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a27392-b287-49b5-8516-4736507d7502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:38.034230 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a27392-b287-49b5-8516-4736507d7502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:38.035010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a27392-b287-49b5-8516-4736507d7502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:38.036973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a27392-b287-49b5-8516-4736507d7502 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:38.046698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 975/1956] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:37 2022] PUT /identity/v3/projects/da909f6bb6cd4eb3bf80e58e82e9dd58/users/05515d6940a64fc7ae56a32a11172310/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:38.080279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a07ae-9c42-4d6d-acd1-0c6d511853e9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:38.080841 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a07ae-9c42-4d6d-acd1-0c6d511853e9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:38.080841 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a07ae-9c42-4d6d-acd1-0c6d511853e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:38.115496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-924a07ae-9c42-4d6d-acd1-0c6d511853e9 None None] MFA Rules not processed for user `05515d6940a64fc7ae56a32a11172310`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:38.116807 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-924a07ae-9c42-4d6d-acd1-0c6d511853e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:38.191029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 976/1957] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:38 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:38.206045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 982/1958] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:38 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:38.210210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a07ae-9c42-4d6d-acd1-0c6d511853e9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:38.274338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a07ae-9c42-4d6d-acd1-0c6d511853e9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:38.350889 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acdbf6-fb33-469c-b3c4-a82aef6bbdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:38.351776 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acdbf6-fb33-469c-b3c4-a82aef6bbdb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:38.352062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acdbf6-fb33-469c-b3c4-a82aef6bbdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:38.352345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acdbf6-fb33-469c-b3c4-a82aef6bbdb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:38.353051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acdbf6-fb33-469c-b3c4-a82aef6bbdb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:38.355041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acdbf6-fb33-469c-b3c4-a82aef6bbdb1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:38.392509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:38.465660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 977/1959] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:38 2022] POST /identity/v3/users => generated 295 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:38.469922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a27392-b287-49b5-8516-4736507d7502 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:38.481587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a27392-b287-49b5-8516-4736507d7502 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:38.486619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9c1d5-8249-453e-9ac7-5fcccf5a6640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:38.487338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9c1d5-8249-453e-9ac7-5fcccf5a6640 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:38.487613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9c1d5-8249-453e-9ac7-5fcccf5a6640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:38.488114 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9c1d5-8249-453e-9ac7-5fcccf5a6640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:38.488851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9c1d5-8249-453e-9ac7-5fcccf5a6640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:38.490510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9c1d5-8249-453e-9ac7-5fcccf5a6640 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:38.507256 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 983/1960] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:38.508464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acdbf6-fb33-469c-b3c4-a82aef6bbdb1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:38.520252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acdbf6-fb33-469c-b3c4-a82aef6bbdb1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:38.525624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00043b6-bba6-4542-9c80-0e87e26eafb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:38.526534 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00043b6-bba6-4542-9c80-0e87e26eafb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:38.526843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00043b6-bba6-4542-9c80-0e87e26eafb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:38.527316 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00043b6-bba6-4542-9c80-0e87e26eafb0 admin admin] PATH_INFO: `/v3/projects/0b26c8443ff44242830e528f7f1bb504/users/4c295f01e65d440e861d59b19ba5578d/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:38.545032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00043b6-bba6-4542-9c80-0e87e26eafb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b26c8443ff44242830e528f7f1bb504, user_id=4c295f01e65d440e861d59b19ba5578d, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:38.547916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00043b6-bba6-4542-9c80-0e87e26eafb0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:38.573180 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9c1d5-8249-453e-9ac7-5fcccf5a6640 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:38.634451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9c1d5-8249-453e-9ac7-5fcccf5a6640 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:38.639869 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff73014-27c0-48e1-9ddd-e38163925230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:38.640529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff73014-27c0-48e1-9ddd-e38163925230 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:38.640803 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff73014-27c0-48e1-9ddd-e38163925230 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:38.641238 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff73014-27c0-48e1-9ddd-e38163925230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:38.655843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 978/1961] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:38 2022] PUT /identity/v3/projects/0b26c8443ff44242830e528f7f1bb504/users/4c295f01e65d440e861d59b19ba5578d/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:38.655843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00043b6-bba6-4542-9c80-0e87e26eafb0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:38.717971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff73014-27c0-48e1-9ddd-e38163925230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:38.719505 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff73014-27c0-48e1-9ddd-e38163925230 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:38.726016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00043b6-bba6-4542-9c80-0e87e26eafb0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:38.731926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 984/1962] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:38 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:38.732657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bc012-ee37-4c92-b51b-4075bfe899aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:38.733412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bc012-ee37-4c92-b51b-4075bfe899aa admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:38.733702 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bc012-ee37-4c92-b51b-4075bfe899aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:38.733976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bc012-ee37-4c92-b51b-4075bfe899aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:38.734746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bc012-ee37-4c92-b51b-4075bfe899aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:38.736413 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bc012-ee37-4c92-b51b-4075bfe899aa admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:38.748600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 979/1963] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:36:38.752998 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff73014-27c0-48e1-9ddd-e38163925230 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:38.765445 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff73014-27c0-48e1-9ddd-e38163925230 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:38.770445 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ad3de-9ac2-4d14-b621-c90d757622f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:38.771441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ad3de-9ac2-4d14-b621-c90d757622f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:38.771722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ad3de-9ac2-4d14-b621-c90d757622f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:38.771995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ad3de-9ac2-4d14-b621-c90d757622f3 admin admin] PATH_INFO: `/v3/projects/0b26c8443ff44242830e528f7f1bb504/users/4c295f01e65d440e861d59b19ba5578d/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:38.774544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ad3de-9ac2-4d14-b621-c90d757622f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b26c8443ff44242830e528f7f1bb504, user_id=4c295f01e65d440e861d59b19ba5578d, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:38.777941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ad3de-9ac2-4d14-b621-c90d757622f3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:38.790150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 985/1964] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:38 2022] PUT /identity/v3/projects/0b26c8443ff44242830e528f7f1bb504/users/4c295f01e65d440e861d59b19ba5578d/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:38.808510 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83d95b-3396-42b5-b18b-cc90db02ffc0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:38.809499 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83d95b-3396-42b5-b18b-cc90db02ffc0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:38.809838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83d95b-3396-42b5-b18b-cc90db02ffc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:38.845031 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8d83d95b-3396-42b5-b18b-cc90db02ffc0 None None] MFA Rules not processed for user `4c295f01e65d440e861d59b19ba5578d`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:38.846285 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8d83d95b-3396-42b5-b18b-cc90db02ffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:38.927580 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 980/1965] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:36:38.958520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ad3de-9ac2-4d14-b621-c90d757622f3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:38.960267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-db9ad3de-9ac2-4d14-b621-c90d757622f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:39.023090 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ad3de-9ac2-4d14-b621-c90d757622f3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:39.029540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5c059-eefe-4659-a3e8-75923d38dde0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:39.030353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c059-eefe-4659-a3e8-75923d38dde0 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:39.030641 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c059-eefe-4659-a3e8-75923d38dde0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:39.030940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c059-eefe-4659-a3e8-75923d38dde0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:39.093208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5c059-eefe-4659-a3e8-75923d38dde0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:39.094689 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5c059-eefe-4659-a3e8-75923d38dde0 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:39.104277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 986/1966] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:39.179943 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:39.406315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83d95b-3396-42b5-b18b-cc90db02ffc0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:39.420599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83d95b-3396-42b5-b18b-cc90db02ffc0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:39.420599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3b94c-042f-413c-8311-52f56dce2640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:39.420807 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3b94c-042f-413c-8311-52f56dce2640 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:39.420997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3b94c-042f-413c-8311-52f56dce2640 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:39.421266 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3b94c-042f-413c-8311-52f56dce2640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:39.524047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3b94c-042f-413c-8311-52f56dce2640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:39.526311 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3b94c-042f-413c-8311-52f56dce2640 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:39.536973 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 981/1967] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:39 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:40.160785 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5c059-eefe-4659-a3e8-75923d38dde0 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:40.169891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5c059-eefe-4659-a3e8-75923d38dde0 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:40.173679 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bd23e-98f0-49ee-8740-2e7b643b9bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:40.175023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bd23e-98f0-49ee-8740-2e7b643b9bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:40.175023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bd23e-98f0-49ee-8740-2e7b643b9bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:40.175023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bd23e-98f0-49ee-8740-2e7b643b9bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:40.176754 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7b0bd23e-98f0-49ee-8740-2e7b643b9bc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:40.237360 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bd23e-98f0-49ee-8740-2e7b643b9bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:40.238848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bd23e-98f0-49ee-8740-2e7b643b9bc7 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:40.248780 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 987/1968] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:41.353582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:41.588509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:41.943214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3b94c-042f-413c-8311-52f56dce2640 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:41.950616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3b94c-042f-413c-8311-52f56dce2640 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:41.963465 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267d276-d95a-4e02-b6e8-5498d5fd3543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:41.964537 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267d276-d95a-4e02-b6e8-5498d5fd3543 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:41.964980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267d276-d95a-4e02-b6e8-5498d5fd3543 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:41.965264 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267d276-d95a-4e02-b6e8-5498d5fd3543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:42.045812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267d276-d95a-4e02-b6e8-5498d5fd3543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:42.047450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267d276-d95a-4e02-b6e8-5498d5fd3543 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:42.071086 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 982/1969] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:43.532163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:43.736039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:45.303139 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:45.425384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bd23e-98f0-49ee-8740-2e7b643b9bc7 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:45.427233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7b0bd23e-98f0-49ee-8740-2e7b643b9bc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:45.430910 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267d276-d95a-4e02-b6e8-5498d5fd3543 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:45.440812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267d276-d95a-4e02-b6e8-5498d5fd3543 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:45.445491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab52633-61e4-4bdf-aff7-d84d6a74c76d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:45.446177 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab52633-61e4-4bdf-aff7-d84d6a74c76d service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:45.446456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab52633-61e4-4bdf-aff7-d84d6a74c76d service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:45.451855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab52633-61e4-4bdf-aff7-d84d6a74c76d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:45.458636 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab52633-61e4-4bdf-aff7-d84d6a74c76d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:45.460309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab52633-61e4-4bdf-aff7-d84d6a74c76d service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:45.476722 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 983/1970] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:36:45.508350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bd23e-98f0-49ee-8740-2e7b643b9bc7 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:45.513341 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2e34a-ca75-4945-b07a-0e5539fd1990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:45.514791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2e34a-ca75-4945-b07a-0e5539fd1990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:45.515222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2e34a-ca75-4945-b07a-0e5539fd1990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:45.515672 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2e34a-ca75-4945-b07a-0e5539fd1990 admin admin] PATH_INFO: `/v3/users/71b0f686cee04064a3523fffdb9232d4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:45.518389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2e34a-ca75-4945-b07a-0e5539fd1990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b0f686cee04064a3523fffdb9232d4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:45.522016 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2e34a-ca75-4945-b07a-0e5539fd1990 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:45.545241 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:45.759737 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-46c2e34a-ca75-4945-b07a-0e5539fd1990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b0f686cee04064a3523fffdb9232d4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:45.840747 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-46c2e34a-ca75-4945-b07a-0e5539fd1990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b0f686cee04064a3523fffdb9232d4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:45.860921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-46c2e34a-ca75-4945-b07a-0e5539fd1990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b0f686cee04064a3523fffdb9232d4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:45.876827 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-46c2e34a-ca75-4945-b07a-0e5539fd1990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b0f686cee04064a3523fffdb9232d4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:45.877783 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-46c2e34a-ca75-4945-b07a-0e5539fd1990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b0f686cee04064a3523fffdb9232d4'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:45.885954 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 988/1971] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:45 2022] DELETE /identity/v3/users/71b0f686cee04064a3523fffdb9232d4 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:45.891061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5b3db-e0bf-4fa0-b190-b1206681f204 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:45.891231 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5b3db-e0bf-4fa0-b190-b1206681f204 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:45.892025 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5b3db-e0bf-4fa0-b190-b1206681f204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:45.911932 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-94b5b3db-e0bf-4fa0-b190-b1206681f204 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:45.913211 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-94b5b3db-e0bf-4fa0-b190-b1206681f204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:45.975780 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 984/1972] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:45.993056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2e34a-ca75-4945-b07a-0e5539fd1990 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:45.994529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-46c2e34a-ca75-4945-b07a-0e5539fd1990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:46.060075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2e34a-ca75-4945-b07a-0e5539fd1990 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:46.065499 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a7b03-4b46-474f-a67d-450210b55557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:46.066348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a7b03-4b46-474f-a67d-450210b55557 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:46.066630 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a7b03-4b46-474f-a67d-450210b55557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:46.066935 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a7b03-4b46-474f-a67d-450210b55557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:46.079123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a7b03-4b46-474f-a67d-450210b55557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:46.081156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a7b03-4b46-474f-a67d-450210b55557 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:46.093802 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 989/1973] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:46.485697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5b3db-e0bf-4fa0-b190-b1206681f204 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:46.487297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-94b5b3db-e0bf-4fa0-b190-b1206681f204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:46.552501 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5b3db-e0bf-4fa0-b190-b1206681f204 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:46.556292 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22488407-1370-4d7b-8040-2f295ff93a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:46.556898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22488407-1370-4d7b-8040-2f295ff93a5b service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:46.557175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22488407-1370-4d7b-8040-2f295ff93a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:46.557471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22488407-1370-4d7b-8040-2f295ff93a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:46.559533 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-22488407-1370-4d7b-8040-2f295ff93a5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:46.619323 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22488407-1370-4d7b-8040-2f295ff93a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:46.620761 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22488407-1370-4d7b-8040-2f295ff93a5b service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:46.630234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 985/1974] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:46.667643 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a7b03-4b46-474f-a67d-450210b55557 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:46.669588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ff1a7b03-4b46-474f-a67d-450210b55557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:46.691785 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22488407-1370-4d7b-8040-2f295ff93a5b service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:46.696675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-22488407-1370-4d7b-8040-2f295ff93a5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:46.706536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a7b03-4b46-474f-a67d-450210b55557 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:46.716857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22488407-1370-4d7b-8040-2f295ff93a5b service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:46.722520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:46.722851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcbb4a-2dde-47cb-bb9b-efe193c4af76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:46.723866 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcbb4a-2dde-47cb-bb9b-efe193c4af76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:46.723975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:46.724250 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:46.724383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcbb4a-2dde-47cb-bb9b-efe193c4af76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:46.724637 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32 admin admin] PATH_INFO: `/v3/projects/9dada0a2186f4d939a1100222a3e962e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:46.724742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcbb4a-2dde-47cb-bb9b-efe193c4af76 admin admin] PATH_INFO: `/v3/users/f0a279aec4da40a28c35985834c3b557` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:46.726098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcbb4a-2dde-47cb-bb9b-efe193c4af76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a279aec4da40a28c35985834c3b557)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:46.726212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dada0a2186f4d939a1100222a3e962e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:46.728317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcbb4a-2dde-47cb-bb9b-efe193c4af76 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:46.728514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:46.949344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dada0a2186f4d939a1100222a3e962e', 'request_id': 'req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:46.959715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dada0a2186f4d939a1100222a3e962e', 'request_id': 'req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:46.976251 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-05bcbb4a-2dde-47cb-bb9b-efe193c4af76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a279aec4da40a28c35985834c3b557'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:46.984789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:47.080824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dada0a2186f4d939a1100222a3e962e', 'request_id': 'req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:47.093712 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32 admin admin] The token cache is being invalidate because project 9dada0a2186f4d939a1100222a3e962e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:47.094109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:47.094968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:47.097656 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 990/1975] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:46 2022] DELETE /identity/v3/projects/9dada0a2186f4d939a1100222a3e962e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:47.103617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:47.106556 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:47.177335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c6641-25a6-41bc-9ec6-865fd14bdc32 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:47.182295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36058cc-7ef0-4941-b7f2-6a7b62efc445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:47.183205 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36058cc-7ef0-4941-b7f2-6a7b62efc445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:47.183482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36058cc-7ef0-4941-b7f2-6a7b62efc445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:47.183751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36058cc-7ef0-4941-b7f2-6a7b62efc445 admin admin] PATH_INFO: `/v3/users/8fc0738f05204f3baabf67131efa6e15` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:47.185201 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36058cc-7ef0-4941-b7f2-6a7b62efc445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc0738f05204f3baabf67131efa6e15)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:47.187628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36058cc-7ef0-4941-b7f2-6a7b62efc445 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:47.241033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-05bcbb4a-2dde-47cb-bb9b-efe193c4af76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a279aec4da40a28c35985834c3b557'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:47.241864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-05bcbb4a-2dde-47cb-bb9b-efe193c4af76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a279aec4da40a28c35985834c3b557'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:47.257646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-05bcbb4a-2dde-47cb-bb9b-efe193c4af76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a279aec4da40a28c35985834c3b557'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:47.266564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-05bcbb4a-2dde-47cb-bb9b-efe193c4af76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a279aec4da40a28c35985834c3b557'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:47.274024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 986/1976] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:46 2022] DELETE /identity/v3/users/f0a279aec4da40a28c35985834c3b557 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:47.278943 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65e0c1-abf2-4dbf-a02f-907ec468d573 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:47.279444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65e0c1-abf2-4dbf-a02f-907ec468d573 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:47.284614 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65e0c1-abf2-4dbf-a02f-907ec468d573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:47.300526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8c65e0c1-abf2-4dbf-a02f-907ec468d573 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:47.301789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8c65e0c1-abf2-4dbf-a02f-907ec468d573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:47.368035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 987/1977] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:36:47.378584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65e0c1-abf2-4dbf-a02f-907ec468d573 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:47.380042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8c65e0c1-abf2-4dbf-a02f-907ec468d573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:47.437574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65e0c1-abf2-4dbf-a02f-907ec468d573 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:47.441521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d0ec1-334b-4022-9b3b-df69b79df46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:47.442250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d0ec1-334b-4022-9b3b-df69b79df46f service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:47.442531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d0ec1-334b-4022-9b3b-df69b79df46f service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:47.442842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d0ec1-334b-4022-9b3b-df69b79df46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:47.458974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d0ec1-334b-4022-9b3b-df69b79df46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:47.458974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d0ec1-334b-4022-9b3b-df69b79df46f service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:47.466146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 988/1978] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:36:47.491568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e36058cc-7ef0-4941-b7f2-6a7b62efc445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc0738f05204f3baabf67131efa6e15'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:47.577141 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e36058cc-7ef0-4941-b7f2-6a7b62efc445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc0738f05204f3baabf67131efa6e15'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:47.586599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e36058cc-7ef0-4941-b7f2-6a7b62efc445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc0738f05204f3baabf67131efa6e15'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:47.599843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e36058cc-7ef0-4941-b7f2-6a7b62efc445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc0738f05204f3baabf67131efa6e15'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:47.600290 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e36058cc-7ef0-4941-b7f2-6a7b62efc445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc0738f05204f3baabf67131efa6e15'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:47.606462 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 991/1979] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:47 2022] DELETE /identity/v3/users/8fc0738f05204f3baabf67131efa6e15 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:48.004837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d0ec1-334b-4022-9b3b-df69b79df46f service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:48.007707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-328d0ec1-334b-4022-9b3b-df69b79df46f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:48.026611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d0ec1-334b-4022-9b3b-df69b79df46f service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:48.089861 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:48.090762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:48.091043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:48.091316 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b admin admin] PATH_INFO: `/v3/projects/564aa7502bac48de87b93ec4bec8222f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:48.092524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=564aa7502bac48de87b93ec4bec8222f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:48.095319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:48.149025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36058cc-7ef0-4941-b7f2-6a7b62efc445 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:48.150637 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e36058cc-7ef0-4941-b7f2-6a7b62efc445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:48.166801 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36058cc-7ef0-4941-b7f2-6a7b62efc445 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:48.172806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f4457-abc9-4819-bc1e-3e865cd5aac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:48.176113 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f4457-abc9-4819-bc1e-3e865cd5aac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:48.176113 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f4457-abc9-4819-bc1e-3e865cd5aac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:48.176113 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f4457-abc9-4819-bc1e-3e865cd5aac5 admin admin] PATH_INFO: `/v3/projects/d1d1f4d93d794d2081311d781fe5abb5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:48.179073 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f4457-abc9-4819-bc1e-3e865cd5aac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d1f4d93d794d2081311d781fe5abb5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:48.179073 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f4457-abc9-4819-bc1e-3e865cd5aac5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:48.336535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '564aa7502bac48de87b93ec4bec8222f', 'request_id': 'req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.404185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-568f4457-abc9-4819-bc1e-3e865cd5aac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d1f4d93d794d2081311d781fe5abb5', 'request_id': 'req-568f4457-abc9-4819-bc1e-3e865cd5aac5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.411568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-568f4457-abc9-4819-bc1e-3e865cd5aac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d1f4d93d794d2081311d781fe5abb5', 'request_id': 'req-568f4457-abc9-4819-bc1e-3e865cd5aac5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.436875 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '564aa7502bac48de87b93ec4bec8222f', 'request_id': 'req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.437102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:48.445984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '564aa7502bac48de87b93ec4bec8222f', 'request_id': 'req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.462978 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b admin admin] The token cache is being invalidate because project 564aa7502bac48de87b93ec4bec8222f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:48.463258 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.463855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.465436 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 989/1980] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:48 2022] DELETE /identity/v3/projects/564aa7502bac48de87b93ec4bec8222f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:48.469581 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:48.470966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:48.536030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e32ff-7d8e-43f1-b983-5fc37aca2f8b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:48.542938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-568f4457-abc9-4819-bc1e-3e865cd5aac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d1f4d93d794d2081311d781fe5abb5', 'request_id': 'req-568f4457-abc9-4819-bc1e-3e865cd5aac5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.555881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-568f4457-abc9-4819-bc1e-3e865cd5aac5 admin admin] The token cache is being invalidate because project d1d1f4d93d794d2081311d781fe5abb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:48.556374 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-568f4457-abc9-4819-bc1e-3e865cd5aac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.557097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-568f4457-abc9-4819-bc1e-3e865cd5aac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.563288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 992/1981] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:48 2022] DELETE /identity/v3/projects/d1d1f4d93d794d2081311d781fe5abb5 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:48.564947 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4587b-8d6f-430a-b74f-4ca45e8941c4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:48.565233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4587b-8d6f-430a-b74f-4ca45e8941c4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:48.565506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4587b-8d6f-430a-b74f-4ca45e8941c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:48.584468 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c2a4587b-8d6f-430a-b74f-4ca45e8941c4 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:48.585719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c2a4587b-8d6f-430a-b74f-4ca45e8941c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:48.598251 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fb0e7-c6ce-48ed-b8ac-d0fd9471530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:48.599177 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fb0e7-c6ce-48ed-b8ac-d0fd9471530f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:48.599457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fb0e7-c6ce-48ed-b8ac-d0fd9471530f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:48.599735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fb0e7-c6ce-48ed-b8ac-d0fd9471530f admin admin] PATH_INFO: `/v3/users/76d9802f234b4822a136892a9ccb5136` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:48.600960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fb0e7-c6ce-48ed-b8ac-d0fd9471530f admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d9802f234b4822a136892a9ccb5136)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:48.602973 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fb0e7-c6ce-48ed-b8ac-d0fd9471530f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:48.648191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 993/1982] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:48.656619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48361294-8c8b-4df5-8b1b-84b870f7ffe8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:48.656957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48361294-8c8b-4df5-8b1b-84b870f7ffe8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:48.657250 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48361294-8c8b-4df5-8b1b-84b870f7ffe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:48.677175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-48361294-8c8b-4df5-8b1b-84b870f7ffe8 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:48.678374 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-48361294-8c8b-4df5-8b1b-84b870f7ffe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:48.686604 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 994/1983] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:36:48.694628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48361294-8c8b-4df5-8b1b-84b870f7ffe8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:48.704600 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48361294-8c8b-4df5-8b1b-84b870f7ffe8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:48.709239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4748114-0435-434b-9523-cd3e29d97ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:48.709890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4748114-0435-434b-9523-cd3e29d97ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:48.710163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4748114-0435-434b-9523-cd3e29d97ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:48.710426 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4748114-0435-434b-9523-cd3e29d97ed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:48.711181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4748114-0435-434b-9523-cd3e29d97ed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:48.711480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4748114-0435-434b-9523-cd3e29d97ed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:48.713159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4748114-0435-434b-9523-cd3e29d97ed1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:48.725252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 995/1984] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:36:48.736049 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4748114-0435-434b-9523-cd3e29d97ed1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:48.746230 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4748114-0435-434b-9523-cd3e29d97ed1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:48.751545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961d521-4085-434b-b6d6-4bc0522efb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:48.752224 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961d521-4085-434b-b6d6-4bc0522efb44 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:48.752507 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961d521-4085-434b-b6d6-4bc0522efb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:48.752779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961d521-4085-434b-b6d6-4bc0522efb44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:48.753549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961d521-4085-434b-b6d6-4bc0522efb44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:48.755490 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961d521-4085-434b-b6d6-4bc0522efb44 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:48.914596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 996/1985] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:48 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:48.918545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961d521-4085-434b-b6d6-4bc0522efb44 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:48.929165 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c06fb0e7-c6ce-48ed-b8ac-d0fd9471530f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d9802f234b4822a136892a9ccb5136'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.990485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961d521-4085-434b-b6d6-4bc0522efb44 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:48.995675 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70164290-2204-4cbc-8d77-f052e1eca1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:48.996339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70164290-2204-4cbc-8d77-f052e1eca1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:48.996618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70164290-2204-4cbc-8d77-f052e1eca1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:48.996890 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70164290-2204-4cbc-8d77-f052e1eca1e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:48.997592 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70164290-2204-4cbc-8d77-f052e1eca1e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:48.999593 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70164290-2204-4cbc-8d77-f052e1eca1e0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:49.002484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c06fb0e7-c6ce-48ed-b8ac-d0fd9471530f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d9802f234b4822a136892a9ccb5136'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.003168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c06fb0e7-c6ce-48ed-b8ac-d0fd9471530f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d9802f234b4822a136892a9ccb5136'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.018710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c06fb0e7-c6ce-48ed-b8ac-d0fd9471530f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d9802f234b4822a136892a9ccb5136'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.026338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c06fb0e7-c6ce-48ed-b8ac-d0fd9471530f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d9802f234b4822a136892a9ccb5136'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.033464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 990/1986] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:48 2022] DELETE /identity/v3/users/76d9802f234b4822a136892a9ccb5136 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:49.138586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 997/1987] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:48 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:49.143184 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fb0e7-c6ce-48ed-b8ac-d0fd9471530f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:49.144662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c06fb0e7-c6ce-48ed-b8ac-d0fd9471530f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:49.227818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fb0e7-c6ce-48ed-b8ac-d0fd9471530f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:49.230260 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863c38f-ca54-4364-b3f8-5ad8389ac3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:49.231043 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863c38f-ca54-4364-b3f8-5ad8389ac3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:49.231319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863c38f-ca54-4364-b3f8-5ad8389ac3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:49.231585 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863c38f-ca54-4364-b3f8-5ad8389ac3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:49.232316 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863c38f-ca54-4364-b3f8-5ad8389ac3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:49.237982 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863c38f-ca54-4364-b3f8-5ad8389ac3c9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:49.249388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 991/1988] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:49.255271 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70164290-2204-4cbc-8d77-f052e1eca1e0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:49.265967 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70164290-2204-4cbc-8d77-f052e1eca1e0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:49.271277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57535877-ce90-4828-995f-1d70ac2deffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:49.271878 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57535877-ce90-4828-995f-1d70ac2deffa admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:49.272156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57535877-ce90-4828-995f-1d70ac2deffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:49.272426 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57535877-ce90-4828-995f-1d70ac2deffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:49.273185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57535877-ce90-4828-995f-1d70ac2deffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:49.274897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57535877-ce90-4828-995f-1d70ac2deffa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:49.292813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 998/1989] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:49.297558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863c38f-ca54-4364-b3f8-5ad8389ac3c9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:49.308786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863c38f-ca54-4364-b3f8-5ad8389ac3c9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:49.314851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b8e2d-78a1-457a-b802-b53875a8d307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:49.315883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b8e2d-78a1-457a-b802-b53875a8d307 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:49.316268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b8e2d-78a1-457a-b802-b53875a8d307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:49.316640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b8e2d-78a1-457a-b802-b53875a8d307 admin admin] PATH_INFO: `/v3/projects/38a7e0174aba48b19f6f5a4a97e17d5d/users/90964a25f0a64559b38e9a58321bde9b/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:49.339311 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b8e2d-78a1-457a-b802-b53875a8d307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a7e0174aba48b19f6f5a4a97e17d5d, user_id=90964a25f0a64559b38e9a58321bde9b, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:49.342083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b8e2d-78a1-457a-b802-b53875a8d307 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:49.428457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 992/1990] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:49 2022] PUT /identity/v3/projects/38a7e0174aba48b19f6f5a4a97e17d5d/users/90964a25f0a64559b38e9a58321bde9b/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:49.439596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1677e-d35e-4952-bbf2-d795512aab97 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:49.441745 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1677e-d35e-4952-bbf2-d795512aab97 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:49.441745 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1677e-d35e-4952-bbf2-d795512aab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:49.509627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cca1677e-d35e-4952-bbf2-d795512aab97 None None] MFA Rules not processed for user `90964a25f0a64559b38e9a58321bde9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:49.511211 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cca1677e-d35e-4952-bbf2-d795512aab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:49.610651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 999/1991] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:49.614972 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b8e2d-78a1-457a-b802-b53875a8d307 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:49.634225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1677e-d35e-4952-bbf2-d795512aab97 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:49.636821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cca1677e-d35e-4952-bbf2-d795512aab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:49.727779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b8e2d-78a1-457a-b802-b53875a8d307 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:49.734829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d0842-cf43-4ff7-9f2e-b1c2a80e0500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:49.735565 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d0842-cf43-4ff7-9f2e-b1c2a80e0500 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:49.735920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d0842-cf43-4ff7-9f2e-b1c2a80e0500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:49.736422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d0842-cf43-4ff7-9f2e-b1c2a80e0500 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:49.737218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d0842-cf43-4ff7-9f2e-b1c2a80e0500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:49.740331 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d0842-cf43-4ff7-9f2e-b1c2a80e0500 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:49.757458 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1677e-d35e-4952-bbf2-d795512aab97 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:49.762406 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613a495-ab4d-4576-ab67-f389a03d604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:49.764355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613a495-ab4d-4576-ab67-f389a03d604e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:49.764636 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613a495-ab4d-4576-ab67-f389a03d604e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:49.764942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613a495-ab4d-4576-ab67-f389a03d604e admin admin] PATH_INFO: `/v3/projects/61002688ce4f4cc0a1a6d3a3abde94e4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:49.766875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613a495-ab4d-4576-ab67-f389a03d604e admin admin] RBAC: Authorizing `identity:delete_project(project_id=61002688ce4f4cc0a1a6d3a3abde94e4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:49.768931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613a495-ab4d-4576-ab67-f389a03d604e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:49.779774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:49.850452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 993/1992] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:49 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:36:49.856898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d0842-cf43-4ff7-9f2e-b1c2a80e0500 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:49.929373 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b613a495-ab4d-4576-ab67-f389a03d604e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61002688ce4f4cc0a1a6d3a3abde94e4', 'request_id': 'req-b613a495-ab4d-4576-ab67-f389a03d604e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.938154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b613a495-ab4d-4576-ab67-f389a03d604e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61002688ce4f4cc0a1a6d3a3abde94e4', 'request_id': 'req-b613a495-ab4d-4576-ab67-f389a03d604e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.998825 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d0842-cf43-4ff7-9f2e-b1c2a80e0500 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.036221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b613a495-ab4d-4576-ab67-f389a03d604e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61002688ce4f4cc0a1a6d3a3abde94e4', 'request_id': 'req-b613a495-ab4d-4576-ab67-f389a03d604e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:50.053807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b613a495-ab4d-4576-ab67-f389a03d604e admin admin] The token cache is being invalidate because project 61002688ce4f4cc0a1a6d3a3abde94e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:50.054643 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b613a495-ab4d-4576-ab67-f389a03d604e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:50.055389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b613a495-ab4d-4576-ab67-f389a03d604e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:50.058019 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1000/1993] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:49 2022] DELETE /identity/v3/projects/61002688ce4f4cc0a1a6d3a3abde94e4 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:50.059000 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613a495-ab4d-4576-ab67-f389a03d604e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:50.061447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b613a495-ab4d-4576-ab67-f389a03d604e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:50.080164 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d84de-9ff8-4fe1-8241-fce7ccbdd5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.081044 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d84de-9ff8-4fe1-8241-fce7ccbdd5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.081438 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d84de-9ff8-4fe1-8241-fce7ccbdd5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.081812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d84de-9ff8-4fe1-8241-fce7ccbdd5c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.082661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d84de-9ff8-4fe1-8241-fce7ccbdd5c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:50.084779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d84de-9ff8-4fe1-8241-fce7ccbdd5c1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:50.176214 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613a495-ab4d-4576-ab67-f389a03d604e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.184011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87d144-dece-48a4-bff8-3157bc46cc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.184011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87d144-dece-48a4-bff8-3157bc46cc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.184011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87d144-dece-48a4-bff8-3157bc46cc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.184011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87d144-dece-48a4-bff8-3157bc46cc93 admin admin] PATH_INFO: `/v3/users/96e07fbe24b5486daa27539366665a19` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.184873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87d144-dece-48a4-bff8-3157bc46cc93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96e07fbe24b5486daa27539366665a19)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:50.187431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87d144-dece-48a4-bff8-3157bc46cc93 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:50.224636 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 994/1994] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:49 2022] POST /identity/v3/users => generated 296 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:36:50.226016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6594932-c351-4821-8c55-2dbacfc5d4c9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.226322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6594932-c351-4821-8c55-2dbacfc5d4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.226627 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6594932-c351-4821-8c55-2dbacfc5d4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.253365 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e6594932-c351-4821-8c55-2dbacfc5d4c9 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:50.254542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e6594932-c351-4821-8c55-2dbacfc5d4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:50.272979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 995/1995] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:50.272979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6594932-c351-4821-8c55-2dbacfc5d4c9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:50.274814 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e6594932-c351-4821-8c55-2dbacfc5d4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:50.292219 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6594932-c351-4821-8c55-2dbacfc5d4c9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.298658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6bc1c-4734-4ef1-add1-25ef37ac856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.299566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6bc1c-4734-4ef1-add1-25ef37ac856b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.299891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6bc1c-4734-4ef1-add1-25ef37ac856b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.300175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6bc1c-4734-4ef1-add1-25ef37ac856b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.300929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6bc1c-4734-4ef1-add1-25ef37ac856b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:50.302714 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6bc1c-4734-4ef1-add1-25ef37ac856b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:50.322063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 996/1996] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:50.323740 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703580-44fc-4067-95e3-9e64ba5b1bd5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.323941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703580-44fc-4067-95e3-9e64ba5b1bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.324260 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703580-44fc-4067-95e3-9e64ba5b1bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.351017 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-33703580-44fc-4067-95e3-9e64ba5b1bd5 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:50.353848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-33703580-44fc-4067-95e3-9e64ba5b1bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:50.367078 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 997/1997] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:50.368495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33703580-44fc-4067-95e3-9e64ba5b1bd5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:50.386437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33703580-44fc-4067-95e3-9e64ba5b1bd5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.393287 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb996dab-6907-4c50-be54-7023ce36057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.394291 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb996dab-6907-4c50-be54-7023ce36057b admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.394472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb996dab-6907-4c50-be54-7023ce36057b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.394838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb996dab-6907-4c50-be54-7023ce36057b admin admin] PATH_INFO: `/v3/projects/0e449a01f572433db0a1eb60cb210104/users/ebd1eff659f245e2ac158524ca209e71/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.433254 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb996dab-6907-4c50-be54-7023ce36057b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e449a01f572433db0a1eb60cb210104, user_id=ebd1eff659f245e2ac158524ca209e71, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:50.440788 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb996dab-6907-4c50-be54-7023ce36057b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:50.485356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-be87d144-dece-48a4-bff8-3157bc46cc93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96e07fbe24b5486daa27539366665a19'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:50.554631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 998/1998] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:50 2022] PUT /identity/v3/projects/0e449a01f572433db0a1eb60cb210104/users/ebd1eff659f245e2ac158524ca209e71/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:50.554631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb996dab-6907-4c50-be54-7023ce36057b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:50.569299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-be87d144-dece-48a4-bff8-3157bc46cc93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96e07fbe24b5486daa27539366665a19'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:50.581283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-be87d144-dece-48a4-bff8-3157bc46cc93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96e07fbe24b5486daa27539366665a19'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:50.628426 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-be87d144-dece-48a4-bff8-3157bc46cc93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96e07fbe24b5486daa27539366665a19'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:50.629588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-be87d144-dece-48a4-bff8-3157bc46cc93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96e07fbe24b5486daa27539366665a19'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:50.648772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1001/1999] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:50 2022] DELETE /identity/v3/users/96e07fbe24b5486daa27539366665a19 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:50.652073 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87d144-dece-48a4-bff8-3157bc46cc93 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:50.655141 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-be87d144-dece-48a4-bff8-3157bc46cc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:50.758565 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb996dab-6907-4c50-be54-7023ce36057b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.785133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87d144-dece-48a4-bff8-3157bc46cc93 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.790070 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b0cdd-d8e7-42ba-84af-2b4ec0218b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.790856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b0cdd-d8e7-42ba-84af-2b4ec0218b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.791209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b0cdd-d8e7-42ba-84af-2b4ec0218b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.791631 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b0cdd-d8e7-42ba-84af-2b4ec0218b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.792647 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b0cdd-d8e7-42ba-84af-2b4ec0218b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:50.794585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b0cdd-d8e7-42ba-84af-2b4ec0218b7b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:50.805230 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1002/2000] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:50.806840 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96799b17-1303-4af5-a336-c0cb954dcdef None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.807197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96799b17-1303-4af5-a336-c0cb954dcdef None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.807539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96799b17-1303-4af5-a336-c0cb954dcdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.826052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-96799b17-1303-4af5-a336-c0cb954dcdef None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:50.827335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-96799b17-1303-4af5-a336-c0cb954dcdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:50.837201 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1003/2001] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:50.838764 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96799b17-1303-4af5-a336-c0cb954dcdef None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:50.839469 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c2232-af52-4ff6-9386-44646e6d18e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.840668 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c2232-af52-4ff6-9386-44646e6d18e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.840956 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c2232-af52-4ff6-9386-44646e6d18e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.841584 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c2232-af52-4ff6-9386-44646e6d18e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.841975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c2232-af52-4ff6-9386-44646e6d18e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:50.842286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c2232-af52-4ff6-9386-44646e6d18e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:50.844454 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c2232-af52-4ff6-9386-44646e6d18e0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:50.851368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96799b17-1303-4af5-a336-c0cb954dcdef None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.858182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54c69c-6696-4c79-bd91-3ccf22e9af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.860184 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54c69c-6696-4c79-bd91-3ccf22e9af32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.860989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54c69c-6696-4c79-bd91-3ccf22e9af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.861668 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54c69c-6696-4c79-bd91-3ccf22e9af32 admin admin] PATH_INFO: `/v3/projects/0e449a01f572433db0a1eb60cb210104/users/ebd1eff659f245e2ac158524ca209e71/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.862174 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 999/2002] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:50.863153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c2232-af52-4ff6-9386-44646e6d18e0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:50.864991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-874c2232-af52-4ff6-9386-44646e6d18e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:50.865278 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54c69c-6696-4c79-bd91-3ccf22e9af32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e449a01f572433db0a1eb60cb210104, user_id=ebd1eff659f245e2ac158524ca209e71, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:50.868556 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54c69c-6696-4c79-bd91-3ccf22e9af32 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:50.885119 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1004/2003] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:50 2022] PUT /identity/v3/projects/0e449a01f572433db0a1eb60cb210104/users/ebd1eff659f245e2ac158524ca209e71/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:50.886170 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54c69c-6696-4c79-bd91-3ccf22e9af32 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:50.888109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-da54c69c-6696-4c79-bd91-3ccf22e9af32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:50.931078 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c2232-af52-4ff6-9386-44646e6d18e0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.990080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54c69c-6696-4c79-bd91-3ccf22e9af32 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.996533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc373413-cb0f-43c6-8abd-8320bc9b0c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.997240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc373413-cb0f-43c6-8abd-8320bc9b0c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.997573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc373413-cb0f-43c6-8abd-8320bc9b0c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.999193 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc373413-cb0f-43c6-8abd-8320bc9b0c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.999193 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc373413-cb0f-43c6-8abd-8320bc9b0c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:51.002035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791976a-f8b8-487d-8700-9f2b3f956f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:51.009168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791976a-f8b8-487d-8700-9f2b3f956f43 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:51.009168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791976a-f8b8-487d-8700-9f2b3f956f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:51.009168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791976a-f8b8-487d-8700-9f2b3f956f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:51.009493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc373413-cb0f-43c6-8abd-8320bc9b0c34 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:51.021680 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791976a-f8b8-487d-8700-9f2b3f956f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:51.023510 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791976a-f8b8-487d-8700-9f2b3f956f43 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:51.042417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1000/2004] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:51.052585 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeca476-9301-4d56-ac67-1c03ccea41ac None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:51.053383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeca476-9301-4d56-ac67-1c03ccea41ac None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:51.053683 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeca476-9301-4d56-ac67-1c03ccea41ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:51.086948 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7aeca476-9301-4d56-ac67-1c03ccea41ac None None] MFA Rules not processed for user `ebd1eff659f245e2ac158524ca209e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:51.088113 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7aeca476-9301-4d56-ac67-1c03ccea41ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:51.184851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1001/2005] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:51.200090 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:51.207393 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1005/2006] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:50 2022] POST /identity/v3/projects => generated 383 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:51.210778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeca476-9301-4d56-ac67-1c03ccea41ac None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:51.211101 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc373413-cb0f-43c6-8abd-8320bc9b0c34 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:51.212224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7aeca476-9301-4d56-ac67-1c03ccea41ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:51.354099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeca476-9301-4d56-ac67-1c03ccea41ac None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:51.354900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc373413-cb0f-43c6-8abd-8320bc9b0c34 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:51.354900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedf62c-ed9f-45a0-84f0-6d09718afcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:51.354900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedf62c-ed9f-45a0-84f0-6d09718afcaf admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:51.354900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedf62c-ed9f-45a0-84f0-6d09718afcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:51.355190 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedf62c-ed9f-45a0-84f0-6d09718afcaf admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:51.355190 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedf62c-ed9f-45a0-84f0-6d09718afcaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:51.355190 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedf62c-ed9f-45a0-84f0-6d09718afcaf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:51.356603 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981ebfe-06cc-41fb-931c-218ce68c341e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:51.357287 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981ebfe-06cc-41fb-931c-218ce68c341e service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:51.357701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981ebfe-06cc-41fb-931c-218ce68c341e service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:51.357865 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981ebfe-06cc-41fb-931c-218ce68c341e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:51.360084 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2981ebfe-06cc-41fb-931c-218ce68c341e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:51.461150 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981ebfe-06cc-41fb-931c-218ce68c341e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:51.470277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981ebfe-06cc-41fb-931c-218ce68c341e service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:51.480175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1002/2007] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:51.522307 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1006/2008] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:51 2022] POST /identity/v3/users => generated 292 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:51.666312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981ebfe-06cc-41fb-931c-218ce68c341e service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:51.674635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981ebfe-06cc-41fb-931c-218ce68c341e service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:51.679370 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088bc1-9f83-4eaf-8a87-b64efa92b80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:51.680046 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088bc1-9f83-4eaf-8a87-b64efa92b80c admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:51.680328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088bc1-9f83-4eaf-8a87-b64efa92b80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:51.680600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088bc1-9f83-4eaf-8a87-b64efa92b80c admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:51.681333 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71088bc1-9f83-4eaf-8a87-b64efa92b80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:51.682972 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71088bc1-9f83-4eaf-8a87-b64efa92b80c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:51.698757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1003/2009] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:51.700528 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedf62c-ed9f-45a0-84f0-6d09718afcaf admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:51.724040 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedf62c-ed9f-45a0-84f0-6d09718afcaf admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:51.744544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd77c46-c7cf-4554-9f8c-4a77eb9db20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:51.744544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd77c46-c7cf-4554-9f8c-4a77eb9db20a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:51.744544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd77c46-c7cf-4554-9f8c-4a77eb9db20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:51.744544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd77c46-c7cf-4554-9f8c-4a77eb9db20a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:51.745122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd77c46-c7cf-4554-9f8c-4a77eb9db20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:51.745122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd77c46-c7cf-4554-9f8c-4a77eb9db20a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:51.745122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1007/2010] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:51.748919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088bc1-9f83-4eaf-8a87-b64efa92b80c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:51.761350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088bc1-9f83-4eaf-8a87-b64efa92b80c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:51.766327 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e209106-679b-4c99-b37a-2e46f94367ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:51.768045 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e209106-679b-4c99-b37a-2e46f94367ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:51.768295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e209106-679b-4c99-b37a-2e46f94367ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:51.768527 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e209106-679b-4c99-b37a-2e46f94367ae admin admin] PATH_INFO: `/v3/projects/cd4b120e93a440318c4645d14cb2bdb3/users/adcf9063dc1443b994c552aae40edb3e/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:51.786799 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e209106-679b-4c99-b37a-2e46f94367ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4b120e93a440318c4645d14cb2bdb3, user_id=adcf9063dc1443b994c552aae40edb3e, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:51.789489 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e209106-679b-4c99-b37a-2e46f94367ae admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:52.160229 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd77c46-c7cf-4554-9f8c-4a77eb9db20a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:52.162285 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1fd77c46-c7cf-4554-9f8c-4a77eb9db20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:52.176475 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd77c46-c7cf-4554-9f8c-4a77eb9db20a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:52.182541 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:52.185475 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:52.185475 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:52.185475 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c admin admin] PATH_INFO: `/v3/projects/995cee7b69734cfcb10029c15d88d963` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:52.185475 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c admin admin] RBAC: Authorizing `identity:delete_project(project_id=995cee7b69734cfcb10029c15d88d963)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:52.187670 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:52.217991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1004/2011] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:51 2022] PUT /identity/v3/projects/cd4b120e93a440318c4645d14cb2bdb3/users/adcf9063dc1443b994c552aae40edb3e/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:52.229150 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233bad7-3dec-4e65-8902-32f51f6c4aad None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:52.229440 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233bad7-3dec-4e65-8902-32f51f6c4aad None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:52.229709 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233bad7-3dec-4e65-8902-32f51f6c4aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:52.261861 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9233bad7-3dec-4e65-8902-32f51f6c4aad None None] MFA Rules not processed for user `adcf9063dc1443b994c552aae40edb3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:52.263369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9233bad7-3dec-4e65-8902-32f51f6c4aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:52.337559 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1005/2012] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:36:52.342149 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233bad7-3dec-4e65-8902-32f51f6c4aad None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:52.386572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995cee7b69734cfcb10029c15d88d963', 'request_id': 'req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:52.393385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995cee7b69734cfcb10029c15d88d963', 'request_id': 'req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:52.404502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233bad7-3dec-4e65-8902-32f51f6c4aad None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:52.472101 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f7246-f944-48f1-b5fc-ea2f6284b513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:52.472883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f7246-f944-48f1-b5fc-ea2f6284b513 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:52.473167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f7246-f944-48f1-b5fc-ea2f6284b513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:52.473444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f7246-f944-48f1-b5fc-ea2f6284b513 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:52.474156 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f7246-f944-48f1-b5fc-ea2f6284b513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:52.476144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f7246-f944-48f1-b5fc-ea2f6284b513 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:52.525686 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:52.530194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995cee7b69734cfcb10029c15d88d963', 'request_id': 'req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:52.544119 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c admin admin] The token cache is being invalidate because project 995cee7b69734cfcb10029c15d88d963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:52.544410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:52.545155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:52.547298 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1008/2013] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:52 2022] DELETE /identity/v3/projects/995cee7b69734cfcb10029c15d88d963 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:52.552000 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:52.553485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:52.567466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed1675-6a4e-4aaf-bd97-f51b94bd633c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:52.572426 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573969a-d1df-47e3-8233-97e19735c2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:52.573317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573969a-d1df-47e3-8233-97e19735c2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:52.573590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573969a-d1df-47e3-8233-97e19735c2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:52.573855 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573969a-d1df-47e3-8233-97e19735c2aa admin admin] PATH_INFO: `/v3/users/05515d6940a64fc7ae56a32a11172310` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:52.575128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573969a-d1df-47e3-8233-97e19735c2aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=05515d6940a64fc7ae56a32a11172310)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:52.577123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573969a-d1df-47e3-8233-97e19735c2aa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:52.635035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1006/2014] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:52 2022] POST /identity/v3/projects => generated 381 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:36:52.639330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f7246-f944-48f1-b5fc-ea2f6284b513 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:52.641175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c21f7246-f944-48f1-b5fc-ea2f6284b513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:52.714131 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f7246-f944-48f1-b5fc-ea2f6284b513 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:52.719915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdd4a6-8521-4499-af65-a5e9358e6758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:52.720620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd4a6-8521-4499-af65-a5e9358e6758 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:52.720893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd4a6-8521-4499-af65-a5e9358e6758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:52.721918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd4a6-8521-4499-af65-a5e9358e6758 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:52.722652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdd4a6-8521-4499-af65-a5e9358e6758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:52.725229 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdd4a6-8521-4499-af65-a5e9358e6758 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:52.770176 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d573969a-d1df-47e3-8233-97e19735c2aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05515d6940a64fc7ae56a32a11172310'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:52.780348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:52.850877 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1007/2015] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:52 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:52.851935 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdd4a6-8521-4499-af65-a5e9358e6758 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:52.853836 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ddfdd4a6-8521-4499-af65-a5e9358e6758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:52.861481 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d573969a-d1df-47e3-8233-97e19735c2aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05515d6940a64fc7ae56a32a11172310'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:52.874486 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d573969a-d1df-47e3-8233-97e19735c2aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05515d6940a64fc7ae56a32a11172310'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:52.888356 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdd4a6-8521-4499-af65-a5e9358e6758 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:52.897058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049c4e2-21a1-464e-8262-30fcb7aa0153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:52.898881 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049c4e2-21a1-464e-8262-30fcb7aa0153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:52.899046 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d573969a-d1df-47e3-8233-97e19735c2aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05515d6940a64fc7ae56a32a11172310'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:52.899349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049c4e2-21a1-464e-8262-30fcb7aa0153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:52.899666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d573969a-d1df-47e3-8233-97e19735c2aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05515d6940a64fc7ae56a32a11172310'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:52.899785 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049c4e2-21a1-464e-8262-30fcb7aa0153 admin admin] PATH_INFO: `/v3/users/0745c71b74d24f9592f8b89a9eb728dc` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:52.902594 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049c4e2-21a1-464e-8262-30fcb7aa0153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0745c71b74d24f9592f8b89a9eb728dc)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:52.906204 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049c4e2-21a1-464e-8262-30fcb7aa0153 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:52.911016 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1009/2016] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:52 2022] DELETE /identity/v3/users/05515d6940a64fc7ae56a32a11172310 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:52.911016 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573969a-d1df-47e3-8233-97e19735c2aa admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:52.926463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d573969a-d1df-47e3-8233-97e19735c2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:53.030613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573969a-d1df-47e3-8233-97e19735c2aa admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:53.057272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1105b-2716-4ce8-8535-14ea448c34cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:53.058057 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1105b-2716-4ce8-8535-14ea448c34cf admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:53.058343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1105b-2716-4ce8-8535-14ea448c34cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:53.058620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1105b-2716-4ce8-8535-14ea448c34cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:53.059460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1105b-2716-4ce8-8535-14ea448c34cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:53.061210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1105b-2716-4ce8-8535-14ea448c34cf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:53.072543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1010/2017] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:53.073243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1105b-2716-4ce8-8535-14ea448c34cf admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:53.075103 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-57c1105b-2716-4ce8-8535-14ea448c34cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:53.088381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1105b-2716-4ce8-8535-14ea448c34cf admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:53.095653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf03d6f-de10-4562-9fdf-db9c6a2530de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:53.097222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03d6f-de10-4562-9fdf-db9c6a2530de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:53.097713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03d6f-de10-4562-9fdf-db9c6a2530de admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:53.098189 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03d6f-de10-4562-9fdf-db9c6a2530de admin admin] PATH_INFO: `/v3/users/e3c912ab62514418bbf127cd26472d01` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:53.100465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf03d6f-de10-4562-9fdf-db9c6a2530de admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3c912ab62514418bbf127cd26472d01)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:53.102926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf03d6f-de10-4562-9fdf-db9c6a2530de admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:53.127624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6049c4e2-21a1-464e-8262-30fcb7aa0153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0745c71b74d24f9592f8b89a9eb728dc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:53.256477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6049c4e2-21a1-464e-8262-30fcb7aa0153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0745c71b74d24f9592f8b89a9eb728dc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:53.257218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6049c4e2-21a1-464e-8262-30fcb7aa0153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0745c71b74d24f9592f8b89a9eb728dc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:53.272074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6049c4e2-21a1-464e-8262-30fcb7aa0153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0745c71b74d24f9592f8b89a9eb728dc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:53.278998 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6049c4e2-21a1-464e-8262-30fcb7aa0153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0745c71b74d24f9592f8b89a9eb728dc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:53.291025 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1008/2018] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:52 2022] DELETE /identity/v3/users/0745c71b74d24f9592f8b89a9eb728dc => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:53.292033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049c4e2-21a1-464e-8262-30fcb7aa0153 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:53.293793 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6049c4e2-21a1-464e-8262-30fcb7aa0153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:53.363853 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049c4e2-21a1-464e-8262-30fcb7aa0153 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:53.368735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3b3e9-afe6-4b6f-a982-84dc326c32c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:53.369665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3b3e9-afe6-4b6f-a982-84dc326c32c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:53.369945 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3b3e9-afe6-4b6f-a982-84dc326c32c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:53.370219 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3b3e9-afe6-4b6f-a982-84dc326c32c1 admin admin] PATH_INFO: `/v3/projects/b0b8f4702c6e432d88bdf9f826d592bf/users/356df5b834454319aaa91584809b22c1/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:53.385493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3b3e9-afe6-4b6f-a982-84dc326c32c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b8f4702c6e432d88bdf9f826d592bf, user_id=356df5b834454319aaa91584809b22c1, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:53.388192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3b3e9-afe6-4b6f-a982-84dc326c32c1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:53.489164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ddf03d6f-de10-4562-9fdf-db9c6a2530de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3c912ab62514418bbf127cd26472d01'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:53.512978 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1009/2019] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:53 2022] PUT /identity/v3/projects/b0b8f4702c6e432d88bdf9f826d592bf/users/356df5b834454319aaa91584809b22c1/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:53.514726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26dbc0-bc62-41ec-9610-d874b5fab271 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:53.514726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26dbc0-bc62-41ec-9610-d874b5fab271 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:53.514975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26dbc0-bc62-41ec-9610-d874b5fab271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:53.532908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-cc26dbc0-bc62-41ec-9610-d874b5fab271 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:53.534429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cc26dbc0-bc62-41ec-9610-d874b5fab271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:53.598121 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1010/2020] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:53.599094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26dbc0-bc62-41ec-9610-d874b5fab271 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:53.605619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cc26dbc0-bc62-41ec-9610-d874b5fab271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:53.608000 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ddf03d6f-de10-4562-9fdf-db9c6a2530de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3c912ab62514418bbf127cd26472d01'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:53.619723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ddf03d6f-de10-4562-9fdf-db9c6a2530de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3c912ab62514418bbf127cd26472d01'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:53.625655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26dbc0-bc62-41ec-9610-d874b5fab271 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:53.632324 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe60b1b-5945-4922-879e-9bda059eade6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:53.633471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe60b1b-5945-4922-879e-9bda059eade6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:53.633669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe60b1b-5945-4922-879e-9bda059eade6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:53.634019 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe60b1b-5945-4922-879e-9bda059eade6 admin admin] PATH_INFO: `/v3/projects/da909f6bb6cd4eb3bf80e58e82e9dd58` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:53.635421 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe60b1b-5945-4922-879e-9bda059eade6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da909f6bb6cd4eb3bf80e58e82e9dd58)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:53.635936 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ddf03d6f-de10-4562-9fdf-db9c6a2530de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3c912ab62514418bbf127cd26472d01'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:53.636658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ddf03d6f-de10-4562-9fdf-db9c6a2530de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3c912ab62514418bbf127cd26472d01'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:53.637306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe60b1b-5945-4922-879e-9bda059eade6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:53.645135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1011/2021] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:53 2022] DELETE /identity/v3/users/e3c912ab62514418bbf127cd26472d01 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:53.650180 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf03d6f-de10-4562-9fdf-db9c6a2530de admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:53.650180 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ddf03d6f-de10-4562-9fdf-db9c6a2530de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:53.718011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf03d6f-de10-4562-9fdf-db9c6a2530de admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:53.728494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5fb0c-bf5e-4585-8531-3bbc1f1a5a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:53.728494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5fb0c-bf5e-4585-8531-3bbc1f1a5a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:53.728494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5fb0c-bf5e-4585-8531-3bbc1f1a5a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:53.728494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5fb0c-bf5e-4585-8531-3bbc1f1a5a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:53.728915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5fb0c-bf5e-4585-8531-3bbc1f1a5a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:53.730349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5fb0c-bf5e-4585-8531-3bbc1f1a5a4d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:53.745776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1012/2022] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:53.745776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5fb0c-bf5e-4585-8531-3bbc1f1a5a4d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:53.745776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-11e5fb0c-bf5e-4585-8531-3bbc1f1a5a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:53.759419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dbe60b1b-5945-4922-879e-9bda059eade6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da909f6bb6cd4eb3bf80e58e82e9dd58', 'request_id': 'req-dbe60b1b-5945-4922-879e-9bda059eade6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:53.819752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5fb0c-bf5e-4585-8531-3bbc1f1a5a4d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:53.872524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f06d4-f79e-4f18-8dbb-a961d4eceebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:53.873181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f06d4-f79e-4f18-8dbb-a961d4eceebe service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:53.873462 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f06d4-f79e-4f18-8dbb-a961d4eceebe service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:53.873736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f06d4-f79e-4f18-8dbb-a961d4eceebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:53.875646 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f48f06d4-f79e-4f18-8dbb-a961d4eceebe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:53.889974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dbe60b1b-5945-4922-879e-9bda059eade6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da909f6bb6cd4eb3bf80e58e82e9dd58', 'request_id': 'req-dbe60b1b-5945-4922-879e-9bda059eade6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:53.901072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dbe60b1b-5945-4922-879e-9bda059eade6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da909f6bb6cd4eb3bf80e58e82e9dd58', 'request_id': 'req-dbe60b1b-5945-4922-879e-9bda059eade6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:53.910367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dbe60b1b-5945-4922-879e-9bda059eade6 admin admin] The token cache is being invalidate because project da909f6bb6cd4eb3bf80e58e82e9dd58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:53.910801 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dbe60b1b-5945-4922-879e-9bda059eade6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:53.911554 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dbe60b1b-5945-4922-879e-9bda059eade6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:53.913616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1011/2023] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:53 2022] DELETE /identity/v3/projects/da909f6bb6cd4eb3bf80e58e82e9dd58 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:53.915812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf875ad-0a98-4308-8d92-8da114e1a654 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:53.915812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf875ad-0a98-4308-8d92-8da114e1a654 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:53.915812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf875ad-0a98-4308-8d92-8da114e1a654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:53.935662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7bf875ad-0a98-4308-8d92-8da114e1a654 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:53.937822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7bf875ad-0a98-4308-8d92-8da114e1a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:53.949078 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f06d4-f79e-4f18-8dbb-a961d4eceebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:53.950594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f06d4-f79e-4f18-8dbb-a961d4eceebe service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:53.955845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1012/2024] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:53.955845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf875ad-0a98-4308-8d92-8da114e1a654 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:53.958426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7bf875ad-0a98-4308-8d92-8da114e1a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:53.969566 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1013/2025] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:53.970438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f06d4-f79e-4f18-8dbb-a961d4eceebe service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:53.971893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf875ad-0a98-4308-8d92-8da114e1a654 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:53.972031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f48f06d4-f79e-4f18-8dbb-a961d4eceebe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:53.977964 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1ef2f-0245-4dd5-bfd8-08709cdf4cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:53.979081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1ef2f-0245-4dd5-bfd8-08709cdf4cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:53.979361 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1ef2f-0245-4dd5-bfd8-08709cdf4cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:53.980089 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1ef2f-0245-4dd5-bfd8-08709cdf4cd5 admin admin] PATH_INFO: `/v3/projects/b0b8f4702c6e432d88bdf9f826d592bf/users/356df5b834454319aaa91584809b22c1/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:53.981981 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1ef2f-0245-4dd5-bfd8-08709cdf4cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b8f4702c6e432d88bdf9f826d592bf, user_id=356df5b834454319aaa91584809b22c1, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:53.984669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1ef2f-0245-4dd5-bfd8-08709cdf4cd5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:54.005655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1013/2026] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:53 2022] PUT /identity/v3/projects/b0b8f4702c6e432d88bdf9f826d592bf/users/356df5b834454319aaa91584809b22c1/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:54.007017 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817d3a8-69b6-40cb-95d4-d2e96868b115 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:54.007384 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817d3a8-69b6-40cb-95d4-d2e96868b115 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:54.007700 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817d3a8-69b6-40cb-95d4-d2e96868b115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:54.038632 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0817d3a8-69b6-40cb-95d4-d2e96868b115 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:54.039985 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0817d3a8-69b6-40cb-95d4-d2e96868b115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:54.053161 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f06d4-f79e-4f18-8dbb-a961d4eceebe service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:54.124677 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfee6f-68f8-4900-8ec4-03a5724e70d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:54.125574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfee6f-68f8-4900-8ec4-03a5724e70d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:54.125862 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfee6f-68f8-4900-8ec4-03a5724e70d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:54.126135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfee6f-68f8-4900-8ec4-03a5724e70d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:54.128659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d4dfee6f-68f8-4900-8ec4-03a5724e70d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:54.130189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1014/2027] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:54.131205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817d3a8-69b6-40cb-95d4-d2e96868b115 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:54.132570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0817d3a8-69b6-40cb-95d4-d2e96868b115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:54.198607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817d3a8-69b6-40cb-95d4-d2e96868b115 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:54.203077 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfee6f-68f8-4900-8ec4-03a5724e70d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:54.203228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9853a-d2ae-4c46-8d53-27cc9adb206b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:54.203924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9853a-d2ae-4c46-8d53-27cc9adb206b service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:54.204156 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9853a-d2ae-4c46-8d53-27cc9adb206b service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:54.204422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9853a-d2ae-4c46-8d53-27cc9adb206b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:54.204522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfee6f-68f8-4900-8ec4-03a5724e70d7 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:54.215716 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1014/2028] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:54.217350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaf8f6-ec28-4dee-8bfe-399ab1a9675d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:54.217661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaf8f6-ec28-4dee-8bfe-399ab1a9675d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:54.217887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9853a-d2ae-4c46-8d53-27cc9adb206b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:54.218007 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaf8f6-ec28-4dee-8bfe-399ab1a9675d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:54.219302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9853a-d2ae-4c46-8d53-27cc9adb206b service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:54.232488 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1015/2029] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:54.233860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c29a5-d199-44de-8b1d-d4d88351774f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:54.234140 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c29a5-d199-44de-8b1d-d4d88351774f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:54.234424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c29a5-d199-44de-8b1d-d4d88351774f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:54.257343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6adaf8f6-ec28-4dee-8bfe-399ab1a9675d None None] MFA Rules not processed for user `356df5b834454319aaa91584809b22c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:54.258874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6adaf8f6-ec28-4dee-8bfe-399ab1a9675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:54.260301 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-347c29a5-d199-44de-8b1d-d4d88351774f None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:54.262468 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-347c29a5-d199-44de-8b1d-d4d88351774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:54.277804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1016/2030] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:54.285949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c29a5-d199-44de-8b1d-d4d88351774f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:54.303595 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c29a5-d199-44de-8b1d-d4d88351774f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:54.312868 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c583534-ab49-479a-96e8-2ade724df69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:54.313822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c583534-ab49-479a-96e8-2ade724df69e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:54.314138 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c583534-ab49-479a-96e8-2ade724df69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:54.314409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c583534-ab49-479a-96e8-2ade724df69e admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:54.315184 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c583534-ab49-479a-96e8-2ade724df69e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:54.315537 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c583534-ab49-479a-96e8-2ade724df69e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:54.317951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c583534-ab49-479a-96e8-2ade724df69e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:54.341180 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1017/2031] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:54.342968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c583534-ab49-479a-96e8-2ade724df69e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:54.356729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c583534-ab49-479a-96e8-2ade724df69e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:54.362191 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554ae95-698f-4994-a6cf-fb12bbd075b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:54.363187 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554ae95-698f-4994-a6cf-fb12bbd075b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:54.363474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554ae95-698f-4994-a6cf-fb12bbd075b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:54.363746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554ae95-698f-4994-a6cf-fb12bbd075b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:54.364598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554ae95-698f-4994-a6cf-fb12bbd075b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:54.366592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554ae95-698f-4994-a6cf-fb12bbd075b4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:54.387433 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1015/2032] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:54.398428 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adaf8f6-ec28-4dee-8bfe-399ab1a9675d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:54.400086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6adaf8f6-ec28-4dee-8bfe-399ab1a9675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:54.413171 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adaf8f6-ec28-4dee-8bfe-399ab1a9675d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:54.417271 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afff2d-98cd-4103-b7ca-d4d02450c294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:54.417557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afff2d-98cd-4103-b7ca-d4d02450c294 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:54.420240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afff2d-98cd-4103-b7ca-d4d02450c294 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:54.420240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afff2d-98cd-4103-b7ca-d4d02450c294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:54.428261 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afff2d-98cd-4103-b7ca-d4d02450c294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:54.429787 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afff2d-98cd-4103-b7ca-d4d02450c294 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:54.440832 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1016/2033] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:36:54.505506 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1018/2034] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:54 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:54.514906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afff2d-98cd-4103-b7ca-d4d02450c294 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:54.527720 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afff2d-98cd-4103-b7ca-d4d02450c294 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:54.611146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554ae95-698f-4994-a6cf-fb12bbd075b4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:54.616779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097c4ce-8c96-4992-94ca-827813a8bb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:54.617471 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097c4ce-8c96-4992-94ca-827813a8bb6e admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:54.617752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097c4ce-8c96-4992-94ca-827813a8bb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:54.618076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097c4ce-8c96-4992-94ca-827813a8bb6e admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:54.618910 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097c4ce-8c96-4992-94ca-827813a8bb6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:54.620892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097c4ce-8c96-4992-94ca-827813a8bb6e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:54.673887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554ae95-698f-4994-a6cf-fb12bbd075b4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:54.678601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576f84d-cb44-47fe-9ffd-6b12ea9411d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:54.679335 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576f84d-cb44-47fe-9ffd-6b12ea9411d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:54.679595 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576f84d-cb44-47fe-9ffd-6b12ea9411d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:54.679859 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576f84d-cb44-47fe-9ffd-6b12ea9411d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:54.681697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a576f84d-cb44-47fe-9ffd-6b12ea9411d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:54.686375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:54.745595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1017/2035] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:54 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:36:54.746091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097c4ce-8c96-4992-94ca-827813a8bb6e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:54.751985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a097c4ce-8c96-4992-94ca-827813a8bb6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:54.759027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576f84d-cb44-47fe-9ffd-6b12ea9411d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:54.760460 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576f84d-cb44-47fe-9ffd-6b12ea9411d9 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:54.766045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097c4ce-8c96-4992-94ca-827813a8bb6e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:54.770335 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1019/2036] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:36:54.774111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:54.774111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:54.774111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:54.774111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f admin admin] PATH_INFO: `/v3/projects/a7d2a6fd8fa44586845747a54b709499` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:54.774601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576f84d-cb44-47fe-9ffd-6b12ea9411d9 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:54.774743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7d2a6fd8fa44586845747a54b709499)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:54.775653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:54.785090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576f84d-cb44-47fe-9ffd-6b12ea9411d9 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:54.791525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30ae1a-96d4-4217-bf88-ef91a964b46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:54.792419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30ae1a-96d4-4217-bf88-ef91a964b46d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:54.792796 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30ae1a-96d4-4217-bf88-ef91a964b46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:54.793080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30ae1a-96d4-4217-bf88-ef91a964b46d admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:54.793848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30ae1a-96d4-4217-bf88-ef91a964b46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:54.795531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30ae1a-96d4-4217-bf88-ef91a964b46d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:54.807368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1020/2037] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:54.811651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30ae1a-96d4-4217-bf88-ef91a964b46d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:54.834303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30ae1a-96d4-4217-bf88-ef91a964b46d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:54.839863 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6d21b-d0ae-4fcb-852e-0b179fc0d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:54.840752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6d21b-d0ae-4fcb-852e-0b179fc0d205 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:54.841037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6d21b-d0ae-4fcb-852e-0b179fc0d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:54.841434 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6d21b-d0ae-4fcb-852e-0b179fc0d205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:54.842250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6d21b-d0ae-4fcb-852e-0b179fc0d205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:54.844049 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6d21b-d0ae-4fcb-852e-0b179fc0d205 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:54.855674 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1021/2038] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:54.857338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6d21b-d0ae-4fcb-852e-0b179fc0d205 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:54.859349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-deb6d21b-d0ae-4fcb-852e-0b179fc0d205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:54.873735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6d21b-d0ae-4fcb-852e-0b179fc0d205 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:54.879798 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:54.892694 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:54.892694 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:54.892694 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d admin admin] PATH_INFO: `/v3/projects/2f89db61c54346bebf11e0f2f0ef9dc9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:54.892694 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f89db61c54346bebf11e0f2f0ef9dc9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:54.892694 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:54.936951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7d2a6fd8fa44586845747a54b709499', 'request_id': 'req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:54.944540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7d2a6fd8fa44586845747a54b709499', 'request_id': 'req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.028979 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f89db61c54346bebf11e0f2f0ef9dc9', 'request_id': 'req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.072762 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7d2a6fd8fa44586845747a54b709499', 'request_id': 'req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.085220 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f admin admin] The token cache is being invalidate because project a7d2a6fd8fa44586845747a54b709499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:55.085576 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.086239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.088219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1018/2039] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:54 2022] DELETE /identity/v3/projects/a7d2a6fd8fa44586845747a54b709499 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:55.088799 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:55.090108 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:55.104239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:55.173066 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97afea5-1248-4f0f-9fc0-1cef5e9ff38f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:55.227601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f89db61c54346bebf11e0f2f0ef9dc9', 'request_id': 'req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.235002 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f89db61c54346bebf11e0f2f0ef9dc9', 'request_id': 'req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.253999 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0a6c0-61ee-4ea8-956a-84f1beb6165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:55.256387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0a6c0-61ee-4ea8-956a-84f1beb6165e admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:55.256647 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0a6c0-61ee-4ea8-956a-84f1beb6165e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:55.256924 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0a6c0-61ee-4ea8-956a-84f1beb6165e admin admin] PATH_INFO: `/v3/projects/a8a3e8cae5524d1c964b9b4c94a288ca/users/39c0f662439d4d2285932add86f89896/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:55.257342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d admin admin] The token cache is being invalidate because project 2f89db61c54346bebf11e0f2f0ef9dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:55.257723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.258466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.262231 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1022/2040] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:54 2022] DELETE /identity/v3/projects/2f89db61c54346bebf11e0f2f0ef9dc9 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:55.262231 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:55.265675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:55.279403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95a8d3-5f51-4514-b48b-2b2f4617c58d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:55.287966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0a6c0-61ee-4ea8-956a-84f1beb6165e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a3e8cae5524d1c964b9b4c94a288ca, user_id=39c0f662439d4d2285932add86f89896, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:55.290961 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7ae57-7452-4b32-a827-4761b5675b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:55.291993 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7ae57-7452-4b32-a827-4761b5675b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:55.292366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7ae57-7452-4b32-a827-4761b5675b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:55.294564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0a6c0-61ee-4ea8-956a-84f1beb6165e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:55.297569 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7ae57-7452-4b32-a827-4761b5675b5d admin admin] PATH_INFO: `/v3/users/9d1d4df3493344ff9d1a2ceba765ca2c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:55.298531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7ae57-7452-4b32-a827-4761b5675b5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d1d4df3493344ff9d1a2ceba765ca2c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:55.301467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7ae57-7452-4b32-a827-4761b5675b5d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:55.366385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1019/2041] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:55 2022] PUT /identity/v3/projects/a8a3e8cae5524d1c964b9b4c94a288ca/users/39c0f662439d4d2285932add86f89896/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:55.367598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0a6c0-61ee-4ea8-956a-84f1beb6165e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:55.369741 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-94b0a6c0-61ee-4ea8-956a-84f1beb6165e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:55.439643 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0a6c0-61ee-4ea8-956a-84f1beb6165e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:55.445300 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c46e1b-f9ce-48a4-b20e-b8bead4f4af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:55.446246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c46e1b-f9ce-48a4-b20e-b8bead4f4af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:55.447468 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c46e1b-f9ce-48a4-b20e-b8bead4f4af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:55.447468 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c46e1b-f9ce-48a4-b20e-b8bead4f4af9 admin admin] PATH_INFO: `/v3/users/5c057f3124694fc3ab0adcf94d77dd1e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:55.447984 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c46e1b-f9ce-48a4-b20e-b8bead4f4af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c057f3124694fc3ab0adcf94d77dd1e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:55.449966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c46e1b-f9ce-48a4-b20e-b8bead4f4af9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:55.559333 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5cc7ae57-7452-4b32-a827-4761b5675b5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d1d4df3493344ff9d1a2ceba765ca2c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.652820 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5cc7ae57-7452-4b32-a827-4761b5675b5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d1d4df3493344ff9d1a2ceba765ca2c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.653644 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5cc7ae57-7452-4b32-a827-4761b5675b5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d1d4df3493344ff9d1a2ceba765ca2c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.668250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5cc7ae57-7452-4b32-a827-4761b5675b5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d1d4df3493344ff9d1a2ceba765ca2c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.675536 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5cc7ae57-7452-4b32-a827-4761b5675b5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d1d4df3493344ff9d1a2ceba765ca2c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.696131 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1023/2042] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:55 2022] DELETE /identity/v3/users/9d1d4df3493344ff9d1a2ceba765ca2c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:55.697949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995040e-8009-41ae-81e1-5e26b1f8a7dc None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:55.699999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995040e-8009-41ae-81e1-5e26b1f8a7dc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:55.703892 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995040e-8009-41ae-81e1-5e26b1f8a7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:55.761124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-16c46e1b-f9ce-48a4-b20e-b8bead4f4af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c057f3124694fc3ab0adcf94d77dd1e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.766512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1995040e-8009-41ae-81e1-5e26b1f8a7dc None None] MFA Rules not processed for user `39c0f662439d4d2285932add86f89896`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:55.768169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1995040e-8009-41ae-81e1-5e26b1f8a7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:55.845605 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-16c46e1b-f9ce-48a4-b20e-b8bead4f4af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c057f3124694fc3ab0adcf94d77dd1e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.857883 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-16c46e1b-f9ce-48a4-b20e-b8bead4f4af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c057f3124694fc3ab0adcf94d77dd1e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.874737 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1024/2043] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:55.875362 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-16c46e1b-f9ce-48a4-b20e-b8bead4f4af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c057f3124694fc3ab0adcf94d77dd1e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.876172 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-16c46e1b-f9ce-48a4-b20e-b8bead4f4af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c057f3124694fc3ab0adcf94d77dd1e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:55.878921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995040e-8009-41ae-81e1-5e26b1f8a7dc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:55.882385 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1995040e-8009-41ae-81e1-5e26b1f8a7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:55.896869 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1020/2044] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:55 2022] DELETE /identity/v3/users/5c057f3124694fc3ab0adcf94d77dd1e => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:55.970175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995040e-8009-41ae-81e1-5e26b1f8a7dc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:56.050501 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ad55-cf4e-4aa5-978e-2ceaf106ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:56.052579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ad55-cf4e-4aa5-978e-2ceaf106ec27 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:56.052987 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ad55-cf4e-4aa5-978e-2ceaf106ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:56.053448 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ad55-cf4e-4aa5-978e-2ceaf106ec27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:56.055019 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588ad55-cf4e-4aa5-978e-2ceaf106ec27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:56.057266 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588ad55-cf4e-4aa5-978e-2ceaf106ec27 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:56.163607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1025/2045] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:55 2022] POST /identity/v3/projects => generated 383 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:56.168185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c46e1b-f9ce-48a4-b20e-b8bead4f4af9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:56.169686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-16c46e1b-f9ce-48a4-b20e-b8bead4f4af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:56.185636 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c46e1b-f9ce-48a4-b20e-b8bead4f4af9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:56.258294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7f198-5a37-483f-b965-b14d91714a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:56.259304 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7f198-5a37-483f-b965-b14d91714a01 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:56.261018 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7f198-5a37-483f-b965-b14d91714a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:56.261018 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7f198-5a37-483f-b965-b14d91714a01 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:56.261551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7f198-5a37-483f-b965-b14d91714a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:56.270031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7f198-5a37-483f-b965-b14d91714a01 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:56.411368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1021/2046] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:56 2022] POST /identity/v3/users => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:56.414738 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ad55-cf4e-4aa5-978e-2ceaf106ec27 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:56.425694 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ad55-cf4e-4aa5-978e-2ceaf106ec27 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:56.431691 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c53b25-3f27-4226-8c70-e7551d205eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:56.432374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c53b25-3f27-4226-8c70-e7551d205eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:56.432705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c53b25-3f27-4226-8c70-e7551d205eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:56.432985 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c53b25-3f27-4226-8c70-e7551d205eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:56.433786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c53b25-3f27-4226-8c70-e7551d205eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:56.436633 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c53b25-3f27-4226-8c70-e7551d205eb8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:56.450935 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1026/2047] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:56.457292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7f198-5a37-483f-b965-b14d91714a01 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:56.477672 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7f198-5a37-483f-b965-b14d91714a01 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:56.482956 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00d17d-41e6-46e7-9b8a-81b1a339b559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:56.483936 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00d17d-41e6-46e7-9b8a-81b1a339b559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:56.484298 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00d17d-41e6-46e7-9b8a-81b1a339b559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:56.484669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00d17d-41e6-46e7-9b8a-81b1a339b559 admin admin] PATH_INFO: `/v3/projects/47c5c9602e9e47f38a5a8244aefd3bbd/users/e75cea9661304c55844fdfab00e161f5/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:56.506999 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00d17d-41e6-46e7-9b8a-81b1a339b559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c5c9602e9e47f38a5a8244aefd3bbd, user_id=e75cea9661304c55844fdfab00e161f5, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:56.515592 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00d17d-41e6-46e7-9b8a-81b1a339b559 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:56.515684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c53b25-3f27-4226-8c70-e7551d205eb8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:56.518158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-48c53b25-3f27-4226-8c70-e7551d205eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:56.532348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c53b25-3f27-4226-8c70-e7551d205eb8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:56.544785 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0959a8f-8d58-497d-94fb-87b039a51ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:56.545674 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0959a8f-8d58-497d-94fb-87b039a51ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:56.545960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0959a8f-8d58-497d-94fb-87b039a51ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:56.546234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0959a8f-8d58-497d-94fb-87b039a51ae2 admin admin] PATH_INFO: `/v3/projects/27167cd0df1147bf9af9d3f65a408c9a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:56.549375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0959a8f-8d58-497d-94fb-87b039a51ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27167cd0df1147bf9af9d3f65a408c9a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:56.552265 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0959a8f-8d58-497d-94fb-87b039a51ae2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:56.622795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1022/2048] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:56 2022] PUT /identity/v3/projects/47c5c9602e9e47f38a5a8244aefd3bbd/users/e75cea9661304c55844fdfab00e161f5/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:56.630184 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00d17d-41e6-46e7-9b8a-81b1a339b559 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:56.630184 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2e00d17d-41e6-46e7-9b8a-81b1a339b559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:56.690301 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00d17d-41e6-46e7-9b8a-81b1a339b559 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:56.695221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cbc4a-5247-40a0-8847-596125620723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:56.696161 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cbc4a-5247-40a0-8847-596125620723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:56.696446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cbc4a-5247-40a0-8847-596125620723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:56.696722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cbc4a-5247-40a0-8847-596125620723 admin admin] PATH_INFO: `/v3/projects/1cedf7e486af4aab9ee0c0ee8d8e68a1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:56.697912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cbc4a-5247-40a0-8847-596125620723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cedf7e486af4aab9ee0c0ee8d8e68a1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:56.699891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cbc4a-5247-40a0-8847-596125620723 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:56.738207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a0959a8f-8d58-497d-94fb-87b039a51ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27167cd0df1147bf9af9d3f65a408c9a', 'request_id': 'req-a0959a8f-8d58-497d-94fb-87b039a51ae2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:56.872591 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a0959a8f-8d58-497d-94fb-87b039a51ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27167cd0df1147bf9af9d3f65a408c9a', 'request_id': 'req-a0959a8f-8d58-497d-94fb-87b039a51ae2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:56.895758 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a0959a8f-8d58-497d-94fb-87b039a51ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27167cd0df1147bf9af9d3f65a408c9a', 'request_id': 'req-a0959a8f-8d58-497d-94fb-87b039a51ae2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:56.895758 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a0959a8f-8d58-497d-94fb-87b039a51ae2 admin admin] The token cache is being invalidate because project 27167cd0df1147bf9af9d3f65a408c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:56.895758 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a0959a8f-8d58-497d-94fb-87b039a51ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:56.896354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9b6cbc4a-5247-40a0-8847-596125620723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cedf7e486af4aab9ee0c0ee8d8e68a1', 'request_id': 'req-9b6cbc4a-5247-40a0-8847-596125620723'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:56.896845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a0959a8f-8d58-497d-94fb-87b039a51ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:56.897081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1027/2049] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:56 2022] DELETE /identity/v3/projects/27167cd0df1147bf9af9d3f65a408c9a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:56.898271 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0959a8f-8d58-497d-94fb-87b039a51ae2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:56.900208 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a0959a8f-8d58-497d-94fb-87b039a51ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:56.903994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9b6cbc4a-5247-40a0-8847-596125620723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cedf7e486af4aab9ee0c0ee8d8e68a1', 'request_id': 'req-9b6cbc4a-5247-40a0-8847-596125620723'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:56.983131 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0959a8f-8d58-497d-94fb-87b039a51ae2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:57.015502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9b6cbc4a-5247-40a0-8847-596125620723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cedf7e486af4aab9ee0c0ee8d8e68a1', 'request_id': 'req-9b6cbc4a-5247-40a0-8847-596125620723'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:57.028878 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9b6cbc4a-5247-40a0-8847-596125620723 admin admin] The token cache is being invalidate because project 1cedf7e486af4aab9ee0c0ee8d8e68a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:57.029417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9b6cbc4a-5247-40a0-8847-596125620723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:57.030343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9b6cbc4a-5247-40a0-8847-596125620723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:57.031016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:57.032189 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1023/2050] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:56 2022] DELETE /identity/v3/projects/1cedf7e486af4aab9ee0c0ee8d8e68a1 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:57.033207 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cbc4a-5247-40a0-8847-596125620723 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:57.035649 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9b6cbc4a-5247-40a0-8847-596125620723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:57.048242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccede69-b3ad-410c-97aa-a05709e0a5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:57.049022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccede69-b3ad-410c-97aa-a05709e0a5df admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:57.049486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccede69-b3ad-410c-97aa-a05709e0a5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:57.049830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccede69-b3ad-410c-97aa-a05709e0a5df admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:57.050645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccede69-b3ad-410c-97aa-a05709e0a5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:57.053296 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccede69-b3ad-410c-97aa-a05709e0a5df admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:57.065615 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1028/2051] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:57.068185 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccede69-b3ad-410c-97aa-a05709e0a5df admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:57.070000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bccede69-b3ad-410c-97aa-a05709e0a5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:57.083646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccede69-b3ad-410c-97aa-a05709e0a5df admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:57.089373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a7daf-ec3f-423c-8c37-a1c36dafd9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:57.090274 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a7daf-ec3f-423c-8c37-a1c36dafd9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:57.090562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a7daf-ec3f-423c-8c37-a1c36dafd9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:57.090869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a7daf-ec3f-423c-8c37-a1c36dafd9d7 admin admin] PATH_INFO: `/v3/users/4c295f01e65d440e861d59b19ba5578d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:57.092144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a7daf-ec3f-423c-8c37-a1c36dafd9d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c295f01e65d440e861d59b19ba5578d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:57.094091 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a7daf-ec3f-423c-8c37-a1c36dafd9d7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:57.116902 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cbc4a-5247-40a0-8847-596125620723 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:57.122986 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222044c-fd42-4408-a190-c7ad81d063a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:57.123884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222044c-fd42-4408-a190-c7ad81d063a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:57.124164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222044c-fd42-4408-a190-c7ad81d063a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:57.124465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222044c-fd42-4408-a190-c7ad81d063a9 admin admin] PATH_INFO: `/v3/users/b42988cdc96f436e9cef1dd7ff3bdafd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:57.125707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222044c-fd42-4408-a190-c7ad81d063a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42988cdc96f436e9cef1dd7ff3bdafd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:57.127682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222044c-fd42-4408-a190-c7ad81d063a9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:57.358592 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:57.449001 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-603a7daf-ec3f-423c-8c37-a1c36dafd9d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c295f01e65d440e861d59b19ba5578d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:57.451175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5222044c-fd42-4408-a190-c7ad81d063a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42988cdc96f436e9cef1dd7ff3bdafd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:57.560437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-603a7daf-ec3f-423c-8c37-a1c36dafd9d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c295f01e65d440e861d59b19ba5578d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:57.561355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-603a7daf-ec3f-423c-8c37-a1c36dafd9d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c295f01e65d440e861d59b19ba5578d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:57.578821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-603a7daf-ec3f-423c-8c37-a1c36dafd9d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c295f01e65d440e861d59b19ba5578d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:57.591619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-603a7daf-ec3f-423c-8c37-a1c36dafd9d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c295f01e65d440e861d59b19ba5578d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:57.601598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1029/2052] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:57 2022] DELETE /identity/v3/users/4c295f01e65d440e861d59b19ba5578d => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:57.602245 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a7daf-ec3f-423c-8c37-a1c36dafd9d7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:57.607882 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-603a7daf-ec3f-423c-8c37-a1c36dafd9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:57.712210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5222044c-fd42-4408-a190-c7ad81d063a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42988cdc96f436e9cef1dd7ff3bdafd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:57.722366 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5222044c-fd42-4408-a190-c7ad81d063a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42988cdc96f436e9cef1dd7ff3bdafd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:57.753901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5222044c-fd42-4408-a190-c7ad81d063a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42988cdc96f436e9cef1dd7ff3bdafd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:57.753901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5222044c-fd42-4408-a190-c7ad81d063a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42988cdc96f436e9cef1dd7ff3bdafd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:57.766756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1024/2053] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:57 2022] DELETE /identity/v3/users/b42988cdc96f436e9cef1dd7ff3bdafd => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:57.814620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a7daf-ec3f-423c-8c37-a1c36dafd9d7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:57.918447 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e2c0d-63ee-4231-bbea-1953e04302be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:57.919560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e2c0d-63ee-4231-bbea-1953e04302be admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:57.919840 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e2c0d-63ee-4231-bbea-1953e04302be admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:57.920112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e2c0d-63ee-4231-bbea-1953e04302be admin admin] PATH_INFO: `/v3/projects/47c5c9602e9e47f38a5a8244aefd3bbd/users/e75cea9661304c55844fdfab00e161f5/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:57.922254 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e2c0d-63ee-4231-bbea-1953e04302be admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c5c9602e9e47f38a5a8244aefd3bbd, user_id=e75cea9661304c55844fdfab00e161f5, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:57.925021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e2c0d-63ee-4231-bbea-1953e04302be admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:57.946772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1030/2054] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:57 2022] PUT /identity/v3/projects/47c5c9602e9e47f38a5a8244aefd3bbd/users/e75cea9661304c55844fdfab00e161f5/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:57.960123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41959b03-f138-451b-815e-a416f55d4cee None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:57.960918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41959b03-f138-451b-815e-a416f55d4cee None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:57.961096 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41959b03-f138-451b-815e-a416f55d4cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:57.996771 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-41959b03-f138-451b-815e-a416f55d4cee None None] MFA Rules not processed for user `e75cea9661304c55844fdfab00e161f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:58.000420 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-41959b03-f138-451b-815e-a416f55d4cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:58.073344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1025/2055] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:58.084810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e2c0d-63ee-4231-bbea-1953e04302be admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:58.087507 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6a0e2c0d-63ee-4231-bbea-1953e04302be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:58.195695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e2c0d-63ee-4231-bbea-1953e04302be admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:58.199580 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13bd10-4c3f-480a-8d10-34c5e463bfdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:58.200333 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13bd10-4c3f-480a-8d10-34c5e463bfdf service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:58.201000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13bd10-4c3f-480a-8d10-34c5e463bfdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:58.201000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13bd10-4c3f-480a-8d10-34c5e463bfdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:58.212427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13bd10-4c3f-480a-8d10-34c5e463bfdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:58.222937 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13bd10-4c3f-480a-8d10-34c5e463bfdf service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:58.232092 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1031/2056] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:58.596404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41959b03-f138-451b-815e-a416f55d4cee None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:58.597446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-41959b03-f138-451b-815e-a416f55d4cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:58.647020 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13bd10-4c3f-480a-8d10-34c5e463bfdf service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:58.648724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3f13bd10-4c3f-480a-8d10-34c5e463bfdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:58.686753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:58.705010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41959b03-f138-451b-815e-a416f55d4cee None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:58.711332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b2fef-6dab-4f37-8277-94ecdb57aa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:58.712710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b2fef-6dab-4f37-8277-94ecdb57aa59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:58.713270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b2fef-6dab-4f37-8277-94ecdb57aa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:58.713756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b2fef-6dab-4f37-8277-94ecdb57aa59 admin admin] PATH_INFO: `/v3/projects/0b26c8443ff44242830e528f7f1bb504` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:58.715280 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b2fef-6dab-4f37-8277-94ecdb57aa59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b26c8443ff44242830e528f7f1bb504)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:58.718334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b2fef-6dab-4f37-8277-94ecdb57aa59 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:58.746118 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13bd10-4c3f-480a-8d10-34c5e463bfdf service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:58.751326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b95f09-d89d-4af4-a1e6-74e3a977f1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:58.752341 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b95f09-d89d-4af4-a1e6-74e3a977f1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:58.752830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b95f09-d89d-4af4-a1e6-74e3a977f1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:58.753228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b95f09-d89d-4af4-a1e6-74e3a977f1cf admin admin] PATH_INFO: `/v3/projects/c0cf9c86ddc341a0a2f933e9c4fedf50` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:58.754947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b95f09-d89d-4af4-a1e6-74e3a977f1cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0cf9c86ddc341a0a2f933e9c4fedf50)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:58.758475 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b95f09-d89d-4af4-a1e6-74e3a977f1cf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:58.877292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a09b2fef-6dab-4f37-8277-94ecdb57aa59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b26c8443ff44242830e528f7f1bb504', 'request_id': 'req-a09b2fef-6dab-4f37-8277-94ecdb57aa59'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:58.888722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a09b2fef-6dab-4f37-8277-94ecdb57aa59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b26c8443ff44242830e528f7f1bb504', 'request_id': 'req-a09b2fef-6dab-4f37-8277-94ecdb57aa59'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:58.892323 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-74b95f09-d89d-4af4-a1e6-74e3a977f1cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0cf9c86ddc341a0a2f933e9c4fedf50', 'request_id': 'req-74b95f09-d89d-4af4-a1e6-74e3a977f1cf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:58.898528 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:58.995118 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a09b2fef-6dab-4f37-8277-94ecdb57aa59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b26c8443ff44242830e528f7f1bb504', 'request_id': 'req-a09b2fef-6dab-4f37-8277-94ecdb57aa59'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:59.009824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a09b2fef-6dab-4f37-8277-94ecdb57aa59 admin admin] The token cache is being invalidate because project 0b26c8443ff44242830e528f7f1bb504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:59.010070 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a09b2fef-6dab-4f37-8277-94ecdb57aa59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:59.011406 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a09b2fef-6dab-4f37-8277-94ecdb57aa59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:59.013278 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1026/2057] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:58 2022] DELETE /identity/v3/projects/0b26c8443ff44242830e528f7f1bb504 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:59.018545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2431a17-5fcd-46d0-ae3d-87a97d0ee171 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:59.018895 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2431a17-5fcd-46d0-ae3d-87a97d0ee171 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:59.019165 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2431a17-5fcd-46d0-ae3d-87a97d0ee171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:59.053103 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f2431a17-5fcd-46d0-ae3d-87a97d0ee171 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:59.054390 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f2431a17-5fcd-46d0-ae3d-87a97d0ee171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:59.132169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-74b95f09-d89d-4af4-a1e6-74e3a977f1cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0cf9c86ddc341a0a2f933e9c4fedf50', 'request_id': 'req-74b95f09-d89d-4af4-a1e6-74e3a977f1cf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:59.132616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1027/2058] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:36:59.140241 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-74b95f09-d89d-4af4-a1e6-74e3a977f1cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0cf9c86ddc341a0a2f933e9c4fedf50', 'request_id': 'req-74b95f09-d89d-4af4-a1e6-74e3a977f1cf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:59.140623 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3deaa1-99ce-45f0-8caa-a6f67115d656 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:59.144466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3deaa1-99ce-45f0-8caa-a6f67115d656 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:59.144466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3deaa1-99ce-45f0-8caa-a6f67115d656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:59.157551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-74b95f09-d89d-4af4-a1e6-74e3a977f1cf admin admin] The token cache is being invalidate because project c0cf9c86ddc341a0a2f933e9c4fedf50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:59.157839 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-74b95f09-d89d-4af4-a1e6-74e3a977f1cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:59.158729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-74b95f09-d89d-4af4-a1e6-74e3a977f1cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:59.160366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1032/2059] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:58 2022] DELETE /identity/v3/projects/c0cf9c86ddc341a0a2f933e9c4fedf50 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:59.169733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a37e12-45e4-4fa9-ac6c-cab15b0c0aa0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:59.170018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a37e12-45e4-4fa9-ac6c-cab15b0c0aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:59.170319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a37e12-45e4-4fa9-ac6c-cab15b0c0aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:59.171955 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2b3deaa1-99ce-45f0-8caa-a6f67115d656 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:59.173652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2b3deaa1-99ce-45f0-8caa-a6f67115d656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:59.185449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1028/2060] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:36:59.189977 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3deaa1-99ce-45f0-8caa-a6f67115d656 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:59.191144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-50a37e12-45e4-4fa9-ac6c-cab15b0c0aa0 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:59.192358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-50a37e12-45e4-4fa9-ac6c-cab15b0c0aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:59.200223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3deaa1-99ce-45f0-8caa-a6f67115d656 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:59.201592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1033/2061] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:59.212115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbf0b9-e6e1-43d0-878d-d5b9608fc41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:59.212115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbf0b9-e6e1-43d0-878d-d5b9608fc41c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:59.212115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbf0b9-e6e1-43d0-878d-d5b9608fc41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:59.212115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbf0b9-e6e1-43d0-878d-d5b9608fc41c admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:59.212513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b4527-4cd5-472b-a876-f510208c65bf None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:59.212513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b4527-4cd5-472b-a876-f510208c65bf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:59.212513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b4527-4cd5-472b-a876-f510208c65bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:59.212734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbf0b9-e6e1-43d0-878d-d5b9608fc41c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:59.212734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbf0b9-e6e1-43d0-878d-d5b9608fc41c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:59.213880 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbf0b9-e6e1-43d0-878d-d5b9608fc41c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:59.229080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1029/2062] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:36:59.233345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9d6b4527-4cd5-472b-a876-f510208c65bf None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:59.234296 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbf0b9-e6e1-43d0-878d-d5b9608fc41c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:59.235207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9d6b4527-4cd5-472b-a876-f510208c65bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:59.244834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1034/2063] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:59.249756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbf0b9-e6e1-43d0-878d-d5b9608fc41c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:59.250574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b4527-4cd5-472b-a876-f510208c65bf None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:59.261514 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b4527-4cd5-472b-a876-f510208c65bf None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:59.264148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2d3a9-2648-4c73-a6ba-6dba905ceacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:59.265074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2d3a9-2648-4c73-a6ba-6dba905ceacd admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:59.265627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2d3a9-2648-4c73-a6ba-6dba905ceacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:59.266063 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2d3a9-2648-4c73-a6ba-6dba905ceacd admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:59.266808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2d3a9-2648-4c73-a6ba-6dba905ceacd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:59.267051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429740bb-d614-487f-b1fd-2c6c92aa399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:59.268149 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429740bb-d614-487f-b1fd-2c6c92aa399d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:59.268618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429740bb-d614-487f-b1fd-2c6c92aa399d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:59.268743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2d3a9-2648-4c73-a6ba-6dba905ceacd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:59.269234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429740bb-d614-487f-b1fd-2c6c92aa399d admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:59.270163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429740bb-d614-487f-b1fd-2c6c92aa399d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:59.270741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429740bb-d614-487f-b1fd-2c6c92aa399d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:59.273763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429740bb-d614-487f-b1fd-2c6c92aa399d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:59.299302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1035/2064] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:36:59.303975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429740bb-d614-487f-b1fd-2c6c92aa399d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:59.320273 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429740bb-d614-487f-b1fd-2c6c92aa399d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:59.328960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b7f3c-e62a-483a-97ea-5f422a2e91e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:59.328960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b7f3c-e62a-483a-97ea-5f422a2e91e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:59.328960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b7f3c-e62a-483a-97ea-5f422a2e91e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:59.328960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b7f3c-e62a-483a-97ea-5f422a2e91e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:59.329259 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b7f3c-e62a-483a-97ea-5f422a2e91e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:59.331388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b7f3c-e62a-483a-97ea-5f422a2e91e6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:59.388299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1030/2065] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:59 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:59.389275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2d3a9-2648-4c73-a6ba-6dba905ceacd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:59.392223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c2d2d3a9-2648-4c73-a6ba-6dba905ceacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:59.474336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2d3a9-2648-4c73-a6ba-6dba905ceacd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:59.479376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daebce5-9626-42cb-8e10-dd329f18c73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:59.480256 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daebce5-9626-42cb-8e10-dd329f18c73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:59.480535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daebce5-9626-42cb-8e10-dd329f18c73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:59.480806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daebce5-9626-42cb-8e10-dd329f18c73b admin admin] PATH_INFO: `/v3/users/adcf9063dc1443b994c552aae40edb3e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:59.482137 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daebce5-9626-42cb-8e10-dd329f18c73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=adcf9063dc1443b994c552aae40edb3e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:59.484472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daebce5-9626-42cb-8e10-dd329f18c73b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:59.496002 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1036/2066] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:59 2022] POST /identity/v3/projects => generated 389 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:59.496855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b7f3c-e62a-483a-97ea-5f422a2e91e6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:59.576987 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b7f3c-e62a-483a-97ea-5f422a2e91e6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:59.595410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edb322-7b9a-4020-9ec7-96604234d3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:59.595410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edb322-7b9a-4020-9ec7-96604234d3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:59.595410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edb322-7b9a-4020-9ec7-96604234d3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:59.595410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edb322-7b9a-4020-9ec7-96604234d3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:59.595783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edb322-7b9a-4020-9ec7-96604234d3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:59.595783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edb322-7b9a-4020-9ec7-96604234d3a0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:59.795854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1037/2067] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:59 2022] POST /identity/v3/users => generated 287 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:59.797441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edb322-7b9a-4020-9ec7-96604234d3a0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:59.808872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edb322-7b9a-4020-9ec7-96604234d3a0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:59.814707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223cdb8-88f2-4131-bcf3-7accb7bb654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:59.815507 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223cdb8-88f2-4131-bcf3-7accb7bb654b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:59.815889 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223cdb8-88f2-4131-bcf3-7accb7bb654b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:59.816450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223cdb8-88f2-4131-bcf3-7accb7bb654b admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:59.817226 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223cdb8-88f2-4131-bcf3-7accb7bb654b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:59.820141 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223cdb8-88f2-4131-bcf3-7accb7bb654b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:59.858581 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1daebce5-9626-42cb-8e10-dd329f18c73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adcf9063dc1443b994c552aae40edb3e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:59.946551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1038/2068] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:59 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:59.947828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223cdb8-88f2-4131-bcf3-7accb7bb654b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:59.974516 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223cdb8-88f2-4131-bcf3-7accb7bb654b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:59.982645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211418b7-2ebf-4f0a-9c95-abb3e2919b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:59.983903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211418b7-2ebf-4f0a-9c95-abb3e2919b33 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:59.984194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211418b7-2ebf-4f0a-9c95-abb3e2919b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:59.984473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211418b7-2ebf-4f0a-9c95-abb3e2919b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:59.985242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211418b7-2ebf-4f0a-9c95-abb3e2919b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:59.987458 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211418b7-2ebf-4f0a-9c95-abb3e2919b33 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:00.001017 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1039/2069] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:00.003634 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211418b7-2ebf-4f0a-9c95-abb3e2919b33 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:00.010295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1daebce5-9626-42cb-8e10-dd329f18c73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adcf9063dc1443b994c552aae40edb3e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:00.017409 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1daebce5-9626-42cb-8e10-dd329f18c73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adcf9063dc1443b994c552aae40edb3e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:00.017847 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211418b7-2ebf-4f0a-9c95-abb3e2919b33 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:00.023741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f00918-034b-4135-b825-3f32f9006e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:00.024534 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f00918-034b-4135-b825-3f32f9006e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:00.024818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f00918-034b-4135-b825-3f32f9006e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:00.025094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f00918-034b-4135-b825-3f32f9006e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:00.025835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f00918-034b-4135-b825-3f32f9006e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:00.027749 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f00918-034b-4135-b825-3f32f9006e02 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:00.033055 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1daebce5-9626-42cb-8e10-dd329f18c73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adcf9063dc1443b994c552aae40edb3e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:00.034441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1daebce5-9626-42cb-8e10-dd329f18c73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adcf9063dc1443b994c552aae40edb3e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:00.040610 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1040/2070] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:00.041482 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f00918-034b-4135-b825-3f32f9006e02 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:00.043984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-13f00918-034b-4135-b825-3f32f9006e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:00.048733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1031/2071] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:59 2022] DELETE /identity/v3/users/adcf9063dc1443b994c552aae40edb3e => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:00.048733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daebce5-9626-42cb-8e10-dd329f18c73b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:00.048733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1daebce5-9626-42cb-8e10-dd329f18c73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:00.066041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f00918-034b-4135-b825-3f32f9006e02 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:00.171891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daebce5-9626-42cb-8e10-dd329f18c73b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:00.178275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dd922-3069-42b4-9ee2-74915b567b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:00.179768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dd922-3069-42b4-9ee2-74915b567b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:00.180428 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dd922-3069-42b4-9ee2-74915b567b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:00.181835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dd922-3069-42b4-9ee2-74915b567b77 admin admin] PATH_INFO: `/v3/users/90964a25f0a64559b38e9a58321bde9b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:00.183422 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0dd922-3069-42b4-9ee2-74915b567b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90964a25f0a64559b38e9a58321bde9b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:00.185655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0dd922-3069-42b4-9ee2-74915b567b77 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:00.201027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:00.220066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbfcd0-1164-4bc9-8618-700b59c19b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:00.222641 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbfcd0-1164-4bc9-8618-700b59c19b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:00.223057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbfcd0-1164-4bc9-8618-700b59c19b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:00.223442 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbfcd0-1164-4bc9-8618-700b59c19b1f admin admin] PATH_INFO: `/v3/users/39c0f662439d4d2285932add86f89896` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:00.226269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbfcd0-1164-4bc9-8618-700b59c19b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=39c0f662439d4d2285932add86f89896)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:00.229078 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbfcd0-1164-4bc9-8618-700b59c19b1f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:00.523665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:00.542319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-43cbfcd0-1164-4bc9-8618-700b59c19b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39c0f662439d4d2285932add86f89896'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:00.543099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e0dd922-3069-42b4-9ee2-74915b567b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90964a25f0a64559b38e9a58321bde9b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:00.629955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-43cbfcd0-1164-4bc9-8618-700b59c19b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39c0f662439d4d2285932add86f89896'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:00.630842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-43cbfcd0-1164-4bc9-8618-700b59c19b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39c0f662439d4d2285932add86f89896'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:00.644814 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-43cbfcd0-1164-4bc9-8618-700b59c19b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39c0f662439d4d2285932add86f89896'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:00.652063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-43cbfcd0-1164-4bc9-8618-700b59c19b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39c0f662439d4d2285932add86f89896'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:00.658387 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1041/2072] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:00 2022] DELETE /identity/v3/users/39c0f662439d4d2285932add86f89896 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:00.659393 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbfcd0-1164-4bc9-8618-700b59c19b1f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:00.661295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-43cbfcd0-1164-4bc9-8618-700b59c19b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:00.693054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e0dd922-3069-42b4-9ee2-74915b567b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90964a25f0a64559b38e9a58321bde9b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:00.700597 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e0dd922-3069-42b4-9ee2-74915b567b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90964a25f0a64559b38e9a58321bde9b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:00.715725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e0dd922-3069-42b4-9ee2-74915b567b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90964a25f0a64559b38e9a58321bde9b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:00.716058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1e0dd922-3069-42b4-9ee2-74915b567b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90964a25f0a64559b38e9a58321bde9b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:00.723227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1032/2073] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:00 2022] DELETE /identity/v3/users/90964a25f0a64559b38e9a58321bde9b => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:00.724081 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dd922-3069-42b4-9ee2-74915b567b77 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:00.725804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1e0dd922-3069-42b4-9ee2-74915b567b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:00.731121 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbfcd0-1164-4bc9-8618-700b59c19b1f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:00.794065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e12922-25b2-4dba-a939-3466faa164cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:00.794871 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e12922-25b2-4dba-a939-3466faa164cd admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:00.795623 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e12922-25b2-4dba-a939-3466faa164cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:00.796286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e12922-25b2-4dba-a939-3466faa164cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:00.797677 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e12922-25b2-4dba-a939-3466faa164cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:00.798219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dd922-3069-42b4-9ee2-74915b567b77 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:00.800093 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e12922-25b2-4dba-a939-3466faa164cd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:00.805095 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d973c7-7161-4637-9df2-edf1af4bcfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:00.805897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d973c7-7161-4637-9df2-edf1af4bcfab admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:00.806185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d973c7-7161-4637-9df2-edf1af4bcfab admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:00.806463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d973c7-7161-4637-9df2-edf1af4bcfab admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:00.807234 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d973c7-7161-4637-9df2-edf1af4bcfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:00.808981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d973c7-7161-4637-9df2-edf1af4bcfab admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:00.811012 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1042/2074] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:00.812371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaac4f3-30cf-4f13-8553-31e1be32f580 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:00.812660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaac4f3-30cf-4f13-8553-31e1be32f580 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:00.812940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaac4f3-30cf-4f13-8553-31e1be32f580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:00.820979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1033/2075] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:00.821819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d973c7-7161-4637-9df2-edf1af4bcfab admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:00.823521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-12d973c7-7161-4637-9df2-edf1af4bcfab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:00.832113 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-afaac4f3-30cf-4f13-8553-31e1be32f580 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:00.833316 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-afaac4f3-30cf-4f13-8553-31e1be32f580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:00.837834 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d973c7-7161-4637-9df2-edf1af4bcfab admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:00.842491 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1a6d2-f7fb-40e4-917b-587e562dbede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:00.843400 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1a6d2-f7fb-40e4-917b-587e562dbede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:00.843500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1043/2076] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:00.843806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1a6d2-f7fb-40e4-917b-587e562dbede admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:00.844087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1a6d2-f7fb-40e4-917b-587e562dbede admin admin] PATH_INFO: `/v3/users/5e3abbae6fea4203b3f0fc3dfe1ca39b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:00.844877 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069abde7-2287-452f-8580-5e76a3f4a76f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:00.845288 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069abde7-2287-452f-8580-5e76a3f4a76f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:00.845471 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1a6d2-f7fb-40e4-917b-587e562dbede admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3abbae6fea4203b3f0fc3dfe1ca39b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:00.845578 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069abde7-2287-452f-8580-5e76a3f4a76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:00.847444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1a6d2-f7fb-40e4-917b-587e562dbede admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:00.863252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-069abde7-2287-452f-8580-5e76a3f4a76f None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:00.864478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-069abde7-2287-452f-8580-5e76a3f4a76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:00.873996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1044/2077] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:00.875283 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548727c7-32b2-424d-8881-f73203f86f53 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:00.875570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548727c7-32b2-424d-8881-f73203f86f53 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:00.875846 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548727c7-32b2-424d-8881-f73203f86f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:00.894975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-548727c7-32b2-424d-8881-f73203f86f53 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:00.896185 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-548727c7-32b2-424d-8881-f73203f86f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:00.905111 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1045/2078] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:00.905856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548727c7-32b2-424d-8881-f73203f86f53 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:00.907099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-548727c7-32b2-424d-8881-f73203f86f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:00.919011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548727c7-32b2-424d-8881-f73203f86f53 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:00.923794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c890-c94d-4ecf-b458-5f4b02ffa94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:00.924703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c890-c94d-4ecf-b458-5f4b02ffa94d admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:00.925018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c890-c94d-4ecf-b458-5f4b02ffa94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:00.925295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c890-c94d-4ecf-b458-5f4b02ffa94d admin admin] PATH_INFO: `/v3/projects/dbe1b78ac89a45ca9701946d274b736f/users/56f23722191b4d8dac153ffea9e743c3/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:00.942186 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955c890-c94d-4ecf-b458-5f4b02ffa94d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe1b78ac89a45ca9701946d274b736f, user_id=56f23722191b4d8dac153ffea9e743c3, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:00.945355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955c890-c94d-4ecf-b458-5f4b02ffa94d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:01.065121 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1046/2079] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:00 2022] PUT /identity/v3/projects/dbe1b78ac89a45ca9701946d274b736f/users/56f23722191b4d8dac153ffea9e743c3/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:01.065686 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c890-c94d-4ecf-b458-5f4b02ffa94d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:01.116585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4cc1a6d2-f7fb-40e4-917b-587e562dbede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3abbae6fea4203b3f0fc3dfe1ca39b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:01.157553 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c890-c94d-4ecf-b458-5f4b02ffa94d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:01.162259 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc15dda-ef44-4eb8-a4e2-a840974e9249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:01.163321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc15dda-ef44-4eb8-a4e2-a840974e9249 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:01.163598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc15dda-ef44-4eb8-a4e2-a840974e9249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:01.163869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc15dda-ef44-4eb8-a4e2-a840974e9249 admin admin] PATH_INFO: `/v3/projects/f1dbc02af62d45888068408a377a37d8/users/bd9732e3df2f46a8af8ecf922e8fbaf9/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:01.179067 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc15dda-ef44-4eb8-a4e2-a840974e9249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1dbc02af62d45888068408a377a37d8, user_id=bd9732e3df2f46a8af8ecf922e8fbaf9, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:01.181713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc15dda-ef44-4eb8-a4e2-a840974e9249 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:01.241774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4cc1a6d2-f7fb-40e4-917b-587e562dbede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3abbae6fea4203b3f0fc3dfe1ca39b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:01.249359 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4cc1a6d2-f7fb-40e4-917b-587e562dbede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3abbae6fea4203b3f0fc3dfe1ca39b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:01.262478 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4cc1a6d2-f7fb-40e4-917b-587e562dbede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3abbae6fea4203b3f0fc3dfe1ca39b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:01.263149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4cc1a6d2-f7fb-40e4-917b-587e562dbede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3abbae6fea4203b3f0fc3dfe1ca39b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:01.269239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1034/2080] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:00 2022] DELETE /identity/v3/users/5e3abbae6fea4203b3f0fc3dfe1ca39b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:01.270089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1a6d2-f7fb-40e4-917b-587e562dbede admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:01.271508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4cc1a6d2-f7fb-40e4-917b-587e562dbede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:01.299126 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1047/2081] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:01 2022] PUT /identity/v3/projects/f1dbc02af62d45888068408a377a37d8/users/bd9732e3df2f46a8af8ecf922e8fbaf9/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:01.299126 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc15dda-ef44-4eb8-a4e2-a840974e9249 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:01.305620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8bc15dda-ef44-4eb8-a4e2-a840974e9249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:01.342263 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1a6d2-f7fb-40e4-917b-587e562dbede admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:01.380459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc15dda-ef44-4eb8-a4e2-a840974e9249 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:01.386541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac4c5a-e211-4cce-919a-02403f6d6f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:01.387368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac4c5a-e211-4cce-919a-02403f6d6f22 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:01.387657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac4c5a-e211-4cce-919a-02403f6d6f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:01.388394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac4c5a-e211-4cce-919a-02403f6d6f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:01.389921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c9ac4c5a-e211-4cce-919a-02403f6d6f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:01.400826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c521e-c8ff-4d6d-aff6-4f6bf0429c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:01.402521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c521e-c8ff-4d6d-aff6-4f6bf0429c11 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:01.402521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c521e-c8ff-4d6d-aff6-4f6bf0429c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:01.402521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c521e-c8ff-4d6d-aff6-4f6bf0429c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:01.404206 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-245c521e-c8ff-4d6d-aff6-4f6bf0429c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:01.436745 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:01.490248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c521e-c8ff-4d6d-aff6-4f6bf0429c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:01.492615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c521e-c8ff-4d6d-aff6-4f6bf0429c11 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:01.493929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac4c5a-e211-4cce-919a-02403f6d6f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:01.495395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac4c5a-e211-4cce-919a-02403f6d6f22 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:01.504346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1035/2082] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:01.505056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c521e-c8ff-4d6d-aff6-4f6bf0429c11 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:01.506079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1048/2083] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:01.507932 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392187f-54b5-4803-a85f-80cd08a34461 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:01.508222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392187f-54b5-4803-a85f-80cd08a34461 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:01.508486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392187f-54b5-4803-a85f-80cd08a34461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:01.520191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c521e-c8ff-4d6d-aff6-4f6bf0429c11 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:01.527125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5392187f-54b5-4803-a85f-80cd08a34461 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:01.527993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747e4ee-77f5-4846-9a8c-2407fecc59c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:01.528326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5392187f-54b5-4803-a85f-80cd08a34461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:01.528658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747e4ee-77f5-4846-9a8c-2407fecc59c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:01.528978 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747e4ee-77f5-4846-9a8c-2407fecc59c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:01.529272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747e4ee-77f5-4846-9a8c-2407fecc59c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:01.531184 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9747e4ee-77f5-4846-9a8c-2407fecc59c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:01.543514 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1049/2084] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:01.544821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ee1bb-0c99-409b-a3d6-a23b8c2e197b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:01.545113 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ee1bb-0c99-409b-a3d6-a23b8c2e197b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:01.545417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ee1bb-0c99-409b-a3d6-a23b8c2e197b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:01.547387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747e4ee-77f5-4846-9a8c-2407fecc59c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:01.549159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747e4ee-77f5-4846-9a8c-2407fecc59c3 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:01.562768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1036/2085] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:01.562768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747e4ee-77f5-4846-9a8c-2407fecc59c3 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:01.562987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9747e4ee-77f5-4846-9a8c-2407fecc59c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:01.575027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747e4ee-77f5-4846-9a8c-2407fecc59c3 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:01.580911 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f90107-6340-4adc-a430-3a3519511703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:01.582044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f90107-6340-4adc-a430-3a3519511703 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:01.582514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f90107-6340-4adc-a430-3a3519511703 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:01.582795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f90107-6340-4adc-a430-3a3519511703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:01.585752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b40ee1bb-0c99-409b-a3d6-a23b8c2e197b None None] MFA Rules not processed for user `bd9732e3df2f46a8af8ecf922e8fbaf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:01.587011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b40ee1bb-0c99-409b-a3d6-a23b8c2e197b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:01.594744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f90107-6340-4adc-a430-3a3519511703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:01.596952 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f90107-6340-4adc-a430-3a3519511703 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:01.605184 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:01.611710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1037/2086] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:01.659572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1050/2087] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:01.664460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f90107-6340-4adc-a430-3a3519511703 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:01.665973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b3f90107-6340-4adc-a430-3a3519511703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:01.668499 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ee1bb-0c99-409b-a3d6-a23b8c2e197b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:01.669746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b40ee1bb-0c99-409b-a3d6-a23b8c2e197b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:01.679908 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f90107-6340-4adc-a430-3a3519511703 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:01.684152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ee1bb-0c99-409b-a3d6-a23b8c2e197b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:01.684963 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05080189-c5cd-4bf8-8cfc-2a1eb7a918d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:01.685597 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05080189-c5cd-4bf8-8cfc-2a1eb7a918d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:01.685871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05080189-c5cd-4bf8-8cfc-2a1eb7a918d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:01.686162 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05080189-c5cd-4bf8-8cfc-2a1eb7a918d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:01.686872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05080189-c5cd-4bf8-8cfc-2a1eb7a918d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:01.688794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05080189-c5cd-4bf8-8cfc-2a1eb7a918d1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:01.689261 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc5f36-9d2a-480e-b7e0-3d2ff6080a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:01.690497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc5f36-9d2a-480e-b7e0-3d2ff6080a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:01.690810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc5f36-9d2a-480e-b7e0-3d2ff6080a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:01.691294 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc5f36-9d2a-480e-b7e0-3d2ff6080a91 admin admin] PATH_INFO: `/v3/projects/3d5db27b540b45ed804673be8ac390e7` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:01.692381 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc5f36-9d2a-480e-b7e0-3d2ff6080a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d5db27b540b45ed804673be8ac390e7)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:01.694923 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc5f36-9d2a-480e-b7e0-3d2ff6080a91 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:01.801056 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1038/2088] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:01 2022] POST /identity/v3/projects => generated 389 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:01.802177 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05080189-c5cd-4bf8-8cfc-2a1eb7a918d1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:01.868367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05080189-c5cd-4bf8-8cfc-2a1eb7a918d1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:01.873109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b30d3-9f69-4237-98a7-7d126febed3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:01.873776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b30d3-9f69-4237-98a7-7d126febed3a admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:01.874055 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b30d3-9f69-4237-98a7-7d126febed3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:01.874327 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b30d3-9f69-4237-98a7-7d126febed3a admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:01.875051 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b30d3-9f69-4237-98a7-7d126febed3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:01.876970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b30d3-9f69-4237-98a7-7d126febed3a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:01.924036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6bc5f36-9d2a-480e-b7e0-3d2ff6080a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5db27b540b45ed804673be8ac390e7', 'request_id': 'req-c6bc5f36-9d2a-480e-b7e0-3d2ff6080a91'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:01.999621 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1039/2089] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:01 2022] POST /identity/v3/users => generated 301 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:02.001207 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b30d3-9f69-4237-98a7-7d126febed3a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:02.014564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b30d3-9f69-4237-98a7-7d126febed3a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:02.042368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6bc5f36-9d2a-480e-b7e0-3d2ff6080a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5db27b540b45ed804673be8ac390e7', 'request_id': 'req-c6bc5f36-9d2a-480e-b7e0-3d2ff6080a91'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:02.049068 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6bc5f36-9d2a-480e-b7e0-3d2ff6080a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5db27b540b45ed804673be8ac390e7', 'request_id': 'req-c6bc5f36-9d2a-480e-b7e0-3d2ff6080a91'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:02.079470 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6bc5f36-9d2a-480e-b7e0-3d2ff6080a91 admin admin] The token cache is being invalidate because project 3d5db27b540b45ed804673be8ac390e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:02.079759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6bc5f36-9d2a-480e-b7e0-3d2ff6080a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:02.080471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6bc5f36-9d2a-480e-b7e0-3d2ff6080a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:02.082059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1051/2090] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:01 2022] DELETE /identity/v3/projects/3d5db27b540b45ed804673be8ac390e7 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:02.087286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc3349-d687-46fa-812c-a29fd91565e9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:02.087690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc3349-d687-46fa-812c-a29fd91565e9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:02.087826 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc3349-d687-46fa-812c-a29fd91565e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:02.114037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181c0e1-7da5-4279-8ffe-7416cde6f753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:02.115664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181c0e1-7da5-4279-8ffe-7416cde6f753 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:02.115664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181c0e1-7da5-4279-8ffe-7416cde6f753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:02.115664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181c0e1-7da5-4279-8ffe-7416cde6f753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:02.116577 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181c0e1-7da5-4279-8ffe-7416cde6f753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:02.118243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181c0e1-7da5-4279-8ffe-7416cde6f753 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:02.127042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d0bc3349-d687-46fa-812c-a29fd91565e9 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:02.128350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d0bc3349-d687-46fa-812c-a29fd91565e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:02.142736 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1052/2091] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:02.147354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1040/2092] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:02.149795 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc3349-d687-46fa-812c-a29fd91565e9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:02.151245 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d33820-8f00-448e-8d42-41620634f50c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:02.151380 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d0bc3349-d687-46fa-812c-a29fd91565e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:02.151604 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d33820-8f00-448e-8d42-41620634f50c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:02.151813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d33820-8f00-448e-8d42-41620634f50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:02.177135 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc3349-d687-46fa-812c-a29fd91565e9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:02.185104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-58d33820-8f00-448e-8d42-41620634f50c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:02.186415 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-58d33820-8f00-448e-8d42-41620634f50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:02.187133 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a61382-33c9-4afc-b26a-4e50a305eed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:02.188325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a61382-33c9-4afc-b26a-4e50a305eed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:02.188810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a61382-33c9-4afc-b26a-4e50a305eed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:02.189315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a61382-33c9-4afc-b26a-4e50a305eed7 admin admin] PATH_INFO: `/v3/projects/d866145fbf464fb8aba890ab4a9654bd/users/959204d0b2944b22ad51c044ea9dd405/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:02.197513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1041/2093] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:02.201606 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d33820-8f00-448e-8d42-41620634f50c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:02.218036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d33820-8f00-448e-8d42-41620634f50c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:02.232130 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a61382-33c9-4afc-b26a-4e50a305eed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d866145fbf464fb8aba890ab4a9654bd, user_id=959204d0b2944b22ad51c044ea9dd405, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:02.235198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a61382-33c9-4afc-b26a-4e50a305eed7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:02.241593 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e3901-f1dc-40e1-86c3-1870f2c099cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:02.243192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e3901-f1dc-40e1-86c3-1870f2c099cc admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:02.243474 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e3901-f1dc-40e1-86c3-1870f2c099cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:02.243744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e3901-f1dc-40e1-86c3-1870f2c099cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:02.244489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e3901-f1dc-40e1-86c3-1870f2c099cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:02.245141 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e3901-f1dc-40e1-86c3-1870f2c099cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:02.246720 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e3901-f1dc-40e1-86c3-1870f2c099cc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:02.262944 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1042/2094] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:37:02.266086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e3901-f1dc-40e1-86c3-1870f2c099cc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:02.280525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e3901-f1dc-40e1-86c3-1870f2c099cc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:02.288771 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f59802-623c-41a1-87d8-8d8eaa6f86c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:02.289564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f59802-623c-41a1-87d8-8d8eaa6f86c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:02.289916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f59802-623c-41a1-87d8-8d8eaa6f86c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:02.290243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f59802-623c-41a1-87d8-8d8eaa6f86c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:02.291061 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f59802-623c-41a1-87d8-8d8eaa6f86c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:02.293142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f59802-623c-41a1-87d8-8d8eaa6f86c7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:02.342415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1053/2095] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:02 2022] PUT /identity/v3/projects/d866145fbf464fb8aba890ab4a9654bd/users/959204d0b2944b22ad51c044ea9dd405/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:02.347829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a61382-33c9-4afc-b26a-4e50a305eed7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:02.419739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a61382-33c9-4afc-b26a-4e50a305eed7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:02.424457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab98f8b-9767-450e-8869-e04a32e33e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:02.425110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98f8b-9767-450e-8869-e04a32e33e3f admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:02.425389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98f8b-9767-450e-8869-e04a32e33e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:02.425690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98f8b-9767-450e-8869-e04a32e33e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:02.426411 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab98f8b-9767-450e-8869-e04a32e33e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:02.428084 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab98f8b-9767-450e-8869-e04a32e33e3f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:02.438871 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1054/2096] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:37:02.443339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab98f8b-9767-450e-8869-e04a32e33e3f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:02.453896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab98f8b-9767-450e-8869-e04a32e33e3f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:02.458576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35c472-e500-4d8c-8aaf-ec006589e1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:02.459495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35c472-e500-4d8c-8aaf-ec006589e1bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:02.465546 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35c472-e500-4d8c-8aaf-ec006589e1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:02.465546 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35c472-e500-4d8c-8aaf-ec006589e1bb admin admin] PATH_INFO: `/v3/projects/d866145fbf464fb8aba890ab4a9654bd/users/959204d0b2944b22ad51c044ea9dd405/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:02.465546 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35c472-e500-4d8c-8aaf-ec006589e1bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d866145fbf464fb8aba890ab4a9654bd, user_id=959204d0b2944b22ad51c044ea9dd405, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:02.466006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35c472-e500-4d8c-8aaf-ec006589e1bb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:02.475080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1043/2097] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:02 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:37:02.475080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f59802-623c-41a1-87d8-8d8eaa6f86c7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:02.475080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-97f59802-623c-41a1-87d8-8d8eaa6f86c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:02.489002 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1055/2098] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:02 2022] PUT /identity/v3/projects/d866145fbf464fb8aba890ab4a9654bd/users/959204d0b2944b22ad51c044ea9dd405/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:02.489002 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35c472-e500-4d8c-8aaf-ec006589e1bb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:02.574656 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f59802-623c-41a1-87d8-8d8eaa6f86c7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:02.619723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:02.629460 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35c472-e500-4d8c-8aaf-ec006589e1bb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:02.639176 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed9937-f685-43c7-919f-8acf14fa4a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:02.639867 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed9937-f685-43c7-919f-8acf14fa4a2f admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:02.640155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed9937-f685-43c7-919f-8acf14fa4a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:02.640465 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed9937-f685-43c7-919f-8acf14fa4a2f admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:02.641160 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed9937-f685-43c7-919f-8acf14fa4a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:02.643338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed9937-f685-43c7-919f-8acf14fa4a2f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:02.643475 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2a890-ce89-4c97-ac0b-4a689ef8b10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:02.645141 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2a890-ce89-4c97-ac0b-4a689ef8b10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:02.645141 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2a890-ce89-4c97-ac0b-4a689ef8b10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:02.645141 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2a890-ce89-4c97-ac0b-4a689ef8b10a admin admin] PATH_INFO: `/v3/projects/a8a3e8cae5524d1c964b9b4c94a288ca` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:02.646341 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2a890-ce89-4c97-ac0b-4a689ef8b10a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a3e8cae5524d1c964b9b4c94a288ca)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:02.650992 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2a890-ce89-4c97-ac0b-4a689ef8b10a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:02.770099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1056/2099] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:02 2022] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:02.770099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed9937-f685-43c7-919f-8acf14fa4a2f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:02.770099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5bed9937-f685-43c7-919f-8acf14fa4a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:02.781720 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03b2a890-ce89-4c97-ac0b-4a689ef8b10a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a3e8cae5524d1c964b9b4c94a288ca', 'request_id': 'req-03b2a890-ce89-4c97-ac0b-4a689ef8b10a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:02.785013 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed9937-f685-43c7-919f-8acf14fa4a2f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:02.789631 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03b2a890-ce89-4c97-ac0b-4a689ef8b10a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a3e8cae5524d1c964b9b4c94a288ca', 'request_id': 'req-03b2a890-ce89-4c97-ac0b-4a689ef8b10a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:02.844502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c524b-7456-4c7b-856a-236dab83e35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:02.848562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c524b-7456-4c7b-856a-236dab83e35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:02.848562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c524b-7456-4c7b-856a-236dab83e35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:02.848562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c524b-7456-4c7b-856a-236dab83e35c admin admin] PATH_INFO: `/v3/projects/cd4b120e93a440318c4645d14cb2bdb3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:02.848562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c524b-7456-4c7b-856a-236dab83e35c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4b120e93a440318c4645d14cb2bdb3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:02.849360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c524b-7456-4c7b-856a-236dab83e35c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:02.870227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:02.910787 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03b2a890-ce89-4c97-ac0b-4a689ef8b10a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a3e8cae5524d1c964b9b4c94a288ca', 'request_id': 'req-03b2a890-ce89-4c97-ac0b-4a689ef8b10a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:02.924159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03b2a890-ce89-4c97-ac0b-4a689ef8b10a admin admin] The token cache is being invalidate because project a8a3e8cae5524d1c964b9b4c94a288ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:02.924598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03b2a890-ce89-4c97-ac0b-4a689ef8b10a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:02.925460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03b2a890-ce89-4c97-ac0b-4a689ef8b10a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:02.927668 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1044/2100] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:02 2022] DELETE /identity/v3/projects/a8a3e8cae5524d1c964b9b4c94a288ca => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:02.929152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eaedb-1c9a-4489-944d-fa2f1b8a7c15 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:02.929573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eaedb-1c9a-4489-944d-fa2f1b8a7c15 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:02.930010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eaedb-1c9a-4489-944d-fa2f1b8a7c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:02.961276 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-da2eaedb-1c9a-4489-944d-fa2f1b8a7c15 None None] MFA Rules not processed for user `959204d0b2944b22ad51c044ea9dd405`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:02.962547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-da2eaedb-1c9a-4489-944d-fa2f1b8a7c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:02.998832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ca2c524b-7456-4c7b-856a-236dab83e35c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4b120e93a440318c4645d14cb2bdb3', 'request_id': 'req-ca2c524b-7456-4c7b-856a-236dab83e35c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:03.037116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1045/2101] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:03.041526 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eaedb-1c9a-4489-944d-fa2f1b8a7c15 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:03.041526 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-da2eaedb-1c9a-4489-944d-fa2f1b8a7c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:03.053481 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eaedb-1c9a-4489-944d-fa2f1b8a7c15 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:03.111405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a1e6d-717e-4e55-a9b9-31f272193923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:03.112247 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a1e6d-717e-4e55-a9b9-31f272193923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:03.112521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a1e6d-717e-4e55-a9b9-31f272193923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:03.112824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a1e6d-717e-4e55-a9b9-31f272193923 admin admin] PATH_INFO: `/v3/projects/38a7e0174aba48b19f6f5a4a97e17d5d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:03.114106 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a1e6d-717e-4e55-a9b9-31f272193923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a7e0174aba48b19f6f5a4a97e17d5d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:03.116802 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a1e6d-717e-4e55-a9b9-31f272193923 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:03.167540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ca2c524b-7456-4c7b-856a-236dab83e35c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4b120e93a440318c4645d14cb2bdb3', 'request_id': 'req-ca2c524b-7456-4c7b-856a-236dab83e35c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:03.174616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ca2c524b-7456-4c7b-856a-236dab83e35c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4b120e93a440318c4645d14cb2bdb3', 'request_id': 'req-ca2c524b-7456-4c7b-856a-236dab83e35c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:03.186807 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ca2c524b-7456-4c7b-856a-236dab83e35c admin admin] The token cache is being invalidate because project cd4b120e93a440318c4645d14cb2bdb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:03.187091 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ca2c524b-7456-4c7b-856a-236dab83e35c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:03.187752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ca2c524b-7456-4c7b-856a-236dab83e35c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:03.189319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1057/2102] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:02 2022] DELETE /identity/v3/projects/cd4b120e93a440318c4645d14cb2bdb3 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:03.190146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c524b-7456-4c7b-856a-236dab83e35c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:03.191697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ca2c524b-7456-4c7b-856a-236dab83e35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:03.204752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c524b-7456-4c7b-856a-236dab83e35c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:03.209496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d8ee7-7369-4b1b-96de-60d231416f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:03.210818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d8ee7-7369-4b1b-96de-60d231416f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:03.211116 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d8ee7-7369-4b1b-96de-60d231416f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:03.211463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d8ee7-7369-4b1b-96de-60d231416f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:03.212199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d8ee7-7369-4b1b-96de-60d231416f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:03.213870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d8ee7-7369-4b1b-96de-60d231416f14 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:03.224044 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1058/2103] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:03.229317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d8ee7-7369-4b1b-96de-60d231416f14 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:03.229317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1a0d8ee7-7369-4b1b-96de-60d231416f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:03.240057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d8ee7-7369-4b1b-96de-60d231416f14 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:03.245104 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8102b3a-bd13-429d-834c-bff50628b542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:03.246188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8102b3a-bd13-429d-834c-bff50628b542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:03.246478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8102b3a-bd13-429d-834c-bff50628b542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:03.246800 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8102b3a-bd13-429d-834c-bff50628b542 admin admin] PATH_INFO: `/v3/users/e75cea9661304c55844fdfab00e161f5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:03.248083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8102b3a-bd13-429d-834c-bff50628b542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75cea9661304c55844fdfab00e161f5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:03.250052 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8102b3a-bd13-429d-834c-bff50628b542 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:03.275431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c10a1e6d-717e-4e55-a9b9-31f272193923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a7e0174aba48b19f6f5a4a97e17d5d', 'request_id': 'req-c10a1e6d-717e-4e55-a9b9-31f272193923'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:03.295812 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c10a1e6d-717e-4e55-a9b9-31f272193923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a7e0174aba48b19f6f5a4a97e17d5d', 'request_id': 'req-c10a1e6d-717e-4e55-a9b9-31f272193923'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:03.383546 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c10a1e6d-717e-4e55-a9b9-31f272193923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a7e0174aba48b19f6f5a4a97e17d5d', 'request_id': 'req-c10a1e6d-717e-4e55-a9b9-31f272193923'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:03.396523 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c10a1e6d-717e-4e55-a9b9-31f272193923 admin admin] The token cache is being invalidate because project 38a7e0174aba48b19f6f5a4a97e17d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:03.396819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c10a1e6d-717e-4e55-a9b9-31f272193923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:03.398060 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c10a1e6d-717e-4e55-a9b9-31f272193923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:03.400094 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1046/2104] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:03 2022] DELETE /identity/v3/projects/38a7e0174aba48b19f6f5a4a97e17d5d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:03.400892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a1e6d-717e-4e55-a9b9-31f272193923 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:03.402512 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c10a1e6d-717e-4e55-a9b9-31f272193923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:03.457688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f8102b3a-bd13-429d-834c-bff50628b542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75cea9661304c55844fdfab00e161f5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:03.464696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a1e6d-717e-4e55-a9b9-31f272193923 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:03.468598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf2d05-1896-48c5-8cd3-0dc1daf20903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:03.469266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2d05-1896-48c5-8cd3-0dc1daf20903 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:03.469548 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2d05-1896-48c5-8cd3-0dc1daf20903 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:03.469826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2d05-1896-48c5-8cd3-0dc1daf20903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:03.471757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7dbf2d05-1896-48c5-8cd3-0dc1daf20903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:03.527498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f8102b3a-bd13-429d-834c-bff50628b542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75cea9661304c55844fdfab00e161f5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:03.528264 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f8102b3a-bd13-429d-834c-bff50628b542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75cea9661304c55844fdfab00e161f5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:03.542515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf2d05-1896-48c5-8cd3-0dc1daf20903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:03.544262 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf2d05-1896-48c5-8cd3-0dc1daf20903 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:03.545181 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f8102b3a-bd13-429d-834c-bff50628b542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75cea9661304c55844fdfab00e161f5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:03.553259 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f8102b3a-bd13-429d-834c-bff50628b542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75cea9661304c55844fdfab00e161f5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:03.555349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1047/2105] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:03.556154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf2d05-1896-48c5-8cd3-0dc1daf20903 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:03.557495 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7dbf2d05-1896-48c5-8cd3-0dc1daf20903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:03.561973 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1059/2106] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:03 2022] DELETE /identity/v3/users/e75cea9661304c55844fdfab00e161f5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:03.562851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8102b3a-bd13-429d-834c-bff50628b542 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:03.564199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f8102b3a-bd13-429d-834c-bff50628b542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:03.631877 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf2d05-1896-48c5-8cd3-0dc1daf20903 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:03.672879 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8102b3a-bd13-429d-834c-bff50628b542 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:03.680535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e5331-8a3a-4adb-ab79-5cd57611fa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:03.681240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e5331-8a3a-4adb-ab79-5cd57611fa94 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:03.681531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e5331-8a3a-4adb-ab79-5cd57611fa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:03.682015 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e5331-8a3a-4adb-ab79-5cd57611fa94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:03.682961 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e5331-8a3a-4adb-ab79-5cd57611fa94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:03.685753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e5331-8a3a-4adb-ab79-5cd57611fa94 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:03.696891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1060/2107] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:03.700283 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46cc97-ac42-474e-b7d6-7f139d85f488 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:03.700569 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46cc97-ac42-474e-b7d6-7f139d85f488 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:03.700894 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46cc97-ac42-474e-b7d6-7f139d85f488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:03.714166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07972e25-53ec-4ed4-a44b-208b5d980a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:03.716020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07972e25-53ec-4ed4-a44b-208b5d980a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:03.717358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07972e25-53ec-4ed4-a44b-208b5d980a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:03.717765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07972e25-53ec-4ed4-a44b-208b5d980a9c admin admin] PATH_INFO: `/v3/users/356df5b834454319aaa91584809b22c1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:03.719931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07972e25-53ec-4ed4-a44b-208b5d980a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=356df5b834454319aaa91584809b22c1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:03.722128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07972e25-53ec-4ed4-a44b-208b5d980a9c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:03.748209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4d46cc97-ac42-474e-b7d6-7f139d85f488 None None] MFA Rules not processed for user `56f23722191b4d8dac153ffea9e743c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:03.749743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4d46cc97-ac42-474e-b7d6-7f139d85f488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:03.834995 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1061/2108] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:03.834995 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46cc97-ac42-474e-b7d6-7f139d85f488 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:03.837027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4d46cc97-ac42-474e-b7d6-7f139d85f488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:03.857762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46cc97-ac42-474e-b7d6-7f139d85f488 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:03.862465 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbbacb-5968-4aa6-8a84-a845f384a86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:03.863481 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbbacb-5968-4aa6-8a84-a845f384a86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:03.863868 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbbacb-5968-4aa6-8a84-a845f384a86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:03.864236 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbbacb-5968-4aa6-8a84-a845f384a86b admin admin] PATH_INFO: `/v3/users/ebd1eff659f245e2ac158524ca209e71` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:03.865580 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbbacb-5968-4aa6-8a84-a845f384a86b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd1eff659f245e2ac158524ca209e71)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:03.868774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbbacb-5968-4aa6-8a84-a845f384a86b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:03.983215 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-07972e25-53ec-4ed4-a44b-208b5d980a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '356df5b834454319aaa91584809b22c1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.030967 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-07972e25-53ec-4ed4-a44b-208b5d980a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '356df5b834454319aaa91584809b22c1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.043632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-07972e25-53ec-4ed4-a44b-208b5d980a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '356df5b834454319aaa91584809b22c1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.043873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:04.051573 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-49bbbacb-5968-4aa6-8a84-a845f384a86b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd1eff659f245e2ac158524ca209e71'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.061102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-07972e25-53ec-4ed4-a44b-208b5d980a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '356df5b834454319aaa91584809b22c1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.062245 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-07972e25-53ec-4ed4-a44b-208b5d980a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '356df5b834454319aaa91584809b22c1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.070329 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1048/2109] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:03 2022] DELETE /identity/v3/users/356df5b834454319aaa91584809b22c1 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:04.071230 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07972e25-53ec-4ed4-a44b-208b5d980a9c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:04.072691 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-07972e25-53ec-4ed4-a44b-208b5d980a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:04.127780 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-49bbbacb-5968-4aa6-8a84-a845f384a86b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd1eff659f245e2ac158524ca209e71'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.128446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-49bbbacb-5968-4aa6-8a84-a845f384a86b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd1eff659f245e2ac158524ca209e71'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.145604 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-49bbbacb-5968-4aa6-8a84-a845f384a86b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd1eff659f245e2ac158524ca209e71'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.148203 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07972e25-53ec-4ed4-a44b-208b5d980a9c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:04.153328 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be81d1-aeb0-4b6b-84ed-6028750bb1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:04.154340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be81d1-aeb0-4b6b-84ed-6028750bb1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:04.155397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be81d1-aeb0-4b6b-84ed-6028750bb1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:04.155397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be81d1-aeb0-4b6b-84ed-6028750bb1fc admin admin] PATH_INFO: `/v3/projects/5168fbb82f234ae28caf4767e89465a0/users/227956b190a443edb09ba764f9dabf45/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:04.156244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-49bbbacb-5968-4aa6-8a84-a845f384a86b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd1eff659f245e2ac158524ca209e71'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.164491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1062/2110] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:03 2022] DELETE /identity/v3/users/ebd1eff659f245e2ac158524ca209e71 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:04.165878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbbacb-5968-4aa6-8a84-a845f384a86b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:04.168260 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-49bbbacb-5968-4aa6-8a84-a845f384a86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:04.175990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be81d1-aeb0-4b6b-84ed-6028750bb1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5168fbb82f234ae28caf4767e89465a0, user_id=227956b190a443edb09ba764f9dabf45, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:04.180771 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be81d1-aeb0-4b6b-84ed-6028750bb1fc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:04.197267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:04.249643 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbbacb-5968-4aa6-8a84-a845f384a86b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:04.255160 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cead0e-0d40-4baa-9a56-aff5156659c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:04.256064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cead0e-0d40-4baa-9a56-aff5156659c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:04.256366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cead0e-0d40-4baa-9a56-aff5156659c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:04.256645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cead0e-0d40-4baa-9a56-aff5156659c3 admin admin] PATH_INFO: `/v3/users/bd9732e3df2f46a8af8ecf922e8fbaf9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:04.258199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cead0e-0d40-4baa-9a56-aff5156659c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd9732e3df2f46a8af8ecf922e8fbaf9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:04.260215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cead0e-0d40-4baa-9a56-aff5156659c3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:04.285920 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1049/2111] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:04 2022] PUT /identity/v3/projects/5168fbb82f234ae28caf4767e89465a0/users/227956b190a443edb09ba764f9dabf45/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:04.285920 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be81d1-aeb0-4b6b-84ed-6028750bb1fc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:04.292422 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-39be81d1-aeb0-4b6b-84ed-6028750bb1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:04.360047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be81d1-aeb0-4b6b-84ed-6028750bb1fc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:04.363876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881e0e6-ea82-4e41-ac3a-79150bb2c646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:04.364593 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881e0e6-ea82-4e41-ac3a-79150bb2c646 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:04.364872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881e0e6-ea82-4e41-ac3a-79150bb2c646 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:04.365144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881e0e6-ea82-4e41-ac3a-79150bb2c646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:04.368966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d881e0e6-ea82-4e41-ac3a-79150bb2c646 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:04.447857 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881e0e6-ea82-4e41-ac3a-79150bb2c646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:04.449352 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881e0e6-ea82-4e41-ac3a-79150bb2c646 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:04.461348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1050/2112] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:04.462744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881e0e6-ea82-4e41-ac3a-79150bb2c646 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:04.466697 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d881e0e6-ea82-4e41-ac3a-79150bb2c646 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:04.496782 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-20cead0e-0d40-4baa-9a56-aff5156659c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd9732e3df2f46a8af8ecf922e8fbaf9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.575756 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881e0e6-ea82-4e41-ac3a-79150bb2c646 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:04.581934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78112a8f-1d12-473f-9cbd-0960c8370595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:04.583075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78112a8f-1d12-473f-9cbd-0960c8370595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:04.583075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78112a8f-1d12-473f-9cbd-0960c8370595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:04.583681 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78112a8f-1d12-473f-9cbd-0960c8370595 admin admin] PATH_INFO: `/v3/projects/47c5c9602e9e47f38a5a8244aefd3bbd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:04.585260 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78112a8f-1d12-473f-9cbd-0960c8370595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c5c9602e9e47f38a5a8244aefd3bbd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:04.587079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-20cead0e-0d40-4baa-9a56-aff5156659c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd9732e3df2f46a8af8ecf922e8fbaf9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.587729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-20cead0e-0d40-4baa-9a56-aff5156659c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd9732e3df2f46a8af8ecf922e8fbaf9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.588510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78112a8f-1d12-473f-9cbd-0960c8370595 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:04.603521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-20cead0e-0d40-4baa-9a56-aff5156659c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd9732e3df2f46a8af8ecf922e8fbaf9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.612681 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-20cead0e-0d40-4baa-9a56-aff5156659c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd9732e3df2f46a8af8ecf922e8fbaf9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.620810 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1063/2113] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:04 2022] DELETE /identity/v3/users/bd9732e3df2f46a8af8ecf922e8fbaf9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:04.622127 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c8325-7f43-4819-881c-ec19a02ffbd5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:04.622413 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c8325-7f43-4819-881c-ec19a02ffbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:04.622705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c8325-7f43-4819-881c-ec19a02ffbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:04.653842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1c3c8325-7f43-4819-881c-ec19a02ffbd5 None None] MFA Rules not processed for user `227956b190a443edb09ba764f9dabf45`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:04.655204 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1c3c8325-7f43-4819-881c-ec19a02ffbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:04.722219 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1064/2114] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:04.728293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50183725-4076-4aad-9a3a-0997ce633a58 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:04.728583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50183725-4076-4aad-9a3a-0997ce633a58 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:04.728867 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50183725-4076-4aad-9a3a-0997ce633a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:04.749606 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-50183725-4076-4aad-9a3a-0997ce633a58 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:04.750860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-50183725-4076-4aad-9a3a-0997ce633a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:04.785338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-78112a8f-1d12-473f-9cbd-0960c8370595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c5c9602e9e47f38a5a8244aefd3bbd', 'request_id': 'req-78112a8f-1d12-473f-9cbd-0960c8370595'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.793595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-78112a8f-1d12-473f-9cbd-0960c8370595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c5c9602e9e47f38a5a8244aefd3bbd', 'request_id': 'req-78112a8f-1d12-473f-9cbd-0960c8370595'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.839661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1065/2115] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:04.840648 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50183725-4076-4aad-9a3a-0997ce633a58 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:04.841876 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-50183725-4076-4aad-9a3a-0997ce633a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:04.857023 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50183725-4076-4aad-9a3a-0997ce633a58 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:04.893599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-78112a8f-1d12-473f-9cbd-0960c8370595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c5c9602e9e47f38a5a8244aefd3bbd', 'request_id': 'req-78112a8f-1d12-473f-9cbd-0960c8370595'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.906319 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-78112a8f-1d12-473f-9cbd-0960c8370595 admin admin] The token cache is being invalidate because project 47c5c9602e9e47f38a5a8244aefd3bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:04.906650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-78112a8f-1d12-473f-9cbd-0960c8370595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.907379 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-78112a8f-1d12-473f-9cbd-0960c8370595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:04.909084 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1051/2116] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:04 2022] DELETE /identity/v3/projects/47c5c9602e9e47f38a5a8244aefd3bbd => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:04.909896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78112a8f-1d12-473f-9cbd-0960c8370595 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:04.911346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-78112a8f-1d12-473f-9cbd-0960c8370595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:04.931477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa55f47-8655-4177-a842-79bbd2f20e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:04.932409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa55f47-8655-4177-a842-79bbd2f20e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:04.932692 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa55f47-8655-4177-a842-79bbd2f20e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:04.933034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa55f47-8655-4177-a842-79bbd2f20e64 admin admin] PATH_INFO: `/v3/projects/b0b8f4702c6e432d88bdf9f826d592bf` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:04.934349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa55f47-8655-4177-a842-79bbd2f20e64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b8f4702c6e432d88bdf9f826d592bf)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:04.936318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa55f47-8655-4177-a842-79bbd2f20e64 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:04.989922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78112a8f-1d12-473f-9cbd-0960c8370595 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:04.995737 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffc244-0d05-4658-b888-5019fce11dda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:04.996393 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffc244-0d05-4658-b888-5019fce11dda service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:04.996668 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffc244-0d05-4658-b888-5019fce11dda service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:04.996937 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffc244-0d05-4658-b888-5019fce11dda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:04.998771 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7fffc244-0d05-4658-b888-5019fce11dda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:05.063930 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffc244-0d05-4658-b888-5019fce11dda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:05.065733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffc244-0d05-4658-b888-5019fce11dda service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:05.071205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8aa55f47-8655-4177-a842-79bbd2f20e64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b8f4702c6e432d88bdf9f826d592bf', 'request_id': 'req-8aa55f47-8655-4177-a842-79bbd2f20e64'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.076309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1052/2117] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:05.077160 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffc244-0d05-4658-b888-5019fce11dda service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:05.078544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7fffc244-0d05-4658-b888-5019fce11dda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:05.097462 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffc244-0d05-4658-b888-5019fce11dda service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:05.165877 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8aa55f47-8655-4177-a842-79bbd2f20e64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b8f4702c6e432d88bdf9f826d592bf', 'request_id': 'req-8aa55f47-8655-4177-a842-79bbd2f20e64'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.169790 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8aa55f47-8655-4177-a842-79bbd2f20e64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b8f4702c6e432d88bdf9f826d592bf', 'request_id': 'req-8aa55f47-8655-4177-a842-79bbd2f20e64'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.185268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8aa55f47-8655-4177-a842-79bbd2f20e64 admin admin] The token cache is being invalidate because project b0b8f4702c6e432d88bdf9f826d592bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:05.185734 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8aa55f47-8655-4177-a842-79bbd2f20e64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.186641 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8aa55f47-8655-4177-a842-79bbd2f20e64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.195687 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1066/2118] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:04 2022] DELETE /identity/v3/projects/b0b8f4702c6e432d88bdf9f826d592bf => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:05.197203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa55f47-8655-4177-a842-79bbd2f20e64 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:05.199181 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8aa55f47-8655-4177-a842-79bbd2f20e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:05.209859 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0662b61-970c-48b4-bc37-5b7b75a137ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:05.211549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0662b61-970c-48b4-bc37-5b7b75a137ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:05.211970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0662b61-970c-48b4-bc37-5b7b75a137ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:05.212303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0662b61-970c-48b4-bc37-5b7b75a137ac admin admin] PATH_INFO: `/v3/projects/0e449a01f572433db0a1eb60cb210104` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:05.220568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0662b61-970c-48b4-bc37-5b7b75a137ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e449a01f572433db0a1eb60cb210104)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:05.220568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0662b61-970c-48b4-bc37-5b7b75a137ac admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:05.321662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa55f47-8655-4177-a842-79bbd2f20e64 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:05.326718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c24e9-bcf0-46b7-9606-7707f5b8bd87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:05.326994 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c24e9-bcf0-46b7-9606-7707f5b8bd87 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:05.327148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c24e9-bcf0-46b7-9606-7707f5b8bd87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:05.327548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c24e9-bcf0-46b7-9606-7707f5b8bd87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:05.329491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7d1c24e9-bcf0-46b7-9606-7707f5b8bd87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:05.342744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c24e9-bcf0-46b7-9606-7707f5b8bd87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:05.344298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c24e9-bcf0-46b7-9606-7707f5b8bd87 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:05.357752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1067/2119] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:05.360126 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5178d65-e172-4016-b8bd-67ed8552ea7e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:05.360126 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5178d65-e172-4016-b8bd-67ed8552ea7e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:05.360126 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5178d65-e172-4016-b8bd-67ed8552ea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:05.383282 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d5178d65-e172-4016-b8bd-67ed8552ea7e None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:05.384812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d5178d65-e172-4016-b8bd-67ed8552ea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:05.406574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1068/2120] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:05.406574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea94b1-6239-4755-aed5-7c53de581dc4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:05.406574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea94b1-6239-4755-aed5-7c53de581dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:05.406574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea94b1-6239-4755-aed5-7c53de581dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:05.424479 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a0662b61-970c-48b4-bc37-5b7b75a137ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e449a01f572433db0a1eb60cb210104', 'request_id': 'req-a0662b61-970c-48b4-bc37-5b7b75a137ac'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.429302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3aea94b1-6239-4755-aed5-7c53de581dc4 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:05.430916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3aea94b1-6239-4755-aed5-7c53de581dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:05.434787 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a0662b61-970c-48b4-bc37-5b7b75a137ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e449a01f572433db0a1eb60cb210104', 'request_id': 'req-a0662b61-970c-48b4-bc37-5b7b75a137ac'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.497447 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1069/2121] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:05.498487 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea94b1-6239-4755-aed5-7c53de581dc4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:05.500102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3aea94b1-6239-4755-aed5-7c53de581dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:05.513914 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea94b1-6239-4755-aed5-7c53de581dc4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:05.519954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a7aa3-2601-4b36-855d-e88fe085fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:05.521894 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a7aa3-2601-4b36-855d-e88fe085fa76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:05.522261 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a0662b61-970c-48b4-bc37-5b7b75a137ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e449a01f572433db0a1eb60cb210104', 'request_id': 'req-a0662b61-970c-48b4-bc37-5b7b75a137ac'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.522384 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a7aa3-2601-4b36-855d-e88fe085fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:05.522652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a7aa3-2601-4b36-855d-e88fe085fa76 admin admin] PATH_INFO: `/v3/users/227956b190a443edb09ba764f9dabf45` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:05.524111 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a7aa3-2601-4b36-855d-e88fe085fa76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=227956b190a443edb09ba764f9dabf45)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:05.526216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a7aa3-2601-4b36-855d-e88fe085fa76 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:05.542127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a0662b61-970c-48b4-bc37-5b7b75a137ac admin admin] The token cache is being invalidate because project 0e449a01f572433db0a1eb60cb210104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:05.542127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a0662b61-970c-48b4-bc37-5b7b75a137ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.542127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a0662b61-970c-48b4-bc37-5b7b75a137ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.542127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1053/2122] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:05 2022] DELETE /identity/v3/projects/0e449a01f572433db0a1eb60cb210104 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:05.542539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6a9e3-c9b6-4b8d-adc0-2c1c9d895f37 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:05.542539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6a9e3-c9b6-4b8d-adc0-2c1c9d895f37 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:05.542841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6a9e3-c9b6-4b8d-adc0-2c1c9d895f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:05.563447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c7c6a9e3-c9b6-4b8d-adc0-2c1c9d895f37 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:05.571224 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c7c6a9e3-c9b6-4b8d-adc0-2c1c9d895f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:05.574158 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1054/2123] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:05.575258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a229f-d924-4f57-9ba7-fe568c15524c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:05.575549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a229f-d924-4f57-9ba7-fe568c15524c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:05.575817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a229f-d924-4f57-9ba7-fe568c15524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:05.594208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-782a229f-d924-4f57-9ba7-fe568c15524c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:05.595884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-782a229f-d924-4f57-9ba7-fe568c15524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:05.605785 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1055/2124] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:05.607186 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7bf6e-1bcc-416e-b02b-80269fddd07d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:05.607467 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7bf6e-1bcc-416e-b02b-80269fddd07d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:05.607732 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7bf6e-1bcc-416e-b02b-80269fddd07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:05.626471 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-29f7bf6e-1bcc-416e-b02b-80269fddd07d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:05.627698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-29f7bf6e-1bcc-416e-b02b-80269fddd07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:05.637276 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1056/2125] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:05.638212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7bf6e-1bcc-416e-b02b-80269fddd07d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:05.647825 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7bf6e-1bcc-416e-b02b-80269fddd07d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:05.653084 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5575047-ff04-486e-b14f-67c1aa5c9e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:05.653763 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5575047-ff04-486e-b14f-67c1aa5c9e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:05.654026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5575047-ff04-486e-b14f-67c1aa5c9e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:05.654293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5575047-ff04-486e-b14f-67c1aa5c9e78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:05.655111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5575047-ff04-486e-b14f-67c1aa5c9e78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:05.655419 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5575047-ff04-486e-b14f-67c1aa5c9e78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:05.657029 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5575047-ff04-486e-b14f-67c1aa5c9e78 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:05.662127 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:05.669296 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1057/2126] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:37:05.670248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5575047-ff04-486e-b14f-67c1aa5c9e78 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:05.680836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5575047-ff04-486e-b14f-67c1aa5c9e78 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:05.687118 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c205bc-6f1a-4d96-a59c-e92e2e92f677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:05.687799 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c205bc-6f1a-4d96-a59c-e92e2e92f677 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:05.688086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c205bc-6f1a-4d96-a59c-e92e2e92f677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:05.688366 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c205bc-6f1a-4d96-a59c-e92e2e92f677 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:05.689247 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c205bc-6f1a-4d96-a59c-e92e2e92f677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:05.692735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c205bc-6f1a-4d96-a59c-e92e2e92f677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:05.692735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c205bc-6f1a-4d96-a59c-e92e2e92f677 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:05.708708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1058/2127] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:37:05.708708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62df25-54bc-4ef9-af6e-8825285971aa None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:05.708708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62df25-54bc-4ef9-af6e-8825285971aa None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:05.708708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62df25-54bc-4ef9-af6e-8825285971aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:05.725601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5a62df25-54bc-4ef9-af6e-8825285971aa None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:05.727764 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5a62df25-54bc-4ef9-af6e-8825285971aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:05.743194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1059/2128] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:05.744062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62df25-54bc-4ef9-af6e-8825285971aa None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:05.754615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62df25-54bc-4ef9-af6e-8825285971aa None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:05.759991 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1be02e-e366-448b-adff-11d7f3ad897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:05.760644 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1be02e-e366-448b-adff-11d7f3ad897b admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:05.760923 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1be02e-e366-448b-adff-11d7f3ad897b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:05.761281 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1be02e-e366-448b-adff-11d7f3ad897b admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:05.761981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1be02e-e366-448b-adff-11d7f3ad897b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:05.764014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1be02e-e366-448b-adff-11d7f3ad897b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:05.798343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ae1a7aa3-2601-4b36-855d-e88fe085fa76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227956b190a443edb09ba764f9dabf45'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.882662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ae1a7aa3-2601-4b36-855d-e88fe085fa76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227956b190a443edb09ba764f9dabf45'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.883443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ae1a7aa3-2601-4b36-855d-e88fe085fa76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227956b190a443edb09ba764f9dabf45'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.893005 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1060/2129] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:05 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:05.893005 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1be02e-e366-448b-adff-11d7f3ad897b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:05.897856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ad1be02e-e366-448b-adff-11d7f3ad897b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:05.899384 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ae1a7aa3-2601-4b36-855d-e88fe085fa76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227956b190a443edb09ba764f9dabf45'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.906703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ae1a7aa3-2601-4b36-855d-e88fe085fa76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227956b190a443edb09ba764f9dabf45'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.913067 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1070/2130] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:05 2022] DELETE /identity/v3/users/227956b190a443edb09ba764f9dabf45 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:05.913881 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a7aa3-2601-4b36-855d-e88fe085fa76 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:05.915855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ae1a7aa3-2601-4b36-855d-e88fe085fa76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:05.963227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1be02e-e366-448b-adff-11d7f3ad897b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:05.984287 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a7aa3-2601-4b36-855d-e88fe085fa76 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:05.989901 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6934a9-bd77-451c-8144-c0e8476f7498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:05.990570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6934a9-bd77-451c-8144-c0e8476f7498 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:05.990879 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6934a9-bd77-451c-8144-c0e8476f7498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:05.991190 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6934a9-bd77-451c-8144-c0e8476f7498 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:05.991954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6934a9-bd77-451c-8144-c0e8476f7498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:05.992903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6934a9-bd77-451c-8144-c0e8476f7498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:05.994681 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6934a9-bd77-451c-8144-c0e8476f7498 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.006795 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1071/2131] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:37:06.009778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6934a9-bd77-451c-8144-c0e8476f7498 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.012808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3c6934a9-bd77-451c-8144-c0e8476f7498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:06.027476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6934a9-bd77-451c-8144-c0e8476f7498 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.029092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66815e-7c28-4284-920d-1be9dbba05c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.029761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66815e-7c28-4284-920d-1be9dbba05c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.030042 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66815e-7c28-4284-920d-1be9dbba05c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.030316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66815e-7c28-4284-920d-1be9dbba05c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.030827 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbec3e-9bf5-4320-82ef-363a078bf20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.031048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66815e-7c28-4284-920d-1be9dbba05c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.031677 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbec3e-9bf5-4320-82ef-363a078bf20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.031951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbec3e-9bf5-4320-82ef-363a078bf20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.032216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbec3e-9bf5-4320-82ef-363a078bf20e admin admin] PATH_INFO: `/v3/projects/f1dbc02af62d45888068408a377a37d8` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.032973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66815e-7c28-4284-920d-1be9dbba05c7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.033403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbec3e-9bf5-4320-82ef-363a078bf20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1dbc02af62d45888068408a377a37d8)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.035330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbec3e-9bf5-4320-82ef-363a078bf20e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.100161 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:06.182054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1061/2132] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:05 2022] POST /identity/v3/projects => generated 385 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:06.183081 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66815e-7c28-4284-920d-1be9dbba05c7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.184770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8e66815e-7c28-4284-920d-1be9dbba05c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:06.214051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-23dbec3e-9bf5-4320-82ef-363a078bf20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1dbc02af62d45888068408a377a37d8', 'request_id': 'req-23dbec3e-9bf5-4320-82ef-363a078bf20e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:06.253460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66815e-7c28-4284-920d-1be9dbba05c7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.316749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f598cf-1487-4136-a568-f7a1e508e987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.317508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f598cf-1487-4136-a568-f7a1e508e987 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.317797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f598cf-1487-4136-a568-f7a1e508e987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.318072 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f598cf-1487-4136-a568-f7a1e508e987 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.318808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f598cf-1487-4136-a568-f7a1e508e987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.321333 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f598cf-1487-4136-a568-f7a1e508e987 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.366755 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-23dbec3e-9bf5-4320-82ef-363a078bf20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1dbc02af62d45888068408a377a37d8', 'request_id': 'req-23dbec3e-9bf5-4320-82ef-363a078bf20e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:06.375663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-23dbec3e-9bf5-4320-82ef-363a078bf20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1dbc02af62d45888068408a377a37d8', 'request_id': 'req-23dbec3e-9bf5-4320-82ef-363a078bf20e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:06.388678 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-23dbec3e-9bf5-4320-82ef-363a078bf20e admin admin] The token cache is being invalidate because project f1dbc02af62d45888068408a377a37d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:06.388985 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-23dbec3e-9bf5-4320-82ef-363a078bf20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:06.389646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-23dbec3e-9bf5-4320-82ef-363a078bf20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:06.391829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1072/2133] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:06 2022] DELETE /identity/v3/projects/f1dbc02af62d45888068408a377a37d8 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:06.393099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446ed24-0a70-4679-a939-e7a0e3590065 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.393391 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446ed24-0a70-4679-a939-e7a0e3590065 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.395267 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446ed24-0a70-4679-a939-e7a0e3590065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.412980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2446ed24-0a70-4679-a939-e7a0e3590065 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:06.414902 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2446ed24-0a70-4679-a939-e7a0e3590065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:06.423573 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1073/2134] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:06.424523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446ed24-0a70-4679-a939-e7a0e3590065 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.425788 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2446ed24-0a70-4679-a939-e7a0e3590065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:06.439499 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446ed24-0a70-4679-a939-e7a0e3590065 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.444750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cfca4-a2de-473f-8a47-032a72951677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.445672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cfca4-a2de-473f-8a47-032a72951677 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.445963 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cfca4-a2de-473f-8a47-032a72951677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.446241 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cfca4-a2de-473f-8a47-032a72951677 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.447071 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56cfca4-a2de-473f-8a47-032a72951677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.448983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56cfca4-a2de-473f-8a47-032a72951677 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.454929 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1062/2135] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:06 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:06.455778 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f598cf-1487-4136-a568-f7a1e508e987 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.457391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-78f598cf-1487-4136-a568-f7a1e508e987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:06.470779 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f598cf-1487-4136-a568-f7a1e508e987 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.475571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124cf0e-7154-4c0f-9a9f-bff81bbf498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.476236 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124cf0e-7154-4c0f-9a9f-bff81bbf498c admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.476519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124cf0e-7154-4c0f-9a9f-bff81bbf498c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.477482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124cf0e-7154-4c0f-9a9f-bff81bbf498c admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.478178 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124cf0e-7154-4c0f-9a9f-bff81bbf498c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.480128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124cf0e-7154-4c0f-9a9f-bff81bbf498c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.552075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:06.588545 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1074/2136] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:06 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:06.593069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1063/2137] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:06 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:06.593247 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1f8da-46bc-45e8-b6dd-c564b865f593 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.593247 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1f8da-46bc-45e8-b6dd-c564b865f593 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.593419 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124cf0e-7154-4c0f-9a9f-bff81bbf498c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.593505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1f8da-46bc-45e8-b6dd-c564b865f593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.593589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7124cf0e-7154-4c0f-9a9f-bff81bbf498c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:06.606736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124cf0e-7154-4c0f-9a9f-bff81bbf498c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.609163 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-83f1f8da-46bc-45e8-b6dd-c564b865f593 None None] MFA Rules not processed for user `56f23722191b4d8dac153ffea9e743c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:06.610384 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-83f1f8da-46bc-45e8-b6dd-c564b865f593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:06.665752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901c2ae-2898-4be5-b8f4-33e4e254fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.667019 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901c2ae-2898-4be5-b8f4-33e4e254fd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.667348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901c2ae-2898-4be5-b8f4-33e4e254fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.667560 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901c2ae-2898-4be5-b8f4-33e4e254fd03 admin admin] PATH_INFO: `/v3/users/959204d0b2944b22ad51c044ea9dd405` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.668849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901c2ae-2898-4be5-b8f4-33e4e254fd03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=959204d0b2944b22ad51c044ea9dd405)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.669883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1075/2138] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:06.674349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1f8da-46bc-45e8-b6dd-c564b865f593 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.674482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901c2ae-2898-4be5-b8f4-33e4e254fd03 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.675853 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-83f1f8da-46bc-45e8-b6dd-c564b865f593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:06.736136 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1f8da-46bc-45e8-b6dd-c564b865f593 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.739884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b78211-db55-4a18-967b-fd935e2f92eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.740553 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b78211-db55-4a18-967b-fd935e2f92eb service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.740813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b78211-db55-4a18-967b-fd935e2f92eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.741107 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b78211-db55-4a18-967b-fd935e2f92eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.751737 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b78211-db55-4a18-967b-fd935e2f92eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.753202 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b78211-db55-4a18-967b-fd935e2f92eb service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.764377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1076/2139] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:06.765459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b78211-db55-4a18-967b-fd935e2f92eb service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.766907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-79b78211-db55-4a18-967b-fd935e2f92eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:06.781225 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b78211-db55-4a18-967b-fd935e2f92eb service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.786901 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65798701-f2c1-47e3-b0d6-6233f23ee83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.791142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65798701-f2c1-47e3-b0d6-6233f23ee83f admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.791142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65798701-f2c1-47e3-b0d6-6233f23ee83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.791142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65798701-f2c1-47e3-b0d6-6233f23ee83f admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.791142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65798701-f2c1-47e3-b0d6-6233f23ee83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.791605 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65798701-f2c1-47e3-b0d6-6233f23ee83f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.803065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1077/2140] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:06.804030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65798701-f2c1-47e3-b0d6-6233f23ee83f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.816216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65798701-f2c1-47e3-b0d6-6233f23ee83f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.823068 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df23f50-2928-45aa-8b84-c7b4de8e15a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.823740 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df23f50-2928-45aa-8b84-c7b4de8e15a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.824099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df23f50-2928-45aa-8b84-c7b4de8e15a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.824379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df23f50-2928-45aa-8b84-c7b4de8e15a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.825081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df23f50-2928-45aa-8b84-c7b4de8e15a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.827072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df23f50-2928-45aa-8b84-c7b4de8e15a1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.857387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c901c2ae-2898-4be5-b8f4-33e4e254fd03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '959204d0b2944b22ad51c044ea9dd405'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:06.955800 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1078/2141] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:06 2022] POST /identity/v3/users => generated 291 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:06.955800 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df23f50-2928-45aa-8b84-c7b4de8e15a1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.964597 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df23f50-2928-45aa-8b84-c7b4de8e15a1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.969265 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77817f8d-575c-41c9-9e4c-b8ea775f6b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.969920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77817f8d-575c-41c9-9e4c-b8ea775f6b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.970200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77817f8d-575c-41c9-9e4c-b8ea775f6b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.970472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77817f8d-575c-41c9-9e4c-b8ea775f6b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.971304 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77817f8d-575c-41c9-9e4c-b8ea775f6b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.972905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77817f8d-575c-41c9-9e4c-b8ea775f6b45 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.988324 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1079/2142] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:06.988740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c901c2ae-2898-4be5-b8f4-33e4e254fd03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '959204d0b2944b22ad51c044ea9dd405'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:06.989481 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77817f8d-575c-41c9-9e4c-b8ea775f6b45 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:07.000912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c901c2ae-2898-4be5-b8f4-33e4e254fd03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '959204d0b2944b22ad51c044ea9dd405'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:07.001450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77817f8d-575c-41c9-9e4c-b8ea775f6b45 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:07.008471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1f3ad-7d5d-45fd-9893-03d5da0f9e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:07.009428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1f3ad-7d5d-45fd-9893-03d5da0f9e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.009863 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1f3ad-7d5d-45fd-9893-03d5da0f9e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.010312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1f3ad-7d5d-45fd-9893-03d5da0f9e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.011301 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1f3ad-7d5d-45fd-9893-03d5da0f9e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:07.013427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1f3ad-7d5d-45fd-9893-03d5da0f9e21 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:07.022455 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c901c2ae-2898-4be5-b8f4-33e4e254fd03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '959204d0b2944b22ad51c044ea9dd405'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:07.024412 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c901c2ae-2898-4be5-b8f4-33e4e254fd03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '959204d0b2944b22ad51c044ea9dd405'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:07.028486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1080/2143] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:07.028486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1f3ad-7d5d-45fd-9893-03d5da0f9e21 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:07.029727 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-08c1f3ad-7d5d-45fd-9893-03d5da0f9e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:07.034600 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1064/2144] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:06 2022] DELETE /identity/v3/users/959204d0b2944b22ad51c044ea9dd405 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:07.036464 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901c2ae-2898-4be5-b8f4-33e4e254fd03 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:07.038175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c901c2ae-2898-4be5-b8f4-33e4e254fd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:07.049191 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1f3ad-7d5d-45fd-9893-03d5da0f9e21 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:07.115932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901c2ae-2898-4be5-b8f4-33e4e254fd03 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:07.122431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc2edb-8bb8-44a3-9f3e-f1de79cb37bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:07.123258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc2edb-8bb8-44a3-9f3e-f1de79cb37bd admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.123538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc2edb-8bb8-44a3-9f3e-f1de79cb37bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.123828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc2edb-8bb8-44a3-9f3e-f1de79cb37bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.124637 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc2edb-8bb8-44a3-9f3e-f1de79cb37bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:07.126267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc2edb-8bb8-44a3-9f3e-f1de79cb37bd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:07.134501 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4214e50-3fd5-4219-b510-dc9fc72735a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:07.135608 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4214e50-3fd5-4219-b510-dc9fc72735a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.135886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4214e50-3fd5-4219-b510-dc9fc72735a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.136161 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4214e50-3fd5-4219-b510-dc9fc72735a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.136900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4214e50-3fd5-4219-b510-dc9fc72735a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:07.138859 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4214e50-3fd5-4219-b510-dc9fc72735a8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:07.139610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1065/2145] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:07.140591 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc2edb-8bb8-44a3-9f3e-f1de79cb37bd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:07.145127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-18fc2edb-8bb8-44a3-9f3e-f1de79cb37bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:07.152626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1081/2146] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:07.153464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4214e50-3fd5-4219-b510-dc9fc72735a8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:07.160540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc2edb-8bb8-44a3-9f3e-f1de79cb37bd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:07.164808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4214e50-3fd5-4219-b510-dc9fc72735a8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:07.166877 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888794a1-b9a7-47f6-bf9c-264ee9df9bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:07.168312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:07.168473 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888794a1-b9a7-47f6-bf9c-264ee9df9bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.168823 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888794a1-b9a7-47f6-bf9c-264ee9df9bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.169202 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888794a1-b9a7-47f6-bf9c-264ee9df9bf1 admin admin] PATH_INFO: `/v3/projects/10e2a2f79e7946fe879b5b3f3fb3b799/users/9af15e811258481ba8244c596c3eef21/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.175045 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aed558-5b50-430d-b115-e3dc86a18ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:07.175997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aed558-5b50-430d-b115-e3dc86a18ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.176199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aed558-5b50-430d-b115-e3dc86a18ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.176472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aed558-5b50-430d-b115-e3dc86a18ca3 admin admin] PATH_INFO: `/v3/projects/8caeb3b7f55442d29dfe6284ea7e851a/users/0c868634794b4124be8ce584398e8401/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.188396 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888794a1-b9a7-47f6-bf9c-264ee9df9bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e2a2f79e7946fe879b5b3f3fb3b799, user_id=9af15e811258481ba8244c596c3eef21, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:07.191386 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888794a1-b9a7-47f6-bf9c-264ee9df9bf1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:07.200034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aed558-5b50-430d-b115-e3dc86a18ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8caeb3b7f55442d29dfe6284ea7e851a, user_id=0c868634794b4124be8ce584398e8401, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:07.202850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aed558-5b50-430d-b115-e3dc86a18ca3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:07.314122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1066/2147] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:07 2022] PUT /identity/v3/projects/10e2a2f79e7946fe879b5b3f3fb3b799/users/9af15e811258481ba8244c596c3eef21/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:07.319299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888794a1-b9a7-47f6-bf9c-264ee9df9bf1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:07.363806 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1082/2148] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:07 2022] PUT /identity/v3/projects/8caeb3b7f55442d29dfe6284ea7e851a/users/0c868634794b4124be8ce584398e8401/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:07.365173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83868c5b-f88f-476c-aac1-dc3efd61fc5c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.365592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83868c5b-f88f-476c-aac1-dc3efd61fc5c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.365830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83868c5b-f88f-476c-aac1-dc3efd61fc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.382903 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888794a1-b9a7-47f6-bf9c-264ee9df9bf1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:07.384679 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-83868c5b-f88f-476c-aac1-dc3efd61fc5c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:07.385963 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-83868c5b-f88f-476c-aac1-dc3efd61fc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:07.447039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13d2d0-a390-47fb-af19-8adabafdc988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:07.447862 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13d2d0-a390-47fb-af19-8adabafdc988 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.447994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13d2d0-a390-47fb-af19-8adabafdc988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.448299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13d2d0-a390-47fb-af19-8adabafdc988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.449042 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13d2d0-a390-47fb-af19-8adabafdc988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:07.451285 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1083/2149] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:07.451630 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13d2d0-a390-47fb-af19-8adabafdc988 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:07.455855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747445c-5a5c-4d04-bd45-e7738925efd4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.456205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747445c-5a5c-4d04-bd45-e7738925efd4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.457205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747445c-5a5c-4d04-bd45-e7738925efd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.467759 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:07.473564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1067/2150] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:07.474508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13d2d0-a390-47fb-af19-8adabafdc988 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:07.476560 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8a13d2d0-a390-47fb-af19-8adabafdc988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:07.493050 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2747445c-5a5c-4d04-bd45-e7738925efd4 None None] MFA Rules not processed for user `0c868634794b4124be8ce584398e8401`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:07.494399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2747445c-5a5c-4d04-bd45-e7738925efd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:07.561346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13d2d0-a390-47fb-af19-8adabafdc988 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:07.567962 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01091c02-4ab3-4839-ab60-ce6bc589baa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:07.568631 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01091c02-4ab3-4839-ab60-ce6bc589baa8 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.568911 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01091c02-4ab3-4839-ab60-ce6bc589baa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.569185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01091c02-4ab3-4839-ab60-ce6bc589baa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.592114 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01091c02-4ab3-4839-ab60-ce6bc589baa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:07.594469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01091c02-4ab3-4839-ab60-ce6bc589baa8 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:07.598051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1084/2151] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:07.598990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747445c-5a5c-4d04-bd45-e7738925efd4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:07.612419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747445c-5a5c-4d04-bd45-e7738925efd4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:07.619658 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5626be-a106-44da-b8cb-2691dc41f5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:07.620604 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5626be-a106-44da-b8cb-2691dc41f5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.620888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5626be-a106-44da-b8cb-2691dc41f5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.621160 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5626be-a106-44da-b8cb-2691dc41f5c7 admin admin] PATH_INFO: `/v3/projects/aa1d7cf044544c2e8c4ba4139d22348d/users/e5350dcf2ca6449bacc8441d31e6d24c/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.623953 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1068/2152] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:07.624849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01091c02-4ab3-4839-ab60-ce6bc589baa8 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:07.626389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-01091c02-4ab3-4839-ab60-ce6bc589baa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:07.639261 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5626be-a106-44da-b8cb-2691dc41f5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1d7cf044544c2e8c4ba4139d22348d, user_id=e5350dcf2ca6449bacc8441d31e6d24c, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:07.642540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01091c02-4ab3-4839-ab60-ce6bc589baa8 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:07.642895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5626be-a106-44da-b8cb-2691dc41f5c7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:07.649109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e9f2d-8a5d-419c-a677-5a7d66be5465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:07.649927 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e9f2d-8a5d-419c-a677-5a7d66be5465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.650377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e9f2d-8a5d-419c-a677-5a7d66be5465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.650653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e9f2d-8a5d-419c-a677-5a7d66be5465 admin admin] PATH_INFO: `/v3/projects/5168fbb82f234ae28caf4767e89465a0` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.652179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e9f2d-8a5d-419c-a677-5a7d66be5465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5168fbb82f234ae28caf4767e89465a0)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:07.660288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e9f2d-8a5d-419c-a677-5a7d66be5465 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:07.804132 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1085/2153] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:07 2022] PUT /identity/v3/projects/aa1d7cf044544c2e8c4ba4139d22348d/users/e5350dcf2ca6449bacc8441d31e6d24c/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:07.805299 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5626be-a106-44da-b8cb-2691dc41f5c7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:07.870044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a91e9f2d-8a5d-419c-a677-5a7d66be5465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5168fbb82f234ae28caf4767e89465a0', 'request_id': 'req-a91e9f2d-8a5d-419c-a677-5a7d66be5465'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:07.878040 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a91e9f2d-8a5d-419c-a677-5a7d66be5465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5168fbb82f234ae28caf4767e89465a0', 'request_id': 'req-a91e9f2d-8a5d-419c-a677-5a7d66be5465'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:07.883862 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5626be-a106-44da-b8cb-2691dc41f5c7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:07.941876 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08123ed8-fa3b-459b-a577-1a6c3fe5fac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:07.942829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08123ed8-fa3b-459b-a577-1a6c3fe5fac7 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.943106 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08123ed8-fa3b-459b-a577-1a6c3fe5fac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.943374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08123ed8-fa3b-459b-a577-1a6c3fe5fac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.944068 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08123ed8-fa3b-459b-a577-1a6c3fe5fac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:07.946017 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08123ed8-fa3b-459b-a577-1a6c3fe5fac7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:08.010549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a91e9f2d-8a5d-419c-a677-5a7d66be5465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5168fbb82f234ae28caf4767e89465a0', 'request_id': 'req-a91e9f2d-8a5d-419c-a677-5a7d66be5465'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:08.025446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a91e9f2d-8a5d-419c-a677-5a7d66be5465 admin admin] The token cache is being invalidate because project 5168fbb82f234ae28caf4767e89465a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:08.025735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a91e9f2d-8a5d-419c-a677-5a7d66be5465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:08.026558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a91e9f2d-8a5d-419c-a677-5a7d66be5465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:08.028609 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1069/2154] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:07 2022] DELETE /identity/v3/projects/5168fbb82f234ae28caf4767e89465a0 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:08.029830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b559be-a99d-4509-8d76-a1507bf22e61 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:08.030146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b559be-a99d-4509-8d76-a1507bf22e61 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:08.030421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b559be-a99d-4509-8d76-a1507bf22e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:08.059514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f9b559be-a99d-4509-8d76-a1507bf22e61 None None] MFA Rules not processed for user `e5350dcf2ca6449bacc8441d31e6d24c`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:08.060741 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f9b559be-a99d-4509-8d76-a1507bf22e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:08.084141 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1086/2155] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:07 2022] POST /identity/v3/projects => generated 383 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:08.085268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08123ed8-fa3b-459b-a577-1a6c3fe5fac7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:08.086971 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-08123ed8-fa3b-459b-a577-1a6c3fe5fac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:08.132346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1070/2156] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:08.133649 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefc0f2-b267-425e-a91f-95307e865ca7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:08.134554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefc0f2-b267-425e-a91f-95307e865ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:08.135064 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefc0f2-b267-425e-a91f-95307e865ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:08.155042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08123ed8-fa3b-459b-a577-1a6c3fe5fac7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:08.156247 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-aaefc0f2-b267-425e-a91f-95307e865ca7 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:08.157553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-aaefc0f2-b267-425e-a91f-95307e865ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:08.161232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcbf60-7231-4b30-81a5-1afdd0b2529a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:08.162134 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcbf60-7231-4b30-81a5-1afdd0b2529a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:08.162404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcbf60-7231-4b30-81a5-1afdd0b2529a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:08.162701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcbf60-7231-4b30-81a5-1afdd0b2529a admin admin] PATH_INFO: `/v3/projects/d866145fbf464fb8aba890ab4a9654bd` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:08.163946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcbf60-7231-4b30-81a5-1afdd0b2529a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d866145fbf464fb8aba890ab4a9654bd)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:08.166968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcbf60-7231-4b30-81a5-1afdd0b2529a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:08.170009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1071/2157] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:08.171112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefc0f2-b267-425e-a91f-95307e865ca7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:08.172973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-aaefc0f2-b267-425e-a91f-95307e865ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:08.189240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefc0f2-b267-425e-a91f-95307e865ca7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:08.195631 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43644823-9b82-45e2-8610-482acb49f868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:08.196478 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43644823-9b82-45e2-8610-482acb49f868 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:08.196881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43644823-9b82-45e2-8610-482acb49f868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:08.197263 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43644823-9b82-45e2-8610-482acb49f868 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:08.198336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43644823-9b82-45e2-8610-482acb49f868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:08.201050 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43644823-9b82-45e2-8610-482acb49f868 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:08.345949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1072/2158] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:08 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:08.359230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8bfcbf60-7231-4b30-81a5-1afdd0b2529a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd866145fbf464fb8aba890ab4a9654bd', 'request_id': 'req-8bfcbf60-7231-4b30-81a5-1afdd0b2529a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:08.370035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43644823-9b82-45e2-8610-482acb49f868 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:08.372306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-43644823-9b82-45e2-8610-482acb49f868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:08.433448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43644823-9b82-45e2-8610-482acb49f868 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:08.455109 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8bfcbf60-7231-4b30-81a5-1afdd0b2529a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd866145fbf464fb8aba890ab4a9654bd', 'request_id': 'req-8bfcbf60-7231-4b30-81a5-1afdd0b2529a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:08.463029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8bfcbf60-7231-4b30-81a5-1afdd0b2529a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd866145fbf464fb8aba890ab4a9654bd', 'request_id': 'req-8bfcbf60-7231-4b30-81a5-1afdd0b2529a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:08.475821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8bfcbf60-7231-4b30-81a5-1afdd0b2529a admin admin] The token cache is being invalidate because project d866145fbf464fb8aba890ab4a9654bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:08.476105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8bfcbf60-7231-4b30-81a5-1afdd0b2529a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:08.476879 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8bfcbf60-7231-4b30-81a5-1afdd0b2529a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:08.479321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1087/2159] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:08 2022] DELETE /identity/v3/projects/d866145fbf464fb8aba890ab4a9654bd => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:08.486797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5e720-b9c9-4151-a398-2b5977220695 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:08.486797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5e720-b9c9-4151-a398-2b5977220695 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:08.486797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5e720-b9c9-4151-a398-2b5977220695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:08.500084 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90529b3-7f53-4883-a79d-359bf0654f7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:08.501345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90529b3-7f53-4883-a79d-359bf0654f7b service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:08.501691 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90529b3-7f53-4883-a79d-359bf0654f7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:08.503028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90529b3-7f53-4883-a79d-359bf0654f7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:08.503147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-68c5e720-b9c9-4151-a398-2b5977220695 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:08.504151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-68c5e720-b9c9-4151-a398-2b5977220695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:08.504937 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c90529b3-7f53-4883-a79d-359bf0654f7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:08.597669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1088/2160] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:08.600956 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5e720-b9c9-4151-a398-2b5977220695 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:08.602247 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-68c5e720-b9c9-4151-a398-2b5977220695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:08.602413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90529b3-7f53-4883-a79d-359bf0654f7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:08.604004 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90529b3-7f53-4883-a79d-359bf0654f7b service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:08.616793 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5e720-b9c9-4151-a398-2b5977220695 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:08.622349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1073/2161] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:08.623798 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085af099-a84d-4414-aba1-77617281848f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:08.624073 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085af099-a84d-4414-aba1-77617281848f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:08.624351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085af099-a84d-4414-aba1-77617281848f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:08.624773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa544d3-9a08-4f69-96f8-4483ef9e4801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:08.626381 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa544d3-9a08-4f69-96f8-4483ef9e4801 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:08.627200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa544d3-9a08-4f69-96f8-4483ef9e4801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:08.627741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa544d3-9a08-4f69-96f8-4483ef9e4801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:08.629600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa544d3-9a08-4f69-96f8-4483ef9e4801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:08.631667 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa544d3-9a08-4f69-96f8-4483ef9e4801 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:08.645047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1089/2162] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:08.646870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa544d3-9a08-4f69-96f8-4483ef9e4801 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:08.647019 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-085af099-a84d-4414-aba1-77617281848f None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:08.648119 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-085af099-a84d-4414-aba1-77617281848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:08.657577 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1074/2163] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:08.658024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa544d3-9a08-4f69-96f8-4483ef9e4801 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:08.658539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085af099-a84d-4414-aba1-77617281848f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:08.662897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811dfd2-3cda-4b3e-9a04-f2a4d39661a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:08.663704 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811dfd2-3cda-4b3e-9a04-f2a4d39661a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:08.664032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811dfd2-3cda-4b3e-9a04-f2a4d39661a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:08.664252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811dfd2-3cda-4b3e-9a04-f2a4d39661a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:08.665119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811dfd2-3cda-4b3e-9a04-f2a4d39661a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:08.665521 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811dfd2-3cda-4b3e-9a04-f2a4d39661a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:08.667157 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811dfd2-3cda-4b3e-9a04-f2a4d39661a4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:08.670582 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085af099-a84d-4414-aba1-77617281848f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:08.675315 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae012d8-c6b4-4030-bfe9-a1335a9d7a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:08.675989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae012d8-c6b4-4030-bfe9-a1335a9d7a85 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:08.676273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae012d8-c6b4-4030-bfe9-a1335a9d7a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:08.676553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae012d8-c6b4-4030-bfe9-a1335a9d7a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:08.677447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae012d8-c6b4-4030-bfe9-a1335a9d7a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:08.679191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae012d8-c6b4-4030-bfe9-a1335a9d7a85 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:08.683939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1090/2164] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:37:08.685621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45136866-4b30-4d5a-9a89-35acc4b7c7a3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:08.686552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45136866-4b30-4d5a-9a89-35acc4b7c7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:08.686929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45136866-4b30-4d5a-9a89-35acc4b7c7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:08.692540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1075/2165] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:08.693371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae012d8-c6b4-4030-bfe9-a1335a9d7a85 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:08.704586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae012d8-c6b4-4030-bfe9-a1335a9d7a85 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:08.711053 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-45136866-4b30-4d5a-9a89-35acc4b7c7a3 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:08.712865 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-45136866-4b30-4d5a-9a89-35acc4b7c7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:08.723068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b90f3-b44d-443e-a5da-48c1555d3b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:08.726388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1091/2166] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:08.726515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b90f3-b44d-443e-a5da-48c1555d3b34 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:08.726515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b90f3-b44d-443e-a5da-48c1555d3b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:08.726515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b90f3-b44d-443e-a5da-48c1555d3b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:08.726767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45136866-4b30-4d5a-9a89-35acc4b7c7a3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:08.726856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b90f3-b44d-443e-a5da-48c1555d3b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:08.727270 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b90f3-b44d-443e-a5da-48c1555d3b34 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:08.739314 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45136866-4b30-4d5a-9a89-35acc4b7c7a3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:08.755487 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d5b74-bb87-4e3f-a9da-acf484c8de15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:08.756396 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d5b74-bb87-4e3f-a9da-acf484c8de15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:08.756671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d5b74-bb87-4e3f-a9da-acf484c8de15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:08.756947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d5b74-bb87-4e3f-a9da-acf484c8de15 admin admin] PATH_INFO: `/v3/projects/33678aea131543138f59620fbb899d44/users/66cee5f2c47040efa381d39190f971af/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:08.784101 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d5b74-bb87-4e3f-a9da-acf484c8de15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33678aea131543138f59620fbb899d44, user_id=66cee5f2c47040efa381d39190f971af, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:08.786898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d5b74-bb87-4e3f-a9da-acf484c8de15 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:08.872733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:08.883264 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1076/2167] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:08 2022] POST /identity/v3/projects => generated 403 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:08.883264 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b90f3-b44d-443e-a5da-48c1555d3b34 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:08.909786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1092/2168] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:08 2022] PUT /identity/v3/projects/33678aea131543138f59620fbb899d44/users/66cee5f2c47040efa381d39190f971af/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:08.910653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d5b74-bb87-4e3f-a9da-acf484c8de15 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:08.976848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b90f3-b44d-443e-a5da-48c1555d3b34 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:08.990579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d5b74-bb87-4e3f-a9da-acf484c8de15 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:09.004632 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e817cc-395a-461e-8f5f-a1b79671a32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:09.005411 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e817cc-395a-461e-8f5f-a1b79671a32b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.005699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e817cc-395a-461e-8f5f-a1b79671a32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.005982 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e817cc-395a-461e-8f5f-a1b79671a32b admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.006872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e817cc-395a-461e-8f5f-a1b79671a32b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:09.011421 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e817cc-395a-461e-8f5f-a1b79671a32b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:09.072643 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b01ac6-fd72-491c-887f-c6d47c63bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:09.073322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b01ac6-fd72-491c-887f-c6d47c63bc06 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.073643 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b01ac6-fd72-491c-887f-c6d47c63bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.073911 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b01ac6-fd72-491c-887f-c6d47c63bc06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.074826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b01ac6-fd72-491c-887f-c6d47c63bc06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:09.075134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b01ac6-fd72-491c-887f-c6d47c63bc06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:09.076752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b01ac6-fd72-491c-887f-c6d47c63bc06 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:09.088769 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1077/2169] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:37:09.090142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84a969-f182-41ea-b746-5a75dd87c476 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.090351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84a969-f182-41ea-b746-5a75dd87c476 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.090629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84a969-f182-41ea-b746-5a75dd87c476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.117716 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0d84a969-f182-41ea-b746-5a75dd87c476 None None] MFA Rules not processed for user `66cee5f2c47040efa381d39190f971af`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:09.119676 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0d84a969-f182-41ea-b746-5a75dd87c476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:09.141983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1093/2170] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:08 2022] POST /identity/v3/users => generated 302 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:09.142829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e817cc-395a-461e-8f5f-a1b79671a32b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:09.155472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e817cc-395a-461e-8f5f-a1b79671a32b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:09.161512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4bdf8-3d3c-48f3-a106-e47ba661392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:09.162098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4bdf8-3d3c-48f3-a106-e47ba661392d admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.162382 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4bdf8-3d3c-48f3-a106-e47ba661392d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.162747 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4bdf8-3d3c-48f3-a106-e47ba661392d admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.163573 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4bdf8-3d3c-48f3-a106-e47ba661392d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:09.166098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4bdf8-3d3c-48f3-a106-e47ba661392d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:09.197009 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1078/2171] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:09.198099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84a969-f182-41ea-b746-5a75dd87c476 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:09.208699 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84a969-f182-41ea-b746-5a75dd87c476 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:09.213824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fac85-5ea9-4fbe-b506-047b7c70fbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:09.214514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fac85-5ea9-4fbe-b506-047b7c70fbed admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.214830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fac85-5ea9-4fbe-b506-047b7c70fbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.215129 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fac85-5ea9-4fbe-b506-047b7c70fbed admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.215847 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fac85-5ea9-4fbe-b506-047b7c70fbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:09.217655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fac85-5ea9-4fbe-b506-047b7c70fbed admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:09.228538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1079/2172] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:09.229348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fac85-5ea9-4fbe-b506-047b7c70fbed admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:09.239303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fac85-5ea9-4fbe-b506-047b7c70fbed admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:09.244738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe601a6b-6e69-479f-9cf9-65a34f5c4cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:09.245386 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe601a6b-6e69-479f-9cf9-65a34f5c4cac admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.245663 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe601a6b-6e69-479f-9cf9-65a34f5c4cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.245933 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe601a6b-6e69-479f-9cf9-65a34f5c4cac admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.246618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe601a6b-6e69-479f-9cf9-65a34f5c4cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:09.248623 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe601a6b-6e69-479f-9cf9-65a34f5c4cac admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:09.357930 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1094/2173] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:09 2022] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:09.357930 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4bdf8-3d3c-48f3-a106-e47ba661392d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:09.391403 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1080/2174] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:09 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:09.391403 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe601a6b-6e69-479f-9cf9-65a34f5c4cac admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:09.414626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:09.440551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4bdf8-3d3c-48f3-a106-e47ba661392d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:09.515254 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe601a6b-6e69-479f-9cf9-65a34f5c4cac admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:09.524163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba60456-faa5-4cb4-94db-a25bbd927e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:09.524815 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba60456-faa5-4cb4-94db-a25bbd927e3b admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.525107 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba60456-faa5-4cb4-94db-a25bbd927e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.525398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba60456-faa5-4cb4-94db-a25bbd927e3b admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.527019 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba60456-faa5-4cb4-94db-a25bbd927e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:09.529161 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba60456-faa5-4cb4-94db-a25bbd927e3b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:09.547251 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66d23e-d7d6-49d1-8fa4-7c55697c6bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:09.547938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66d23e-d7d6-49d1-8fa4-7c55697c6bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.548223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66d23e-d7d6-49d1-8fa4-7c55697c6bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.548499 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66d23e-d7d6-49d1-8fa4-7c55697c6bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.549240 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66d23e-d7d6-49d1-8fa4-7c55697c6bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:09.551417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66d23e-d7d6-49d1-8fa4-7c55697c6bf2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:09.569588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1095/2175] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:09.569588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66d23e-d7d6-49d1-8fa4-7c55697c6bf2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:09.579241 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66d23e-d7d6-49d1-8fa4-7c55697c6bf2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:09.586449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d383a7a-fbe2-48f4-b31f-ae84b9b8459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:09.588663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d383a7a-fbe2-48f4-b31f-ae84b9b8459a admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.589344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d383a7a-fbe2-48f4-b31f-ae84b9b8459a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.589625 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d383a7a-fbe2-48f4-b31f-ae84b9b8459a admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.590342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d383a7a-fbe2-48f4-b31f-ae84b9b8459a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:09.592528 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d383a7a-fbe2-48f4-b31f-ae84b9b8459a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:09.645722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1081/2176] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:09 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:09.647155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71aa299-3d83-4311-8cef-e770b20e5ca6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.647515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71aa299-3d83-4311-8cef-e770b20e5ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.647788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71aa299-3d83-4311-8cef-e770b20e5ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.679974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1096/2177] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:09 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:09.679974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d383a7a-fbe2-48f4-b31f-ae84b9b8459a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:09.683562 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d71aa299-3d83-4311-8cef-e770b20e5ca6 None None] MFA Rules not processed for user `9af15e811258481ba8244c596c3eef21`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:09.685007 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d71aa299-3d83-4311-8cef-e770b20e5ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:09.694606 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d383a7a-fbe2-48f4-b31f-ae84b9b8459a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:09.702763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71e494-ea56-4adc-b827-a7fd5a7012c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:09.704200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71e494-ea56-4adc-b827-a7fd5a7012c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.704693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71e494-ea56-4adc-b827-a7fd5a7012c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.704971 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71e494-ea56-4adc-b827-a7fd5a7012c7 admin admin] PATH_INFO: `/v3/projects/7792d0b4afc1449b811b1130c222615d/users/41c29b73093f438882288e9ebeb07c07/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.730488 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71e494-ea56-4adc-b827-a7fd5a7012c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7792d0b4afc1449b811b1130c222615d, user_id=41c29b73093f438882288e9ebeb07c07, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:09.739513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71e494-ea56-4adc-b827-a7fd5a7012c7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:09.777768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1082/2178] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:09.779287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71aa299-3d83-4311-8cef-e770b20e5ca6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:09.789954 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71aa299-3d83-4311-8cef-e770b20e5ca6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:09.796023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82410921-7912-4bd2-b149-4071949d255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:09.796872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82410921-7912-4bd2-b149-4071949d255d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.797204 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82410921-7912-4bd2-b149-4071949d255d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.797418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82410921-7912-4bd2-b149-4071949d255d admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.798151 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82410921-7912-4bd2-b149-4071949d255d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:09.799829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82410921-7912-4bd2-b149-4071949d255d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:09.814264 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1083/2179] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:09.815154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82410921-7912-4bd2-b149-4071949d255d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:09.835753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82410921-7912-4bd2-b149-4071949d255d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:09.839444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1097/2180] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:09 2022] PUT /identity/v3/projects/7792d0b4afc1449b811b1130c222615d/users/41c29b73093f438882288e9ebeb07c07/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:09.840874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71e494-ea56-4adc-b827-a7fd5a7012c7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:09.850705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8e71e494-ea56-4adc-b827-a7fd5a7012c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:09.900962 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5ed6d-3761-4e46-8c5c-67315d3c2cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:09.901746 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5ed6d-3761-4e46-8c5c-67315d3c2cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.902100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5ed6d-3761-4e46-8c5c-67315d3c2cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.902444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5ed6d-3761-4e46-8c5c-67315d3c2cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.903292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5ed6d-3761-4e46-8c5c-67315d3c2cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:09.905091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5ed6d-3761-4e46-8c5c-67315d3c2cfd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:09.917197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1084/2181] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:09.918254 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5ed6d-3761-4e46-8c5c-67315d3c2cfd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:09.929186 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71e494-ea56-4adc-b827-a7fd5a7012c7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:09.931128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5ed6d-3761-4e46-8c5c-67315d3c2cfd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:09.941030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3736ce1-3920-4706-8b6f-fc191129601f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:09.941389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142333a-6c18-4157-b4c0-94d625bc083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:09.942176 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142333a-6c18-4157-b4c0-94d625bc083b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.942549 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142333a-6c18-4157-b4c0-94d625bc083b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.943065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3736ce1-3920-4706-8b6f-fc191129601f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.943302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142333a-6c18-4157-b4c0-94d625bc083b admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.944129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142333a-6c18-4157-b4c0-94d625bc083b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:09.944609 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3736ce1-3920-4706-8b6f-fc191129601f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.945058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3736ce1-3920-4706-8b6f-fc191129601f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.946133 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142333a-6c18-4157-b4c0-94d625bc083b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:09.946974 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3736ce1-3920-4706-8b6f-fc191129601f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:09.949292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3736ce1-3920-4706-8b6f-fc191129601f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:09.966738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1085/2182] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:09.968361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5f2fd-2938-4797-bee9-f5a5980ac145 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:09.968654 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5f2fd-2938-4797-bee9-f5a5980ac145 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:09.968930 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5f2fd-2938-4797-bee9-f5a5980ac145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:09.998312 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5ab5f2fd-2938-4797-bee9-f5a5980ac145 None None] MFA Rules not processed for user `41c29b73093f438882288e9ebeb07c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:09.999766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5ab5f2fd-2938-4797-bee9-f5a5980ac145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:10.075415 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1086/2183] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:10.075415 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5f2fd-2938-4797-bee9-f5a5980ac145 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:10.078402 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1098/2184] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:09 2022] POST /identity/v3/projects => generated 369 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:10.079259 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142333a-6c18-4157-b4c0-94d625bc083b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:10.086311 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5f2fd-2938-4797-bee9-f5a5980ac145 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:10.152429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5efcc5-7a53-4121-98e6-f804fc72faa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:10.153249 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5efcc5-7a53-4121-98e6-f804fc72faa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:10.153528 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5efcc5-7a53-4121-98e6-f804fc72faa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:10.153801 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5efcc5-7a53-4121-98e6-f804fc72faa2 admin admin] PATH_INFO: `/v3/projects/0164326d895d4b92b72100541f0eba29/users/aa163804d53b4566a0cb03a90b548a94/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:10.154464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142333a-6c18-4157-b4c0-94d625bc083b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:10.159193 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d26e80-460a-40c1-a5f8-bc57ffaa0e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:10.160087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d26e80-460a-40c1-a5f8-bc57ffaa0e6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:10.160368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d26e80-460a-40c1-a5f8-bc57ffaa0e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:10.160644 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d26e80-460a-40c1-a5f8-bc57ffaa0e6d admin admin] PATH_INFO: `/v3/projects/aa4f46651e8b4d4c906c4b74080e3a6d/users/384846a5204f484a8e5bf2c8c85d08e3/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:10.170761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5efcc5-7a53-4121-98e6-f804fc72faa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0164326d895d4b92b72100541f0eba29, user_id=aa163804d53b4566a0cb03a90b548a94, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:10.173557 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5efcc5-7a53-4121-98e6-f804fc72faa2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:10.177845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d26e80-460a-40c1-a5f8-bc57ffaa0e6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4f46651e8b4d4c906c4b74080e3a6d, user_id=384846a5204f484a8e5bf2c8c85d08e3, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:10.180696 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d26e80-460a-40c1-a5f8-bc57ffaa0e6d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:10.284052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1087/2185] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:10 2022] PUT /identity/v3/projects/0164326d895d4b92b72100541f0eba29/users/aa163804d53b4566a0cb03a90b548a94/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:10.284748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1099/2186] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:10 2022] PUT /identity/v3/projects/aa4f46651e8b4d4c906c4b74080e3a6d/users/384846a5204f484a8e5bf2c8c85d08e3/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:10.284887 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5efcc5-7a53-4121-98e6-f804fc72faa2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:10.285802 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d26e80-460a-40c1-a5f8-bc57ffaa0e6d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:10.355607 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5efcc5-7a53-4121-98e6-f804fc72faa2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:10.359539 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d26e80-460a-40c1-a5f8-bc57ffaa0e6d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:10.360605 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a65ab-693d-45bc-a8de-47cb80b143c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:10.361283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a65ab-693d-45bc-a8de-47cb80b143c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:10.361562 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a65ab-693d-45bc-a8de-47cb80b143c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:10.361833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a65ab-693d-45bc-a8de-47cb80b143c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:10.362528 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a65ab-693d-45bc-a8de-47cb80b143c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:10.364498 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a65ab-693d-45bc-a8de-47cb80b143c7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:10.364920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504285cb-7e15-4d17-9f83-589b14044541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:10.365611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504285cb-7e15-4d17-9f83-589b14044541 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:10.365988 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504285cb-7e15-4d17-9f83-589b14044541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:10.366344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504285cb-7e15-4d17-9f83-589b14044541 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:10.367034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504285cb-7e15-4d17-9f83-589b14044541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:10.369024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504285cb-7e15-4d17-9f83-589b14044541 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:10.469022 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1088/2187] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:10 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:10.470140 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a65ab-693d-45bc-a8de-47cb80b143c7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:10.470393 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1100/2188] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:10 2022] POST /identity/v3/projects => generated 405 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:10.472528 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c57af-e912-43ff-80d5-f459b5a65de4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:10.472817 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c57af-e912-43ff-80d5-f459b5a65de4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:10.473242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c57af-e912-43ff-80d5-f459b5a65de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:10.481475 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a65ab-693d-45bc-a8de-47cb80b143c7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:10.493973 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-715c57af-e912-43ff-80d5-f459b5a65de4 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:10.495546 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-715c57af-e912-43ff-80d5-f459b5a65de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:10.544970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084edb8-de09-4099-974b-dad2648c8ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:10.545683 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084edb8-de09-4099-974b-dad2648c8ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:10.545857 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084edb8-de09-4099-974b-dad2648c8ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:10.546114 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084edb8-de09-4099-974b-dad2648c8ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:10.546883 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084edb8-de09-4099-974b-dad2648c8ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:10.548577 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084edb8-de09-4099-974b-dad2648c8ad8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:10.560706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1089/2189] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:10.561741 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084edb8-de09-4099-974b-dad2648c8ad8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:10.564966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1101/2190] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:10.565831 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c57af-e912-43ff-80d5-f459b5a65de4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:10.576149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084edb8-de09-4099-974b-dad2648c8ad8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:10.581222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f3bc3-8f7c-4832-a13e-726996c6f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:10.582042 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f3bc3-8f7c-4832-a13e-726996c6f1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:10.582423 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f3bc3-8f7c-4832-a13e-726996c6f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:10.582860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f3bc3-8f7c-4832-a13e-726996c6f1a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:10.590075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f3bc3-8f7c-4832-a13e-726996c6f1a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:10.590075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f3bc3-8f7c-4832-a13e-726996c6f1a8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:10.590272 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c57af-e912-43ff-80d5-f459b5a65de4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:10.593071 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd634d-dc44-4207-a1df-b4f935d2fb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:10.593747 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd634d-dc44-4207-a1df-b4f935d2fb17 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:10.594027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd634d-dc44-4207-a1df-b4f935d2fb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:10.594300 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd634d-dc44-4207-a1df-b4f935d2fb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:10.595102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd634d-dc44-4207-a1df-b4f935d2fb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:10.597486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd634d-dc44-4207-a1df-b4f935d2fb17 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:10.611833 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1102/2191] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:10.611833 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd634d-dc44-4207-a1df-b4f935d2fb17 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:10.621441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd634d-dc44-4207-a1df-b4f935d2fb17 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:10.627428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c85f3-9326-44fe-a9cc-fbb7a36af571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:10.628323 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c85f3-9326-44fe-a9cc-fbb7a36af571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:10.628599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c85f3-9326-44fe-a9cc-fbb7a36af571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:10.628930 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c85f3-9326-44fe-a9cc-fbb7a36af571 admin admin] PATH_INFO: `/v3/projects/0164326d895d4b92b72100541f0eba29/users/aa163804d53b4566a0cb03a90b548a94/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:10.630984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c85f3-9326-44fe-a9cc-fbb7a36af571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0164326d895d4b92b72100541f0eba29, user_id=aa163804d53b4566a0cb03a90b548a94, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:10.634540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c85f3-9326-44fe-a9cc-fbb7a36af571 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:10.647720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1103/2192] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:10 2022] PUT /identity/v3/projects/0164326d895d4b92b72100541f0eba29/users/aa163804d53b4566a0cb03a90b548a94/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:10.648465 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c85f3-9326-44fe-a9cc-fbb7a36af571 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:10.650140 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-695c85f3-9326-44fe-a9cc-fbb7a36af571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:10.701260 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1090/2193] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:10 2022] POST /identity/v3/users => generated 309 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:10.702437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f3bc3-8f7c-4832-a13e-726996c6f1a8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:10.714071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f3bc3-8f7c-4832-a13e-726996c6f1a8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:10.740703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c85f3-9326-44fe-a9cc-fbb7a36af571 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:10.744779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49655091-db6b-4481-8cc2-346b6b4cf749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:10.746547 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49655091-db6b-4481-8cc2-346b6b4cf749 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:10.746869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49655091-db6b-4481-8cc2-346b6b4cf749 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:10.747191 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49655091-db6b-4481-8cc2-346b6b4cf749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:10.788360 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54215cf3-1f84-44c6-b396-652e5e39616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:10.789589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54215cf3-1f84-44c6-b396-652e5e39616c admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:10.789975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54215cf3-1f84-44c6-b396-652e5e39616c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:10.790532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54215cf3-1f84-44c6-b396-652e5e39616c admin admin] PATH_INFO: `/v3/projects/90dab315e7d3405ea9c80933c6cde1fa/users/f04363f8a167469a946071d10a9fff62/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:10.808549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54215cf3-1f84-44c6-b396-652e5e39616c admin admin] RBAC: Authorizing `identity:create_grant(project_id=90dab315e7d3405ea9c80933c6cde1fa, user_id=f04363f8a167469a946071d10a9fff62, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:10.811480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54215cf3-1f84-44c6-b396-652e5e39616c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:10.830374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49655091-db6b-4481-8cc2-346b6b4cf749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:10.832066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49655091-db6b-4481-8cc2-346b6b4cf749 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:10.844900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1104/2194] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:10.846518 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622e919-0a03-4323-aa51-8d022f7368b3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:10.847048 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622e919-0a03-4323-aa51-8d022f7368b3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:10.847325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622e919-0a03-4323-aa51-8d022f7368b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:10.878488 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0622e919-0a03-4323-aa51-8d022f7368b3 None None] MFA Rules not processed for user `aa163804d53b4566a0cb03a90b548a94`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:10.879797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0622e919-0a03-4323-aa51-8d022f7368b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:10.955063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1105/2195] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:10.956122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622e919-0a03-4323-aa51-8d022f7368b3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:10.969615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1091/2196] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:10 2022] PUT /identity/v3/projects/90dab315e7d3405ea9c80933c6cde1fa/users/f04363f8a167469a946071d10a9fff62/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:10.970710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54215cf3-1f84-44c6-b396-652e5e39616c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:10.972564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-54215cf3-1f84-44c6-b396-652e5e39616c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:10.978033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622e919-0a03-4323-aa51-8d022f7368b3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:11.065589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54215cf3-1f84-44c6-b396-652e5e39616c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:11.071253 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3ffbd-439a-4873-a197-f03da13973ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:11.071985 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3ffbd-439a-4873-a197-f03da13973ac admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:11.072289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3ffbd-439a-4873-a197-f03da13973ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:11.072566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3ffbd-439a-4873-a197-f03da13973ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:11.073901 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3ffbd-439a-4873-a197-f03da13973ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:11.075751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c4892-4e9f-4216-9d1d-7fc3d459b221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:11.076035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3ffbd-439a-4873-a197-f03da13973ac admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:11.076424 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c4892-4e9f-4216-9d1d-7fc3d459b221 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:11.076740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c4892-4e9f-4216-9d1d-7fc3d459b221 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:11.077036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c4892-4e9f-4216-9d1d-7fc3d459b221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:11.080258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-004c4892-4e9f-4216-9d1d-7fc3d459b221 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:11.088789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1106/2197] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:11.090051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3ffbd-439a-4873-a197-f03da13973ac admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:11.101534 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3ffbd-439a-4873-a197-f03da13973ac admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:11.107110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac7827-4d52-45d2-b3c1-867772560bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:11.107791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac7827-4d52-45d2-b3c1-867772560bdb admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:11.108074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac7827-4d52-45d2-b3c1-867772560bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:11.108348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac7827-4d52-45d2-b3c1-867772560bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:11.109084 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac7827-4d52-45d2-b3c1-867772560bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:11.111316 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac7827-4d52-45d2-b3c1-867772560bdb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:11.125947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1107/2198] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:11.125947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac7827-4d52-45d2-b3c1-867772560bdb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:11.139406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac7827-4d52-45d2-b3c1-867772560bdb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:11.158936 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5b616-4a3e-4adc-927f-2559872bcf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:11.159855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5b616-4a3e-4adc-927f-2559872bcf4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:11.160133 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5b616-4a3e-4adc-927f-2559872bcf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:11.160403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5b616-4a3e-4adc-927f-2559872bcf4c admin admin] PATH_INFO: `/v3/projects/4ec1540faeda44b79666091d9db1e45c/users/cd5b5583d4044b20beb2030373f2efc8/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:11.178955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5b616-4a3e-4adc-927f-2559872bcf4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec1540faeda44b79666091d9db1e45c, user_id=cd5b5583d4044b20beb2030373f2efc8, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:11.181975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5b616-4a3e-4adc-927f-2559872bcf4c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:11.188871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c4892-4e9f-4216-9d1d-7fc3d459b221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:11.191722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c4892-4e9f-4216-9d1d-7fc3d459b221 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:11.210029 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1092/2199] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:11.212385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c4892-4e9f-4216-9d1d-7fc3d459b221 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:11.227062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c4892-4e9f-4216-9d1d-7fc3d459b221 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:11.233173 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0cc45-a4ed-43f1-85d7-7976a3529399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:11.234108 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0cc45-a4ed-43f1-85d7-7976a3529399 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:11.234388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0cc45-a4ed-43f1-85d7-7976a3529399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:11.234662 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0cc45-a4ed-43f1-85d7-7976a3529399 admin admin] PATH_INFO: `/v3/projects/90dab315e7d3405ea9c80933c6cde1fa/users/f04363f8a167469a946071d10a9fff62/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:11.236807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0cc45-a4ed-43f1-85d7-7976a3529399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90dab315e7d3405ea9c80933c6cde1fa, user_id=f04363f8a167469a946071d10a9fff62, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:11.242251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0cc45-a4ed-43f1-85d7-7976a3529399 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:11.256514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1093/2200] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:11 2022] PUT /identity/v3/projects/90dab315e7d3405ea9c80933c6cde1fa/users/f04363f8a167469a946071d10a9fff62/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:11.308799 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1108/2201] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:11 2022] PUT /identity/v3/projects/4ec1540faeda44b79666091d9db1e45c/users/cd5b5583d4044b20beb2030373f2efc8/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:11.313196 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0cc45-a4ed-43f1-85d7-7976a3529399 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:11.468828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0cc45-a4ed-43f1-85d7-7976a3529399 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:11.538059 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559c8a3-8b08-494e-8d74-91432b1b7da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:11.538773 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559c8a3-8b08-494e-8d74-91432b1b7da6 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:11.539057 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559c8a3-8b08-494e-8d74-91432b1b7da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:11.539333 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559c8a3-8b08-494e-8d74-91432b1b7da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:11.544277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559c8a3-8b08-494e-8d74-91432b1b7da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:11.544277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559c8a3-8b08-494e-8d74-91432b1b7da6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:11.555736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1094/2202] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:11.560888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5b616-4a3e-4adc-927f-2559872bcf4c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:11.580216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5b616-4a3e-4adc-927f-2559872bcf4c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:11.585489 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad622f7c-8b9e-4175-ad75-994b80bcfa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:11.586396 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad622f7c-8b9e-4175-ad75-994b80bcfa24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:11.586695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad622f7c-8b9e-4175-ad75-994b80bcfa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:11.586978 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad622f7c-8b9e-4175-ad75-994b80bcfa24 admin admin] PATH_INFO: `/v3/projects/4ec1540faeda44b79666091d9db1e45c/users/cd5b5583d4044b20beb2030373f2efc8/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:11.589725 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad622f7c-8b9e-4175-ad75-994b80bcfa24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec1540faeda44b79666091d9db1e45c, user_id=cd5b5583d4044b20beb2030373f2efc8, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:11.592944 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad622f7c-8b9e-4175-ad75-994b80bcfa24 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:11.604260 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1109/2203] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:11 2022] PUT /identity/v3/projects/4ec1540faeda44b79666091d9db1e45c/users/cd5b5583d4044b20beb2030373f2efc8/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:11.615491 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce99bd4-7450-491e-88b9-ca2652f28fba None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:11.615741 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce99bd4-7450-491e-88b9-ca2652f28fba None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:11.616014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce99bd4-7450-491e-88b9-ca2652f28fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:11.652867 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bce99bd4-7450-491e-88b9-ca2652f28fba None None] MFA Rules not processed for user `cd5b5583d4044b20beb2030373f2efc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:11.654281 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bce99bd4-7450-491e-88b9-ca2652f28fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:11.742546 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1095/2204] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:11.754387 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad622f7c-8b9e-4175-ad75-994b80bcfa24 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:11.756539 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ad622f7c-8b9e-4175-ad75-994b80bcfa24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:11.857685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad622f7c-8b9e-4175-ad75-994b80bcfa24 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:11.865261 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0c754-b5a9-4217-b1ec-229b999c64c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:11.866030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0c754-b5a9-4217-b1ec-229b999c64c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:11.867290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0c754-b5a9-4217-b1ec-229b999c64c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:11.867698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0c754-b5a9-4217-b1ec-229b999c64c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:11.882263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0c754-b5a9-4217-b1ec-229b999c64c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:11.883359 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0c754-b5a9-4217-b1ec-229b999c64c7 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:11.895547 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1110/2205] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:11 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:12.079929 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce99bd4-7450-491e-88b9-ca2652f28fba None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:12.177033 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce99bd4-7450-491e-88b9-ca2652f28fba None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:12.182706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73c560-1d0f-4b16-948c-4090b004cd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:12.183822 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73c560-1d0f-4b16-948c-4090b004cd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:12.184448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73c560-1d0f-4b16-948c-4090b004cd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:12.184868 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73c560-1d0f-4b16-948c-4090b004cd7b admin admin] PATH_INFO: `/v3/users/41c29b73093f438882288e9ebeb07c07` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:12.186855 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73c560-1d0f-4b16-948c-4090b004cd7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c29b73093f438882288e9ebeb07c07)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:12.189766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73c560-1d0f-4b16-948c-4090b004cd7b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:12.257514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:12.545531 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9e73c560-1d0f-4b16-948c-4090b004cd7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c29b73093f438882288e9ebeb07c07'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:12.628202 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9e73c560-1d0f-4b16-948c-4090b004cd7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c29b73093f438882288e9ebeb07c07'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:12.639189 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9e73c560-1d0f-4b16-948c-4090b004cd7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c29b73093f438882288e9ebeb07c07'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:12.654987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9e73c560-1d0f-4b16-948c-4090b004cd7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c29b73093f438882288e9ebeb07c07'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:12.655823 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9e73c560-1d0f-4b16-948c-4090b004cd7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c29b73093f438882288e9ebeb07c07'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:12.664327 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1096/2206] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:12 2022] DELETE /identity/v3/users/41c29b73093f438882288e9ebeb07c07 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:12.669570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05634821-a2f4-45dc-8042-0f8976f21309 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:12.670128 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05634821-a2f4-45dc-8042-0f8976f21309 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:12.670128 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05634821-a2f4-45dc-8042-0f8976f21309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:12.688855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-05634821-a2f4-45dc-8042-0f8976f21309 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:12.690072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-05634821-a2f4-45dc-8042-0f8976f21309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:12.765171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1111/2207] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:12.803816 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73c560-1d0f-4b16-948c-4090b004cd7b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:12.805598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9e73c560-1d0f-4b16-948c-4090b004cd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:12.817049 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:12.903680 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73c560-1d0f-4b16-948c-4090b004cd7b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:12.908680 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d95ef8-7981-4873-ae67-1a87935c3b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:12.909367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d95ef8-7981-4873-ae67-1a87935c3b15 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:12.909643 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d95ef8-7981-4873-ae67-1a87935c3b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:12.909924 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d95ef8-7981-4873-ae67-1a87935c3b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:12.939622 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d95ef8-7981-4873-ae67-1a87935c3b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:12.939622 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d95ef8-7981-4873-ae67-1a87935c3b15 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:12.957217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1097/2208] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:13.291506 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254d10a-9c3e-4525-a32d-7b9e202a5622 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:13.292060 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254d10a-9c3e-4525-a32d-7b9e202a5622 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:13.292574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254d10a-9c3e-4525-a32d-7b9e202a5622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:13.325689 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2254d10a-9c3e-4525-a32d-7b9e202a5622 None None] MFA Rules not processed for user `f04363f8a167469a946071d10a9fff62`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:13.327491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2254d10a-9c3e-4525-a32d-7b9e202a5622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:13.474329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1112/2209] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:13.476380 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca2736-f0cd-4938-a6c8-d6a7572b726c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:13.476671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca2736-f0cd-4938-a6c8-d6a7572b726c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:13.476943 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca2736-f0cd-4938-a6c8-d6a7572b726c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:13.510551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-25ca2736-f0cd-4938-a6c8-d6a7572b726c None None] MFA Rules not processed for user `9af15e811258481ba8244c596c3eef21`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:13.512624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-25ca2736-f0cd-4938-a6c8-d6a7572b726c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:13.610466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1098/2210] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:13.623171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254d10a-9c3e-4525-a32d-7b9e202a5622 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:13.624723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2254d10a-9c3e-4525-a32d-7b9e202a5622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:13.698485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca2736-f0cd-4938-a6c8-d6a7572b726c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:13.700336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-25ca2736-f0cd-4938-a6c8-d6a7572b726c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:13.727576 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca2736-f0cd-4938-a6c8-d6a7572b726c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:13.728201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254d10a-9c3e-4525-a32d-7b9e202a5622 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:13.736597 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00184c20-1975-4751-b89f-b1c42ab6aa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:13.737854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00184c20-1975-4751-b89f-b1c42ab6aa80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:13.738535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00184c20-1975-4751-b89f-b1c42ab6aa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:13.739053 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00184c20-1975-4751-b89f-b1c42ab6aa80 admin admin] PATH_INFO: `/v3/projects/7792d0b4afc1449b811b1130c222615d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:13.740837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00184c20-1975-4751-b89f-b1c42ab6aa80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7792d0b4afc1449b811b1130c222615d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:13.743603 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00184c20-1975-4751-b89f-b1c42ab6aa80 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:13.761690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d46cac-0050-4ba1-acf0-a36ce1df6831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:13.762034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d46cac-0050-4ba1-acf0-a36ce1df6831 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:13.762322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d46cac-0050-4ba1-acf0-a36ce1df6831 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:13.762645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d46cac-0050-4ba1-acf0-a36ce1df6831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:13.767548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b9d46cac-0050-4ba1-acf0-a36ce1df6831 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:13.795885 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d46cac-0050-4ba1-acf0-a36ce1df6831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:13.797817 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d46cac-0050-4ba1-acf0-a36ce1df6831 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:13.810574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1113/2211] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:37:13.943843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-00184c20-1975-4751-b89f-b1c42ab6aa80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7792d0b4afc1449b811b1130c222615d', 'request_id': 'req-00184c20-1975-4751-b89f-b1c42ab6aa80'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:13.962312 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-00184c20-1975-4751-b89f-b1c42ab6aa80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7792d0b4afc1449b811b1130c222615d', 'request_id': 'req-00184c20-1975-4751-b89f-b1c42ab6aa80'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:14.062783 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-00184c20-1975-4751-b89f-b1c42ab6aa80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7792d0b4afc1449b811b1130c222615d', 'request_id': 'req-00184c20-1975-4751-b89f-b1c42ab6aa80'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:14.083381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-00184c20-1975-4751-b89f-b1c42ab6aa80 admin admin] The token cache is being invalidate because project 7792d0b4afc1449b811b1130c222615d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:14.083902 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-00184c20-1975-4751-b89f-b1c42ab6aa80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:14.084682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-00184c20-1975-4751-b89f-b1c42ab6aa80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:14.088441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1099/2212] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:13 2022] DELETE /identity/v3/projects/7792d0b4afc1449b811b1130c222615d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:14.092361 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d46cac-0050-4ba1-acf0-a36ce1df6831 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:14.103506 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d46cac-0050-4ba1-acf0-a36ce1df6831 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:14.169114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91614def-2397-4aa3-a6ca-dfeb5a2065ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:14.170272 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91614def-2397-4aa3-a6ca-dfeb5a2065ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:14.170511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91614def-2397-4aa3-a6ca-dfeb5a2065ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:14.170784 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91614def-2397-4aa3-a6ca-dfeb5a2065ed admin admin] PATH_INFO: `/v3/users/cd5b5583d4044b20beb2030373f2efc8` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:14.172038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91614def-2397-4aa3-a6ca-dfeb5a2065ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd5b5583d4044b20beb2030373f2efc8)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:14.174142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91614def-2397-4aa3-a6ca-dfeb5a2065ed admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:14.429058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-91614def-2397-4aa3-a6ca-dfeb5a2065ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd5b5583d4044b20beb2030373f2efc8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:14.560859 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-91614def-2397-4aa3-a6ca-dfeb5a2065ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd5b5583d4044b20beb2030373f2efc8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:14.561631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-91614def-2397-4aa3-a6ca-dfeb5a2065ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd5b5583d4044b20beb2030373f2efc8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:14.587155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-91614def-2397-4aa3-a6ca-dfeb5a2065ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd5b5583d4044b20beb2030373f2efc8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:14.603362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-91614def-2397-4aa3-a6ca-dfeb5a2065ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd5b5583d4044b20beb2030373f2efc8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:14.611601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1114/2213] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:14 2022] DELETE /identity/v3/users/cd5b5583d4044b20beb2030373f2efc8 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:14.840526 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00184c20-1975-4751-b89f-b1c42ab6aa80 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:14.842074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-00184c20-1975-4751-b89f-b1c42ab6aa80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:14.940978 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00184c20-1975-4751-b89f-b1c42ab6aa80 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:15.024453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbb6d2-44ac-4cd3-b030-1593925b1e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:15.025324 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbb6d2-44ac-4cd3-b030-1593925b1e11 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:15.025757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbb6d2-44ac-4cd3-b030-1593925b1e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:15.026233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbb6d2-44ac-4cd3-b030-1593925b1e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:15.028985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c6dbb6d2-44ac-4cd3-b030-1593925b1e11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:15.100484 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbb6d2-44ac-4cd3-b030-1593925b1e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:15.102114 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbb6d2-44ac-4cd3-b030-1593925b1e11 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:15.113621 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1100/2214] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:15.279032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91614def-2397-4aa3-a6ca-dfeb5a2065ed admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:15.289275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-91614def-2397-4aa3-a6ca-dfeb5a2065ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:15.392447 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91614def-2397-4aa3-a6ca-dfeb5a2065ed admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:15.399189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa01d3-b074-467c-b5a2-e312f2e5931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:15.400231 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa01d3-b074-467c-b5a2-e312f2e5931f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:15.400616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa01d3-b074-467c-b5a2-e312f2e5931f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:15.400989 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa01d3-b074-467c-b5a2-e312f2e5931f admin admin] PATH_INFO: `/v3/projects/4ec1540faeda44b79666091d9db1e45c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:15.402463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa01d3-b074-467c-b5a2-e312f2e5931f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec1540faeda44b79666091d9db1e45c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:15.404852 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa01d3-b074-467c-b5a2-e312f2e5931f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:15.452674 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:15.573220 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3faa01d3-b074-467c-b5a2-e312f2e5931f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec1540faeda44b79666091d9db1e45c', 'request_id': 'req-3faa01d3-b074-467c-b5a2-e312f2e5931f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:15.653214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3faa01d3-b074-467c-b5a2-e312f2e5931f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec1540faeda44b79666091d9db1e45c', 'request_id': 'req-3faa01d3-b074-467c-b5a2-e312f2e5931f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:15.661019 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3faa01d3-b074-467c-b5a2-e312f2e5931f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec1540faeda44b79666091d9db1e45c', 'request_id': 'req-3faa01d3-b074-467c-b5a2-e312f2e5931f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:15.683960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3faa01d3-b074-467c-b5a2-e312f2e5931f admin admin] The token cache is being invalidate because project 4ec1540faeda44b79666091d9db1e45c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:15.684987 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3faa01d3-b074-467c-b5a2-e312f2e5931f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:15.686915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3faa01d3-b074-467c-b5a2-e312f2e5931f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:15.688999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1115/2215] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:15 2022] DELETE /identity/v3/projects/4ec1540faeda44b79666091d9db1e45c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:15.694561 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cee271-c72f-4455-9124-ca68e81ab470 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:15.695398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cee271-c72f-4455-9124-ca68e81ab470 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:15.695855 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cee271-c72f-4455-9124-ca68e81ab470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:15.725684 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-51cee271-c72f-4455-9124-ca68e81ab470 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:15.727918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-51cee271-c72f-4455-9124-ca68e81ab470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:15.760716 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:15.845861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1101/2216] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:15.869968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92bf3f-c7ea-4f24-8ea6-3c2fe2c0e29a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:15.869968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92bf3f-c7ea-4f24-8ea6-3c2fe2c0e29a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:15.869968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92bf3f-c7ea-4f24-8ea6-3c2fe2c0e29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:15.927681 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2f92bf3f-c7ea-4f24-8ea6-3c2fe2c0e29a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:15.929174 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2f92bf3f-c7ea-4f24-8ea6-3c2fe2c0e29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:15.945758 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1116/2217] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:15.952027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cee271-c72f-4455-9124-ca68e81ab470 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:15.964899 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cee271-c72f-4455-9124-ca68e81ab470 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:15.972294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11506d94-4f5e-4761-a21a-52834e20fb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:15.973182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11506d94-4f5e-4761-a21a-52834e20fb0a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:15.973586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11506d94-4f5e-4761-a21a-52834e20fb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:15.973939 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11506d94-4f5e-4761-a21a-52834e20fb0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:15.974885 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11506d94-4f5e-4761-a21a-52834e20fb0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:15.975535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11506d94-4f5e-4761-a21a-52834e20fb0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:15.977342 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11506d94-4f5e-4761-a21a-52834e20fb0a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:15.998016 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1102/2218] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:37:16.004105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92bf3f-c7ea-4f24-8ea6-3c2fe2c0e29a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:16.017303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92bf3f-c7ea-4f24-8ea6-3c2fe2c0e29a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:16.024547 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de68d8-77bb-46fd-b8c2-a66f30aa2fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:16.026179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de68d8-77bb-46fd-b8c2-a66f30aa2fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:16.026502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de68d8-77bb-46fd-b8c2-a66f30aa2fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:16.026883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de68d8-77bb-46fd-b8c2-a66f30aa2fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:16.027761 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de68d8-77bb-46fd-b8c2-a66f30aa2fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:16.031035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de68d8-77bb-46fd-b8c2-a66f30aa2fd9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:16.164045 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1117/2219] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:16 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:16.169951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11506d94-4f5e-4761-a21a-52834e20fb0a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:16.183596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11506d94-4f5e-4761-a21a-52834e20fb0a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:16.280246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e813ec3-a8d1-42d4-b3aa-fbf1e4dff6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:16.280940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e813ec3-a8d1-42d4-b3aa-fbf1e4dff6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:16.281493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e813ec3-a8d1-42d4-b3aa-fbf1e4dff6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:16.281924 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e813ec3-a8d1-42d4-b3aa-fbf1e4dff6e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:16.283397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e813ec3-a8d1-42d4-b3aa-fbf1e4dff6e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:16.285637 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e813ec3-a8d1-42d4-b3aa-fbf1e4dff6e6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:16.404923 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1103/2220] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:16 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:16.408995 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de68d8-77bb-46fd-b8c2-a66f30aa2fd9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:16.421594 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de68d8-77bb-46fd-b8c2-a66f30aa2fd9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:16.428617 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8566da-8383-4097-9bd0-15292245d04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:16.429450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8566da-8383-4097-9bd0-15292245d04e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:16.429838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8566da-8383-4097-9bd0-15292245d04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:16.430220 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8566da-8383-4097-9bd0-15292245d04e admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:16.431119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8566da-8383-4097-9bd0-15292245d04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:16.432840 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8566da-8383-4097-9bd0-15292245d04e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:16.453682 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1118/2221] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:16.458068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e813ec3-a8d1-42d4-b3aa-fbf1e4dff6e6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:16.480142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e813ec3-a8d1-42d4-b3aa-fbf1e4dff6e6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:16.492884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08675d-fd59-47ef-a2ea-ce26ff737c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:16.493968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08675d-fd59-47ef-a2ea-ce26ff737c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:16.494440 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08675d-fd59-47ef-a2ea-ce26ff737c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:16.495014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08675d-fd59-47ef-a2ea-ce26ff737c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:16.495964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08675d-fd59-47ef-a2ea-ce26ff737c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:16.499904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08675d-fd59-47ef-a2ea-ce26ff737c41 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:16.531773 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1104/2222] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:16.532470 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8566da-8383-4097-9bd0-15292245d04e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:16.544077 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8566da-8383-4097-9bd0-15292245d04e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:16.556870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47ad7d-c885-4a3a-b0f0-0c1e82d993e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:16.558032 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47ad7d-c885-4a3a-b0f0-0c1e82d993e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:16.558536 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47ad7d-c885-4a3a-b0f0-0c1e82d993e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:16.559385 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47ad7d-c885-4a3a-b0f0-0c1e82d993e5 admin admin] PATH_INFO: `/v3/projects/6fb435b3ec2e4b1995325a4e23b489d5/users/3da8db4043a642ac8bfcf01e7c0a6d3b/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:16.596969 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47ad7d-c885-4a3a-b0f0-0c1e82d993e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb435b3ec2e4b1995325a4e23b489d5, user_id=3da8db4043a642ac8bfcf01e7c0a6d3b, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:16.601567 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47ad7d-c885-4a3a-b0f0-0c1e82d993e5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:16.737375 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a7e0f-a1e3-4ad5-a723-50ddd582ae73 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:16.737930 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a7e0f-a1e3-4ad5-a723-50ddd582ae73 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:16.738404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a7e0f-a1e3-4ad5-a723-50ddd582ae73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:16.740063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1119/2223] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:16 2022] PUT /identity/v3/projects/6fb435b3ec2e4b1995325a4e23b489d5/users/3da8db4043a642ac8bfcf01e7c0a6d3b/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:16.783357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2c9a7e0f-a1e3-4ad5-a723-50ddd582ae73 None None] MFA Rules not processed for user `3da8db4043a642ac8bfcf01e7c0a6d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:16.784599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2c9a7e0f-a1e3-4ad5-a723-50ddd582ae73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:16.877645 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1105/2224] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:16.882134 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47ad7d-c885-4a3a-b0f0-0c1e82d993e5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:16.925584 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a7e0f-a1e3-4ad5-a723-50ddd582ae73 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:16.925584 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2c9a7e0f-a1e3-4ad5-a723-50ddd582ae73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:16.975300 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:17.021983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47ad7d-c885-4a3a-b0f0-0c1e82d993e5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:17.030494 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea288e-20d4-4b0d-812a-14400bf1c7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:17.031022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea288e-20d4-4b0d-812a-14400bf1c7dc admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:17.031307 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea288e-20d4-4b0d-812a-14400bf1c7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:17.031714 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea288e-20d4-4b0d-812a-14400bf1c7dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:17.033699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea288e-20d4-4b0d-812a-14400bf1c7dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:17.035618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea288e-20d4-4b0d-812a-14400bf1c7dc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:17.094087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a7e0f-a1e3-4ad5-a723-50ddd582ae73 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:17.097770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1942c3f-f473-48c6-9791-7ad2a99af198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:17.100275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1942c3f-f473-48c6-9791-7ad2a99af198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:17.100651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1942c3f-f473-48c6-9791-7ad2a99af198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:17.101542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1942c3f-f473-48c6-9791-7ad2a99af198 admin admin] PATH_INFO: `/v3/users/e5350dcf2ca6449bacc8441d31e6d24c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:17.103436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1942c3f-f473-48c6-9791-7ad2a99af198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5350dcf2ca6449bacc8441d31e6d24c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:17.106006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1942c3f-f473-48c6-9791-7ad2a99af198 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:17.173037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1120/2225] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:16 2022] POST /identity/v3/projects => generated 371 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:37:17.174198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea288e-20d4-4b0d-812a-14400bf1c7dc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:17.176019 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4cea288e-20d4-4b0d-812a-14400bf1c7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:17.249095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea288e-20d4-4b0d-812a-14400bf1c7dc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:17.254479 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4c290-8a6b-4605-9cde-bb1b417fb232 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:17.254869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4c290-8a6b-4605-9cde-bb1b417fb232 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:17.255158 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4c290-8a6b-4605-9cde-bb1b417fb232 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:17.255420 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4c290-8a6b-4605-9cde-bb1b417fb232 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:17.257377 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-aff4c290-8a6b-4605-9cde-bb1b417fb232 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:17.329097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4c290-8a6b-4605-9cde-bb1b417fb232 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:17.330644 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4c290-8a6b-4605-9cde-bb1b417fb232 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:17.342135 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1121/2226] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:17.343684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4c290-8a6b-4605-9cde-bb1b417fb232 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:17.412140 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4c290-8a6b-4605-9cde-bb1b417fb232 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:17.417035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7f951-c837-44e5-a219-0d687c8656e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:17.417706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7f951-c837-44e5-a219-0d687c8656e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:17.418065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7f951-c837-44e5-a219-0d687c8656e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:17.418290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7f951-c837-44e5-a219-0d687c8656e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:17.419566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7f951-c837-44e5-a219-0d687c8656e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:17.421518 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7f951-c837-44e5-a219-0d687c8656e9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:17.461878 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d1942c3f-f473-48c6-9791-7ad2a99af198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5350dcf2ca6449bacc8441d31e6d24c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:17.535535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d1942c3f-f473-48c6-9791-7ad2a99af198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5350dcf2ca6449bacc8441d31e6d24c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:17.535747 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:17.542618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1122/2227] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:17 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:17.547300 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7f951-c837-44e5-a219-0d687c8656e9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:17.557692 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7f951-c837-44e5-a219-0d687c8656e9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:17.565195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1dce4-2e95-4052-b552-98ac3109e4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:17.565969 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1dce4-2e95-4052-b552-98ac3109e4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:17.566513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1dce4-2e95-4052-b552-98ac3109e4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:17.566713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1dce4-2e95-4052-b552-98ac3109e4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:17.567871 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1dce4-2e95-4052-b552-98ac3109e4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:17.570143 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d1942c3f-f473-48c6-9791-7ad2a99af198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5350dcf2ca6449bacc8441d31e6d24c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:17.571429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1dce4-2e95-4052-b552-98ac3109e4f3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:17.605719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1123/2228] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:37:17.605719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1dce4-2e95-4052-b552-98ac3109e4f3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:17.605957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d1942c3f-f473-48c6-9791-7ad2a99af198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5350dcf2ca6449bacc8441d31e6d24c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:17.605957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d1942c3f-f473-48c6-9791-7ad2a99af198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5350dcf2ca6449bacc8441d31e6d24c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:17.608630 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1dce4-2e95-4052-b552-98ac3109e4f3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:17.613251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1106/2229] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:16 2022] DELETE /identity/v3/users/e5350dcf2ca6449bacc8441d31e6d24c => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:17.613865 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bcd46-b6c3-44c7-80da-3da70ebb4add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:17.614795 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bcd46-b6c3-44c7-80da-3da70ebb4add admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:17.615234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bcd46-b6c3-44c7-80da-3da70ebb4add admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:17.615515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bcd46-b6c3-44c7-80da-3da70ebb4add admin admin] PATH_INFO: `/v3/projects/5e88e2073c39447aa4e6b695b70b7d20/users/1b14a04af1614da386932835f1af08c3/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:17.620444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a0d1d-5f4f-4494-b66e-4b42398fc5fb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:17.620871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a0d1d-5f4f-4494-b66e-4b42398fc5fb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:17.621264 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a0d1d-5f4f-4494-b66e-4b42398fc5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:17.634286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bcd46-b6c3-44c7-80da-3da70ebb4add admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e88e2073c39447aa4e6b695b70b7d20, user_id=1b14a04af1614da386932835f1af08c3, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:17.637291 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bcd46-b6c3-44c7-80da-3da70ebb4add admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:17.640655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-889a0d1d-5f4f-4494-b66e-4b42398fc5fb None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:17.642003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-889a0d1d-5f4f-4494-b66e-4b42398fc5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:17.705403 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1107/2230] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:17.716596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a0d1d-5f4f-4494-b66e-4b42398fc5fb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:17.718143 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-889a0d1d-5f4f-4494-b66e-4b42398fc5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:17.755320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1124/2231] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:17 2022] PUT /identity/v3/projects/5e88e2073c39447aa4e6b695b70b7d20/users/1b14a04af1614da386932835f1af08c3/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:17.757464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bcd46-b6c3-44c7-80da-3da70ebb4add admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:17.759446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a72bcd46-b6c3-44c7-80da-3da70ebb4add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:17.790092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a0d1d-5f4f-4494-b66e-4b42398fc5fb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:17.848290 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463c435-e586-424e-ac62-cb26ddc75241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:17.849182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463c435-e586-424e-ac62-cb26ddc75241 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:17.849562 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463c435-e586-424e-ac62-cb26ddc75241 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:17.849941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463c435-e586-424e-ac62-cb26ddc75241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:17.864478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bcd46-b6c3-44c7-80da-3da70ebb4add admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:17.871942 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7ff2f-8bbe-42ca-8e9a-2c4c9ff438ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:17.873556 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7ff2f-8bbe-42ca-8e9a-2c4c9ff438ea admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:17.874145 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7ff2f-8bbe-42ca-8e9a-2c4c9ff438ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:17.884067 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7ff2f-8bbe-42ca-8e9a-2c4c9ff438ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:17.884067 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7ff2f-8bbe-42ca-8e9a-2c4c9ff438ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:17.884067 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7ff2f-8bbe-42ca-8e9a-2c4c9ff438ea admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:17.901179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1125/2232] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:37:17.902322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7ff2f-8bbe-42ca-8e9a-2c4c9ff438ea admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:17.916072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7ff2f-8bbe-42ca-8e9a-2c4c9ff438ea admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:17.922703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b41811-ec56-4055-bfe6-2a8eb6fb4069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:17.923828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b41811-ec56-4055-bfe6-2a8eb6fb4069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:17.924256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b41811-ec56-4055-bfe6-2a8eb6fb4069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:17.924672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b41811-ec56-4055-bfe6-2a8eb6fb4069 admin admin] PATH_INFO: `/v3/projects/5e88e2073c39447aa4e6b695b70b7d20/users/1b14a04af1614da386932835f1af08c3/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:17.927345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b41811-ec56-4055-bfe6-2a8eb6fb4069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e88e2073c39447aa4e6b695b70b7d20, user_id=1b14a04af1614da386932835f1af08c3, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:17.930199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b41811-ec56-4055-bfe6-2a8eb6fb4069 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:17.930881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463c435-e586-424e-ac62-cb26ddc75241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:17.932474 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463c435-e586-424e-ac62-cb26ddc75241 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:17.947504 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1108/2233] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:17.965056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1126/2234] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:17 2022] PUT /identity/v3/projects/5e88e2073c39447aa4e6b695b70b7d20/users/1b14a04af1614da386932835f1af08c3/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:17.966184 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4bcd8-944c-407a-b04c-e6d6067814b5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:17.966625 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4bcd8-944c-407a-b04c-e6d6067814b5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:17.967003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4bcd8-944c-407a-b04c-e6d6067814b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:18.002946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-fad4bcd8-944c-407a-b04c-e6d6067814b5 None None] MFA Rules not processed for user `1b14a04af1614da386932835f1af08c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:18.004570 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fad4bcd8-944c-407a-b04c-e6d6067814b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:18.094572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1109/2235] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:18.105918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b41811-ec56-4055-bfe6-2a8eb6fb4069 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:18.108069 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-15b41811-ec56-4055-bfe6-2a8eb6fb4069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:18.198573 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b41811-ec56-4055-bfe6-2a8eb6fb4069 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:18.204281 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a14696-9743-4dd6-af69-fcbf9d54cf42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:18.205079 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a14696-9743-4dd6-af69-fcbf9d54cf42 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:18.205459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a14696-9743-4dd6-af69-fcbf9d54cf42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:18.206592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a14696-9743-4dd6-af69-fcbf9d54cf42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:18.217552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a14696-9743-4dd6-af69-fcbf9d54cf42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:18.228362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a14696-9743-4dd6-af69-fcbf9d54cf42 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:18.232702 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1127/2236] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:37:18.441766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:18.597382 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4bcd8-944c-407a-b04c-e6d6067814b5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:18.610066 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4bcd8-944c-407a-b04c-e6d6067814b5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:18.615648 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d239aa-151d-4e67-816f-5e25761d5dc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:18.616634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d239aa-151d-4e67-816f-5e25761d5dc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:18.617933 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d239aa-151d-4e67-816f-5e25761d5dc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:18.617933 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d239aa-151d-4e67-816f-5e25761d5dc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:18.620423 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-81d239aa-151d-4e67-816f-5e25761d5dc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:18.734802 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d239aa-151d-4e67-816f-5e25761d5dc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:18.739259 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d239aa-151d-4e67-816f-5e25761d5dc9 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:18.762958 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1110/2237] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:37:18.850554 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a14696-9743-4dd6-af69-fcbf9d54cf42 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:18.851789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e6a14696-9743-4dd6-af69-fcbf9d54cf42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:18.955955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a14696-9743-4dd6-af69-fcbf9d54cf42 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:18.961212 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bfccc-c567-4ea0-abb6-f894cf5ee25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:18.962345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bfccc-c567-4ea0-abb6-f894cf5ee25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:18.962638 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bfccc-c567-4ea0-abb6-f894cf5ee25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:18.963710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bfccc-c567-4ea0-abb6-f894cf5ee25b admin admin] PATH_INFO: `/v3/projects/aa1d7cf044544c2e8c4ba4139d22348d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:18.964276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bfccc-c567-4ea0-abb6-f894cf5ee25b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1d7cf044544c2e8c4ba4139d22348d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:18.966308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bfccc-c567-4ea0-abb6-f894cf5ee25b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:19.142596 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-890bfccc-c567-4ea0-abb6-f894cf5ee25b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1d7cf044544c2e8c4ba4139d22348d', 'request_id': 'req-890bfccc-c567-4ea0-abb6-f894cf5ee25b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:19.341135 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-890bfccc-c567-4ea0-abb6-f894cf5ee25b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1d7cf044544c2e8c4ba4139d22348d', 'request_id': 'req-890bfccc-c567-4ea0-abb6-f894cf5ee25b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:19.351046 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-890bfccc-c567-4ea0-abb6-f894cf5ee25b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1d7cf044544c2e8c4ba4139d22348d', 'request_id': 'req-890bfccc-c567-4ea0-abb6-f894cf5ee25b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:19.365789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-890bfccc-c567-4ea0-abb6-f894cf5ee25b admin admin] The token cache is being invalidate because project aa1d7cf044544c2e8c4ba4139d22348d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:19.366081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-890bfccc-c567-4ea0-abb6-f894cf5ee25b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:19.366794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-890bfccc-c567-4ea0-abb6-f894cf5ee25b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:19.368623 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1128/2238] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:18 2022] DELETE /identity/v3/projects/aa1d7cf044544c2e8c4ba4139d22348d => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:19.374348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ca508-d3c1-4562-8b52-e501ccc6657a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:19.375036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ca508-d3c1-4562-8b52-e501ccc6657a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:19.380344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ca508-d3c1-4562-8b52-e501ccc6657a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:19.403323 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5e1ca508-d3c1-4562-8b52-e501ccc6657a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:19.404970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5e1ca508-d3c1-4562-8b52-e501ccc6657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:19.519883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036faeb-f32e-46ea-a3c0-d85db5076832 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:19.520596 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036faeb-f32e-46ea-a3c0-d85db5076832 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:19.520596 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036faeb-f32e-46ea-a3c0-d85db5076832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:19.526312 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1111/2239] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:19.534258 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:19.556911 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c036faeb-f32e-46ea-a3c0-d85db5076832 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:19.559823 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c036faeb-f32e-46ea-a3c0-d85db5076832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:19.612555 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1129/2240] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:19.616783 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ca508-d3c1-4562-8b52-e501ccc6657a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:19.636543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ca508-d3c1-4562-8b52-e501ccc6657a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:19.659618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ac5b9-13cb-4d2a-9ac4-7e0329ddcf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:19.661851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ac5b9-13cb-4d2a-9ac4-7e0329ddcf56 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:19.675101 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ac5b9-13cb-4d2a-9ac4-7e0329ddcf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:19.675431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ac5b9-13cb-4d2a-9ac4-7e0329ddcf56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:19.678531 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ac5b9-13cb-4d2a-9ac4-7e0329ddcf56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:19.678888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ac5b9-13cb-4d2a-9ac4-7e0329ddcf56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:19.683825 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ac5b9-13cb-4d2a-9ac4-7e0329ddcf56 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:19.704739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1112/2241] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:37:19.705458 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036faeb-f32e-46ea-a3c0-d85db5076832 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:19.720172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036faeb-f32e-46ea-a3c0-d85db5076832 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:19.741144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac0f57-7725-4bab-bd5e-57632e5365b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:19.744873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac0f57-7725-4bab-bd5e-57632e5365b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:19.748391 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac0f57-7725-4bab-bd5e-57632e5365b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:19.748391 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac0f57-7725-4bab-bd5e-57632e5365b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:19.748391 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac0f57-7725-4bab-bd5e-57632e5365b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:19.752469 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac0f57-7725-4bab-bd5e-57632e5365b7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:19.929081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1130/2242] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:19 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:37:19.934791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ac5b9-13cb-4d2a-9ac4-7e0329ddcf56 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:19.950369 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ac5b9-13cb-4d2a-9ac4-7e0329ddcf56 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:20.035279 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3740dab-2ced-4515-a895-1b186882286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:20.036088 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3740dab-2ced-4515-a895-1b186882286d admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:20.036430 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3740dab-2ced-4515-a895-1b186882286d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:20.036872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3740dab-2ced-4515-a895-1b186882286d admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:20.037855 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3740dab-2ced-4515-a895-1b186882286d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:20.040411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3740dab-2ced-4515-a895-1b186882286d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:20.070865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:20.183163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1113/2243] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:19 2022] POST /identity/v3/users => generated 287 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:20.184872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac0f57-7725-4bab-bd5e-57632e5365b7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:20.200466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac0f57-7725-4bab-bd5e-57632e5365b7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:20.209041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676ac5b-d682-491e-a5f1-525b9f0ae523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:20.210006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676ac5b-d682-491e-a5f1-525b9f0ae523 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:20.210501 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676ac5b-d682-491e-a5f1-525b9f0ae523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:20.210988 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676ac5b-d682-491e-a5f1-525b9f0ae523 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:20.213092 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676ac5b-d682-491e-a5f1-525b9f0ae523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:20.215416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676ac5b-d682-491e-a5f1-525b9f0ae523 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:20.236694 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3740dab-2ced-4515-a895-1b186882286d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:20.237066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1131/2244] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:37:20.256428 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3740dab-2ced-4515-a895-1b186882286d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:20.263028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53968e-9c0e-4829-b5bd-b08f05b629c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:20.264366 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53968e-9c0e-4829-b5bd-b08f05b629c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:20.264785 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53968e-9c0e-4829-b5bd-b08f05b629c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:20.265158 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53968e-9c0e-4829-b5bd-b08f05b629c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:20.266133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53968e-9c0e-4829-b5bd-b08f05b629c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:20.268702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53968e-9c0e-4829-b5bd-b08f05b629c1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:20.293373 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1114/2245] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:37:20.297895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676ac5b-d682-491e-a5f1-525b9f0ae523 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:20.310590 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676ac5b-d682-491e-a5f1-525b9f0ae523 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:20.320228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b8c17-3d43-4f1e-902d-228f04510343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:20.321611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b8c17-3d43-4f1e-902d-228f04510343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:20.322006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b8c17-3d43-4f1e-902d-228f04510343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:20.322322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b8c17-3d43-4f1e-902d-228f04510343 admin admin] PATH_INFO: `/v3/projects/589415b309bb46f59aa83321d968be0d/users/a51ce09ac8354b118c6f98d86c558808/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:20.344125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b8c17-3d43-4f1e-902d-228f04510343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=589415b309bb46f59aa83321d968be0d, user_id=a51ce09ac8354b118c6f98d86c558808, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:20.347002 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b8c17-3d43-4f1e-902d-228f04510343 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:20.430743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1132/2246] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:20 2022] PUT /identity/v3/projects/589415b309bb46f59aa83321d968be0d/users/a51ce09ac8354b118c6f98d86c558808/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:20.456291 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21d7d-23f8-448d-8550-1ea3b4544ae6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:20.457527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21d7d-23f8-448d-8550-1ea3b4544ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:20.458276 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21d7d-23f8-448d-8550-1ea3b4544ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:20.523525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0ca21d7d-23f8-448d-8550-1ea3b4544ae6 None None] MFA Rules not processed for user `a51ce09ac8354b118c6f98d86c558808`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:20.525050 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0ca21d7d-23f8-448d-8550-1ea3b4544ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:20.731919 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1115/2247] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:20.754137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b8c17-3d43-4f1e-902d-228f04510343 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:20.759220 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2e8b8c17-3d43-4f1e-902d-228f04510343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:20.873666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b8c17-3d43-4f1e-902d-228f04510343 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:20.880697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1748b3-925b-477f-b4b8-15951cdff465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:20.881893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1748b3-925b-477f-b4b8-15951cdff465 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:20.882599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1748b3-925b-477f-b4b8-15951cdff465 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:20.883094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1748b3-925b-477f-b4b8-15951cdff465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:20.895969 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1748b3-925b-477f-b4b8-15951cdff465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:20.902824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1748b3-925b-477f-b4b8-15951cdff465 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:20.934189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1133/2248] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:22.042865 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:22.344753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbbfd6-a7da-4bc4-82d1-4da9e6ddf5ff None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:22.346726 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbbfd6-a7da-4bc4-82d1-4da9e6ddf5ff None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:22.352769 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbbfd6-a7da-4bc4-82d1-4da9e6ddf5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:22.379651 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c8fbbfd6-a7da-4bc4-82d1-4da9e6ddf5ff None None] MFA Rules not processed for user `384846a5204f484a8e5bf2c8c85d08e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:22.380861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c8fbbfd6-a7da-4bc4-82d1-4da9e6ddf5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:22.472322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1116/2249] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:22.480688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1748b3-925b-477f-b4b8-15951cdff465 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:22.486004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6f1748b3-925b-477f-b4b8-15951cdff465 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:22.588085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1748b3-925b-477f-b4b8-15951cdff465 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:22.596741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05762700-2f33-48e3-a724-0b671e23a7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:22.598833 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05762700-2f33-48e3-a724-0b671e23a7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:22.599605 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05762700-2f33-48e3-a724-0b671e23a7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:22.600420 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05762700-2f33-48e3-a724-0b671e23a7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:22.602795 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05762700-2f33-48e3-a724-0b671e23a7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:22.607547 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05762700-2f33-48e3-a724-0b671e23a7e9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:22.959384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbbfd6-a7da-4bc4-82d1-4da9e6ddf5ff None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:22.959762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1134/2250] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:22 2022] POST /identity/v3/projects => generated 383 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:22.976598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbbfd6-a7da-4bc4-82d1-4da9e6ddf5ff None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:23.129860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137396b9-523e-46e8-b8c2-ccbedaf27b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:23.130842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137396b9-523e-46e8-b8c2-ccbedaf27b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:23.131320 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137396b9-523e-46e8-b8c2-ccbedaf27b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:23.131755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137396b9-523e-46e8-b8c2-ccbedaf27b9b admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:23.132454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137396b9-523e-46e8-b8c2-ccbedaf27b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:23.134568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137396b9-523e-46e8-b8c2-ccbedaf27b9b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:23.239303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1117/2251] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:22 2022] POST /identity/v3/users => generated 298 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:37:23.243262 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05762700-2f33-48e3-a724-0b671e23a7e9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:23.270162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05762700-2f33-48e3-a724-0b671e23a7e9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:23.288633 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65d88a-ee0f-4313-b58f-24ffca01a0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:23.289630 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65d88a-ee0f-4313-b58f-24ffca01a0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:23.289904 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65d88a-ee0f-4313-b58f-24ffca01a0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:23.290173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65d88a-ee0f-4313-b58f-24ffca01a0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:23.291162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65d88a-ee0f-4313-b58f-24ffca01a0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:23.293048 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65d88a-ee0f-4313-b58f-24ffca01a0b5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:23.321616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1135/2252] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:23.326834 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137396b9-523e-46e8-b8c2-ccbedaf27b9b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:23.351086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137396b9-523e-46e8-b8c2-ccbedaf27b9b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:23.369637 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0a81a-442c-4c2b-aee6-db9b80bcced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:23.370555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0a81a-442c-4c2b-aee6-db9b80bcced3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:23.370863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0a81a-442c-4c2b-aee6-db9b80bcced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:23.371139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0a81a-442c-4c2b-aee6-db9b80bcced3 admin admin] PATH_INFO: `/v3/projects/cb579c200ed346df87014e77b99370e5/users/8df89007f46249e0845bc6acb292058e/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:23.408097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0a81a-442c-4c2b-aee6-db9b80bcced3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb579c200ed346df87014e77b99370e5, user_id=8df89007f46249e0845bc6acb292058e, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:23.410830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0a81a-442c-4c2b-aee6-db9b80bcced3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:23.487147 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1118/2253] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:23 2022] PUT /identity/v3/projects/cb579c200ed346df87014e77b99370e5/users/8df89007f46249e0845bc6acb292058e/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:23.492217 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65d88a-ee0f-4313-b58f-24ffca01a0b5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:23.512703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65d88a-ee0f-4313-b58f-24ffca01a0b5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:23.600213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292feed-d88e-4f0c-b420-eb66d6f84a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:23.601133 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292feed-d88e-4f0c-b420-eb66d6f84a60 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:23.601918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292feed-d88e-4f0c-b420-eb66d6f84a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:23.602362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292feed-d88e-4f0c-b420-eb66d6f84a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:23.603400 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292feed-d88e-4f0c-b420-eb66d6f84a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:23.605624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292feed-d88e-4f0c-b420-eb66d6f84a60 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:23.621422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1136/2254] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:37:23.625100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0a81a-442c-4c2b-aee6-db9b80bcced3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:23.638997 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0a81a-442c-4c2b-aee6-db9b80bcced3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:23.644808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0dea3-4ed7-4a51-aac8-0d47f3d0d4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:23.646237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0dea3-4ed7-4a51-aac8-0d47f3d0d4bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:23.646793 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0dea3-4ed7-4a51-aac8-0d47f3d0d4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:23.647529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0dea3-4ed7-4a51-aac8-0d47f3d0d4bf admin admin] PATH_INFO: `/v3/projects/cb579c200ed346df87014e77b99370e5/users/8df89007f46249e0845bc6acb292058e/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:23.649937 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0dea3-4ed7-4a51-aac8-0d47f3d0d4bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb579c200ed346df87014e77b99370e5, user_id=8df89007f46249e0845bc6acb292058e, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:23.654024 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0dea3-4ed7-4a51-aac8-0d47f3d0d4bf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:23.669376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1119/2255] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:23 2022] PUT /identity/v3/projects/cb579c200ed346df87014e77b99370e5/users/8df89007f46249e0845bc6acb292058e/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:24.210046 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292feed-d88e-4f0c-b420-eb66d6f84a60 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:24.212045 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e292feed-d88e-4f0c-b420-eb66d6f84a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:24.244186 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292feed-d88e-4f0c-b420-eb66d6f84a60 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:24.398221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444f2dc-b045-442f-8ec9-ace3c3637081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:24.398221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444f2dc-b045-442f-8ec9-ace3c3637081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:24.398221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444f2dc-b045-442f-8ec9-ace3c3637081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:24.398221 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444f2dc-b045-442f-8ec9-ace3c3637081 admin admin] PATH_INFO: `/v3/users/0c868634794b4124be8ce584398e8401` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:24.398858 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444f2dc-b045-442f-8ec9-ace3c3637081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c868634794b4124be8ce584398e8401)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:24.399357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444f2dc-b045-442f-8ec9-ace3c3637081 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:24.579914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:24.708732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1444f2dc-b045-442f-8ec9-ace3c3637081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c868634794b4124be8ce584398e8401'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:24.809434 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1444f2dc-b045-442f-8ec9-ace3c3637081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c868634794b4124be8ce584398e8401'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:24.810607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1444f2dc-b045-442f-8ec9-ace3c3637081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c868634794b4124be8ce584398e8401'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:24.837153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1444f2dc-b045-442f-8ec9-ace3c3637081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c868634794b4124be8ce584398e8401'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:24.857837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1444f2dc-b045-442f-8ec9-ace3c3637081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c868634794b4124be8ce584398e8401'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:24.880696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ff17-47b3-4551-b330-2d87de072575 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:24.881278 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ff17-47b3-4551-b330-2d87de072575 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:24.881764 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ff17-47b3-4551-b330-2d87de072575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:24.893566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1137/2256] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:24 2022] DELETE /identity/v3/users/0c868634794b4124be8ce584398e8401 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:24.910763 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2693ff17-47b3-4551-b330-2d87de072575 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:24.914231 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2693ff17-47b3-4551-b330-2d87de072575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:25.019119 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1120/2257] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:25.036143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444f2dc-b045-442f-8ec9-ace3c3637081 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:25.036143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1444f2dc-b045-442f-8ec9-ace3c3637081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:25.207394 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444f2dc-b045-442f-8ec9-ace3c3637081 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:25.212566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb376c5-54aa-459b-98ea-2933cd690f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:25.213359 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb376c5-54aa-459b-98ea-2933cd690f12 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.213826 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb376c5-54aa-459b-98ea-2933cd690f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.214194 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb376c5-54aa-459b-98ea-2933cd690f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:25.259688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb376c5-54aa-459b-98ea-2933cd690f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:25.261271 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb376c5-54aa-459b-98ea-2933cd690f12 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:25.290422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1138/2258] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:25.864121 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693ff17-47b3-4551-b330-2d87de072575 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:25.865517 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2693ff17-47b3-4551-b330-2d87de072575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:25.887590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693ff17-47b3-4551-b330-2d87de072575 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:25.893431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d73a0-e90d-4869-a331-c4c2da294eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:25.895020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d73a0-e90d-4869-a331-c4c2da294eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.895475 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d73a0-e90d-4869-a331-c4c2da294eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.896134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d73a0-e90d-4869-a331-c4c2da294eb9 admin admin] PATH_INFO: `/v3/projects/8caeb3b7f55442d29dfe6284ea7e851a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:25.899652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d73a0-e90d-4869-a331-c4c2da294eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8caeb3b7f55442d29dfe6284ea7e851a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:25.901908 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d73a0-e90d-4869-a331-c4c2da294eb9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:26.127460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d77d73a0-e90d-4869-a331-c4c2da294eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8caeb3b7f55442d29dfe6284ea7e851a', 'request_id': 'req-d77d73a0-e90d-4869-a331-c4c2da294eb9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.136599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d77d73a0-e90d-4869-a331-c4c2da294eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8caeb3b7f55442d29dfe6284ea7e851a', 'request_id': 'req-d77d73a0-e90d-4869-a331-c4c2da294eb9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.281086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d77d73a0-e90d-4869-a331-c4c2da294eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8caeb3b7f55442d29dfe6284ea7e851a', 'request_id': 'req-d77d73a0-e90d-4869-a331-c4c2da294eb9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.311318 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d77d73a0-e90d-4869-a331-c4c2da294eb9 admin admin] The token cache is being invalidate because project 8caeb3b7f55442d29dfe6284ea7e851a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:26.311609 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d77d73a0-e90d-4869-a331-c4c2da294eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.319850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d77d73a0-e90d-4869-a331-c4c2da294eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.328877 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1121/2259] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:25 2022] DELETE /identity/v3/projects/8caeb3b7f55442d29dfe6284ea7e851a => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:26.331639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb376c5-54aa-459b-98ea-2933cd690f12 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:26.342344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb376c5-54aa-459b-98ea-2933cd690f12 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:26.440488 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:26.456626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea1840-b165-4673-81cd-7f7821a77994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:26.458731 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea1840-b165-4673-81cd-7f7821a77994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:26.459190 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea1840-b165-4673-81cd-7f7821a77994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:26.459569 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea1840-b165-4673-81cd-7f7821a77994 admin admin] PATH_INFO: `/v3/users/66cee5f2c47040efa381d39190f971af` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:26.462200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea1840-b165-4673-81cd-7f7821a77994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66cee5f2c47040efa381d39190f971af)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:26.464648 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea1840-b165-4673-81cd-7f7821a77994 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:26.738963 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d2ea1840-b165-4673-81cd-7f7821a77994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66cee5f2c47040efa381d39190f971af'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.866639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d2ea1840-b165-4673-81cd-7f7821a77994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66cee5f2c47040efa381d39190f971af'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.867593 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d2ea1840-b165-4673-81cd-7f7821a77994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66cee5f2c47040efa381d39190f971af'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.890976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d2ea1840-b165-4673-81cd-7f7821a77994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66cee5f2c47040efa381d39190f971af'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.900329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d2ea1840-b165-4673-81cd-7f7821a77994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66cee5f2c47040efa381d39190f971af'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.923796 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1139/2260] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:26 2022] DELETE /identity/v3/users/66cee5f2c47040efa381d39190f971af => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:27.794508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d73a0-e90d-4869-a331-c4c2da294eb9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:27.798187 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d77d73a0-e90d-4869-a331-c4c2da294eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:27.830769 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d73a0-e90d-4869-a331-c4c2da294eb9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:27.851525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea1840-b165-4673-81cd-7f7821a77994 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:27.853628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d2ea1840-b165-4673-81cd-7f7821a77994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:27.988298 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:27.989547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.989935 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.990311 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e admin admin] PATH_INFO: `/v3/projects/33678aea131543138f59620fbb899d44` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.992137 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=33678aea131543138f59620fbb899d44)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:27.995439 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:28.031117 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea1840-b165-4673-81cd-7f7821a77994 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:28.043552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec769f-8c3d-4b70-8522-e8f800a04787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:28.044455 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec769f-8c3d-4b70-8522-e8f800a04787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.044729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec769f-8c3d-4b70-8522-e8f800a04787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.046300 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec769f-8c3d-4b70-8522-e8f800a04787 admin admin] PATH_INFO: `/v3/users/a51ce09ac8354b118c6f98d86c558808` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.048511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec769f-8c3d-4b70-8522-e8f800a04787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51ce09ac8354b118c6f98d86c558808)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:28.051858 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec769f-8c3d-4b70-8522-e8f800a04787 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:28.200511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33678aea131543138f59620fbb899d44', 'request_id': 'req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.209563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33678aea131543138f59620fbb899d44', 'request_id': 'req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.483913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33678aea131543138f59620fbb899d44', 'request_id': 'req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.495373 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e admin admin] The token cache is being invalidate because project 33678aea131543138f59620fbb899d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:28.495767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.496489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.498158 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1122/2261] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:27 2022] DELETE /identity/v3/projects/33678aea131543138f59620fbb899d44 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:28.502399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:28.503844 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:28.596890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6ec769f-8c3d-4b70-8522-e8f800a04787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51ce09ac8354b118c6f98d86c558808'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.611069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f70bc6-2a81-4ff5-9287-9deaa2483c6e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:28.617367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b1c88-4489-474c-aadb-e5ca1534d53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:28.618663 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b1c88-4489-474c-aadb-e5ca1534d53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.619251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b1c88-4489-474c-aadb-e5ca1534d53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.619738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b1c88-4489-474c-aadb-e5ca1534d53f admin admin] PATH_INFO: `/v3/users/aa163804d53b4566a0cb03a90b548a94` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.622031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b1c88-4489-474c-aadb-e5ca1534d53f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa163804d53b4566a0cb03a90b548a94)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:28.624225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b1c88-4489-474c-aadb-e5ca1534d53f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:28.679447 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6ec769f-8c3d-4b70-8522-e8f800a04787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51ce09ac8354b118c6f98d86c558808'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.680526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6ec769f-8c3d-4b70-8522-e8f800a04787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51ce09ac8354b118c6f98d86c558808'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.701935 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6ec769f-8c3d-4b70-8522-e8f800a04787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51ce09ac8354b118c6f98d86c558808'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.717438 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c6ec769f-8c3d-4b70-8522-e8f800a04787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51ce09ac8354b118c6f98d86c558808'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.732186 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1140/2262] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:27 2022] DELETE /identity/v3/users/a51ce09ac8354b118c6f98d86c558808 => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:28.737316 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b52f30-c3c6-4976-913f-8b0f0a48733e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.737621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b52f30-c3c6-4976-913f-8b0f0a48733e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.738009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b52f30-c3c6-4976-913f-8b0f0a48733e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.758382 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-63b52f30-c3c6-4976-913f-8b0f0a48733e None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:28.760000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-63b52f30-c3c6-4976-913f-8b0f0a48733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:28.837476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1141/2263] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:28.851248 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b52f30-c3c6-4976-913f-8b0f0a48733e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:28.853035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-63b52f30-c3c6-4976-913f-8b0f0a48733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:28.943478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b52f30-c3c6-4976-913f-8b0f0a48733e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:28.948179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06238a1-86a4-43ab-9bbd-1be5f5c07682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:28.949582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06238a1-86a4-43ab-9bbd-1be5f5c07682 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.950095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06238a1-86a4-43ab-9bbd-1be5f5c07682 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.950763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06238a1-86a4-43ab-9bbd-1be5f5c07682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.965883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06238a1-86a4-43ab-9bbd-1be5f5c07682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:28.968721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06238a1-86a4-43ab-9bbd-1be5f5c07682 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:28.979693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b9b1c88-4489-474c-aadb-e5ca1534d53f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa163804d53b4566a0cb03a90b548a94'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.993332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1142/2264] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:37:29.143437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b9b1c88-4489-474c-aadb-e5ca1534d53f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa163804d53b4566a0cb03a90b548a94'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:29.163018 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b9b1c88-4489-474c-aadb-e5ca1534d53f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa163804d53b4566a0cb03a90b548a94'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:29.203062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b9b1c88-4489-474c-aadb-e5ca1534d53f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa163804d53b4566a0cb03a90b548a94'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:29.204087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b9b1c88-4489-474c-aadb-e5ca1534d53f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa163804d53b4566a0cb03a90b548a94'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:29.212243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1123/2265] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:28 2022] DELETE /identity/v3/users/aa163804d53b4566a0cb03a90b548a94 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:29.757244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06238a1-86a4-43ab-9bbd-1be5f5c07682 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:29.759361 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f06238a1-86a4-43ab-9bbd-1be5f5c07682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:29.776930 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06238a1-86a4-43ab-9bbd-1be5f5c07682 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:29.847188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effe312-1929-493e-98da-6c16bf00b041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:29.848117 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effe312-1929-493e-98da-6c16bf00b041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:29.848397 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effe312-1929-493e-98da-6c16bf00b041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:29.848664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effe312-1929-493e-98da-6c16bf00b041 admin admin] PATH_INFO: `/v3/projects/589415b309bb46f59aa83321d968be0d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:29.850024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effe312-1929-493e-98da-6c16bf00b041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=589415b309bb46f59aa83321d968be0d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:29.852051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effe312-1929-493e-98da-6c16bf00b041 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:29.894252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b1c88-4489-474c-aadb-e5ca1534d53f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:29.902786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5b9b1c88-4489-474c-aadb-e5ca1534d53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:29.912854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b1c88-4489-474c-aadb-e5ca1534d53f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:29.919503 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11fa10-d543-4df7-ab14-c4fb7c5f242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:29.922583 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11fa10-d543-4df7-ab14-c4fb7c5f242e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:29.922971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11fa10-d543-4df7-ab14-c4fb7c5f242e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:29.923791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11fa10-d543-4df7-ab14-c4fb7c5f242e admin admin] PATH_INFO: `/v3/projects/0164326d895d4b92b72100541f0eba29` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:29.925424 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11fa10-d543-4df7-ab14-c4fb7c5f242e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0164326d895d4b92b72100541f0eba29)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:29.928252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11fa10-d543-4df7-ab14-c4fb7c5f242e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:30.093619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1effe312-1929-493e-98da-6c16bf00b041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '589415b309bb46f59aa83321d968be0d', 'request_id': 'req-1effe312-1929-493e-98da-6c16bf00b041'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:30.149092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8f11fa10-d543-4df7-ab14-c4fb7c5f242e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0164326d895d4b92b72100541f0eba29', 'request_id': 'req-8f11fa10-d543-4df7-ab14-c4fb7c5f242e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:30.156951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8f11fa10-d543-4df7-ab14-c4fb7c5f242e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0164326d895d4b92b72100541f0eba29', 'request_id': 'req-8f11fa10-d543-4df7-ab14-c4fb7c5f242e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:30.274009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1effe312-1929-493e-98da-6c16bf00b041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '589415b309bb46f59aa83321d968be0d', 'request_id': 'req-1effe312-1929-493e-98da-6c16bf00b041'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:30.289431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1effe312-1929-493e-98da-6c16bf00b041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '589415b309bb46f59aa83321d968be0d', 'request_id': 'req-1effe312-1929-493e-98da-6c16bf00b041'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:30.306010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1effe312-1929-493e-98da-6c16bf00b041 admin admin] The token cache is being invalidate because project 589415b309bb46f59aa83321d968be0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:30.306351 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1effe312-1929-493e-98da-6c16bf00b041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:30.307101 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1effe312-1929-493e-98da-6c16bf00b041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:30.309094 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1143/2266] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:29 2022] DELETE /identity/v3/projects/589415b309bb46f59aa83321d968be0d => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:30.315027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeab928-def5-4386-8b13-4790d411b303 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:30.315452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeab928-def5-4386-8b13-4790d411b303 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:30.315851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeab928-def5-4386-8b13-4790d411b303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:30.337996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2aeab928-def5-4386-8b13-4790d411b303 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:30.340068 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2aeab928-def5-4386-8b13-4790d411b303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:30.388019 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8f11fa10-d543-4df7-ab14-c4fb7c5f242e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0164326d895d4b92b72100541f0eba29', 'request_id': 'req-8f11fa10-d543-4df7-ab14-c4fb7c5f242e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:30.404144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8f11fa10-d543-4df7-ab14-c4fb7c5f242e admin admin] The token cache is being invalidate because project 0164326d895d4b92b72100541f0eba29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:30.404677 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8f11fa10-d543-4df7-ab14-c4fb7c5f242e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:30.405635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8f11fa10-d543-4df7-ab14-c4fb7c5f242e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:30.408485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1124/2267] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:29 2022] DELETE /identity/v3/projects/0164326d895d4b92b72100541f0eba29 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:30.414701 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638e91a-ed5b-4ded-ae13-6bd3804cac65 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:30.415706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638e91a-ed5b-4ded-ae13-6bd3804cac65 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:30.416734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638e91a-ed5b-4ded-ae13-6bd3804cac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:30.420050 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:30.432637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1144/2268] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:30.443035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227d826-432d-4b80-8d4e-80bd94fbddcb None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:30.443700 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227d826-432d-4b80-8d4e-80bd94fbddcb None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:30.444371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227d826-432d-4b80-8d4e-80bd94fbddcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:30.445306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4638e91a-ed5b-4ded-ae13-6bd3804cac65 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:30.446745 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4638e91a-ed5b-4ded-ae13-6bd3804cac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:30.457801 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1125/2269] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:30.465451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff945f4a-2543-48e5-85d0-24582119bd55 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:30.465964 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff945f4a-2543-48e5-85d0-24582119bd55 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:30.466384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff945f4a-2543-48e5-85d0-24582119bd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:30.469352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3227d826-432d-4b80-8d4e-80bd94fbddcb None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:30.471524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3227d826-432d-4b80-8d4e-80bd94fbddcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:30.484958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1145/2270] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:30.490128 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227d826-432d-4b80-8d4e-80bd94fbddcb None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:30.496555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ff945f4a-2543-48e5-85d0-24582119bd55 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:30.498552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ff945f4a-2543-48e5-85d0-24582119bd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:30.503519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227d826-432d-4b80-8d4e-80bd94fbddcb None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:30.513495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3576fa-00c6-44c6-bb36-cdfa9637d68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:30.515245 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3576fa-00c6-44c6-bb36-cdfa9637d68f admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:30.515962 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3576fa-00c6-44c6-bb36-cdfa9637d68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:30.516385 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3576fa-00c6-44c6-bb36-cdfa9637d68f admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:30.517823 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3576fa-00c6-44c6-bb36-cdfa9637d68f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:30.518497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3576fa-00c6-44c6-bb36-cdfa9637d68f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:30.520622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3576fa-00c6-44c6-bb36-cdfa9637d68f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:30.553441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1126/2271] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:30.555103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1146/2272] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:37:30.559428 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff945f4a-2543-48e5-85d0-24582119bd55 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:30.559816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3576fa-00c6-44c6-bb36-cdfa9637d68f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:30.578337 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3576fa-00c6-44c6-bb36-cdfa9637d68f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:30.579600 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff945f4a-2543-48e5-85d0-24582119bd55 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:30.583936 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8fa3c-7ebb-40ed-9237-e532055a87fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:30.585401 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8fa3c-7ebb-40ed-9237-e532055a87fb admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:30.585925 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8fa3c-7ebb-40ed-9237-e532055a87fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:30.586522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8fa3c-7ebb-40ed-9237-e532055a87fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:30.587390 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6764827-c38a-4c94-ad32-deb451581d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:30.587706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8fa3c-7ebb-40ed-9237-e532055a87fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:30.589113 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6764827-c38a-4c94-ad32-deb451581d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:30.589574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6764827-c38a-4c94-ad32-deb451581d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:30.589852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6764827-c38a-4c94-ad32-deb451581d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:30.590604 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6764827-c38a-4c94-ad32-deb451581d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:30.590959 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8fa3c-7ebb-40ed-9237-e532055a87fb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:30.591079 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6764827-c38a-4c94-ad32-deb451581d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:30.592847 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6764827-c38a-4c94-ad32-deb451581d26 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:30.618643 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1127/2273] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:37:30.623148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6764827-c38a-4c94-ad32-deb451581d26 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:30.636398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6764827-c38a-4c94-ad32-deb451581d26 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:30.643026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a113a-db66-42f1-a439-5ea890326226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:30.644020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a113a-db66-42f1-a439-5ea890326226 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:30.644535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a113a-db66-42f1-a439-5ea890326226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:30.645666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a113a-db66-42f1-a439-5ea890326226 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:30.645666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a113a-db66-42f1-a439-5ea890326226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:30.649165 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a113a-db66-42f1-a439-5ea890326226 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:30.746753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1147/2274] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:30 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:30.766070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8fa3c-7ebb-40ed-9237-e532055a87fb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:30.796292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1128/2275] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:30 2022] POST /identity/v3/projects => generated 397 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:37:30.797416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a113a-db66-42f1-a439-5ea890326226 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:30.889626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8fa3c-7ebb-40ed-9237-e532055a87fb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:30.914107 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a113a-db66-42f1-a439-5ea890326226 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:30.920595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562cb22-22bf-4eaa-95e2-4a0ee0b75245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:30.921389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562cb22-22bf-4eaa-95e2-4a0ee0b75245 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:30.921862 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562cb22-22bf-4eaa-95e2-4a0ee0b75245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:30.922331 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562cb22-22bf-4eaa-95e2-4a0ee0b75245 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:30.923227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562cb22-22bf-4eaa-95e2-4a0ee0b75245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:30.926861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562cb22-22bf-4eaa-95e2-4a0ee0b75245 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:30.969324 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace269f-d762-4d16-b09b-48a05ad78ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:30.970000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace269f-d762-4d16-b09b-48a05ad78ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:30.970307 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace269f-d762-4d16-b09b-48a05ad78ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:30.970577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace269f-d762-4d16-b09b-48a05ad78ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:30.971524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace269f-d762-4d16-b09b-48a05ad78ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:30.973475 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace269f-d762-4d16-b09b-48a05ad78ba6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:31.077135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1129/2276] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:30 2022] POST /identity/v3/users => generated 299 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:37:31.082628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562cb22-22bf-4eaa-95e2-4a0ee0b75245 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:31.095099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562cb22-22bf-4eaa-95e2-4a0ee0b75245 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:31.116358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1148/2277] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:30 2022] POST /identity/v3/users => generated 286 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:31.118361 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace269f-d762-4d16-b09b-48a05ad78ba6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:31.125736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6fc15-6889-49c1-b6e0-f752376358f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:31.126434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6fc15-6889-49c1-b6e0-f752376358f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:31.126808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6fc15-6889-49c1-b6e0-f752376358f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:31.127090 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6fc15-6889-49c1-b6e0-f752376358f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:31.130441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6fc15-6889-49c1-b6e0-f752376358f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:31.133909 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6fc15-6889-49c1-b6e0-f752376358f2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:31.141047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace269f-d762-4d16-b09b-48a05ad78ba6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:31.154819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1130/2278] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:37:31.160006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6812b0-22d6-4f68-9033-f2a8c9ab9ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:31.160006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6812b0-22d6-4f68-9033-f2a8c9ab9ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:31.160006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6812b0-22d6-4f68-9033-f2a8c9ab9ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:31.160006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6812b0-22d6-4f68-9033-f2a8c9ab9ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:31.160402 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6812b0-22d6-4f68-9033-f2a8c9ab9ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:31.163358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6fc15-6889-49c1-b6e0-f752376358f2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:31.164721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6812b0-22d6-4f68-9033-f2a8c9ab9ec3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:31.182225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6fc15-6889-49c1-b6e0-f752376358f2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:31.192039 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1149/2279] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:31.197892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6340a-cd05-44f4-a10e-68df4756aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:31.198789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6340a-cd05-44f4-a10e-68df4756aad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:31.199191 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6812b0-22d6-4f68-9033-f2a8c9ab9ec3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:31.200660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6340a-cd05-44f4-a10e-68df4756aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:31.201533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6340a-cd05-44f4-a10e-68df4756aad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:31.203108 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6340a-cd05-44f4-a10e-68df4756aad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:31.209841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6340a-cd05-44f4-a10e-68df4756aad5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:31.221066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6812b0-22d6-4f68-9033-f2a8c9ab9ec3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:31.229111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1131/2280] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:31.233382 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6340a-cd05-44f4-a10e-68df4756aad5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:31.237852 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed559f95-822e-40d1-8d46-d96c11c09813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:31.239183 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed559f95-822e-40d1-8d46-d96c11c09813 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:31.239696 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed559f95-822e-40d1-8d46-d96c11c09813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:31.240123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed559f95-822e-40d1-8d46-d96c11c09813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:31.241064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed559f95-822e-40d1-8d46-d96c11c09813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:31.242911 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed559f95-822e-40d1-8d46-d96c11c09813 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:31.258639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1150/2281] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:31.260843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6340a-cd05-44f4-a10e-68df4756aad5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:31.263012 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed559f95-822e-40d1-8d46-d96c11c09813 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:31.269689 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6014b54-0b18-4bf9-90a5-4f6be1da6b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:31.270996 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6014b54-0b18-4bf9-90a5-4f6be1da6b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:31.271445 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6014b54-0b18-4bf9-90a5-4f6be1da6b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:31.271784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6014b54-0b18-4bf9-90a5-4f6be1da6b3b admin admin] PATH_INFO: `/v3/projects/3b1b4d42f1da4766abd27b97cfac1cf4/users/52058139f9264845b33625a52ebe7a02/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:31.276095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed559f95-822e-40d1-8d46-d96c11c09813 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:31.284677 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c70859-f57d-42c6-bf1f-7228cfde1f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:31.286310 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c70859-f57d-42c6-bf1f-7228cfde1f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:31.286783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c70859-f57d-42c6-bf1f-7228cfde1f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:31.307804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c70859-f57d-42c6-bf1f-7228cfde1f6a admin admin] PATH_INFO: `/v3/projects/0372a05205b54e7b9d1052c0f1e142bd/users/83646396ef9a48299025fcf1af4c22a3/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:31.308494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6014b54-0b18-4bf9-90a5-4f6be1da6b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1b4d42f1da4766abd27b97cfac1cf4, user_id=52058139f9264845b33625a52ebe7a02, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:31.308494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6014b54-0b18-4bf9-90a5-4f6be1da6b3b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:31.308714 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c70859-f57d-42c6-bf1f-7228cfde1f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0372a05205b54e7b9d1052c0f1e142bd, user_id=83646396ef9a48299025fcf1af4c22a3, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:31.310443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c70859-f57d-42c6-bf1f-7228cfde1f6a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:31.445006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1151/2282] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:31 2022] PUT /identity/v3/projects/0372a05205b54e7b9d1052c0f1e142bd/users/83646396ef9a48299025fcf1af4c22a3/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:31.462024 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1132/2283] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:31 2022] PUT /identity/v3/projects/3b1b4d42f1da4766abd27b97cfac1cf4/users/52058139f9264845b33625a52ebe7a02/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:31.463896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121314-aa7c-48b8-85d0-f034d109f301 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:31.464782 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4391b7e-2c73-4f9d-b7ae-119c0c7b5f38 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:31.465369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4391b7e-2c73-4f9d-b7ae-119c0c7b5f38 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:31.465853 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4391b7e-2c73-4f9d-b7ae-119c0c7b5f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:31.466355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121314-aa7c-48b8-85d0-f034d109f301 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:31.468281 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121314-aa7c-48b8-85d0-f034d109f301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:31.553957 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c4391b7e-2c73-4f9d-b7ae-119c0c7b5f38 None None] MFA Rules not processed for user `83646396ef9a48299025fcf1af4c22a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:31.555297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4e121314-aa7c-48b8-85d0-f034d109f301 None None] MFA Rules not processed for user `52058139f9264845b33625a52ebe7a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:31.556602 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c4391b7e-2c73-4f9d-b7ae-119c0c7b5f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:31.558303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4e121314-aa7c-48b8-85d0-f034d109f301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:31.718869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1152/2284] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:31.731708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1133/2285] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:31.740006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4391b7e-2c73-4f9d-b7ae-119c0c7b5f38 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:31.740564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e121314-aa7c-48b8-85d0-f034d109f301 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:31.741951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c4391b7e-2c73-4f9d-b7ae-119c0c7b5f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:31.744778 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4e121314-aa7c-48b8-85d0-f034d109f301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:31.883364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e121314-aa7c-48b8-85d0-f034d109f301 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:31.894880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4391b7e-2c73-4f9d-b7ae-119c0c7b5f38 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:31.896230 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63490e88-7b77-4014-813d-267d14634951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:31.897003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63490e88-7b77-4014-813d-267d14634951 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:31.897332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63490e88-7b77-4014-813d-267d14634951 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:31.897602 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63490e88-7b77-4014-813d-267d14634951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:31.900755 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151e7c4-fc50-4c23-89e7-24b3639adafb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc7e1bc2eb943eba57a0009635de70d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:31.901582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151e7c4-fc50-4c23-89e7-24b3639adafb service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:31.901994 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151e7c4-fc50-4c23-89e7-24b3639adafb service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:31.902281 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151e7c4-fc50-4c23-89e7-24b3639adafb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:31.916074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151e7c4-fc50-4c23-89e7-24b3639adafb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:31.918263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151e7c4-fc50-4c23-89e7-24b3639adafb service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:31.927185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63490e88-7b77-4014-813d-267d14634951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:31.928675 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63490e88-7b77-4014-813d-267d14634951 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:31.935547 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1153/2286] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:31.965011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1134/2287] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:33.303607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165216c1-4562-4a59-b673-7430b99a0d9d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:33.304545 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165216c1-4562-4a59-b673-7430b99a0d9d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:33.305051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165216c1-4562-4a59-b673-7430b99a0d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:33.367723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:33.390261 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-165216c1-4562-4a59-b673-7430b99a0d9d None None] MFA Rules not processed for user `8df89007f46249e0845bc6acb292058e`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:33.391833 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-165216c1-4562-4a59-b673-7430b99a0d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:33.498382 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1154/2288] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:33.524754 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63490e88-7b77-4014-813d-267d14634951 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:33.526893 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-63490e88-7b77-4014-813d-267d14634951 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:33.543871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63490e88-7b77-4014-813d-267d14634951 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:33.550240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cf13a-c71d-4387-a4d7-334e9172e149 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc7e1bc2eb943eba57a0009635de70d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:33.553444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cf13a-c71d-4387-a4d7-334e9172e149 service glance] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:33.553444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cf13a-c71d-4387-a4d7-334e9172e149 service glance] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:33.553444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cf13a-c71d-4387-a4d7-334e9172e149 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:33.556103 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b78cf13a-c71d-4387-a4d7-334e9172e149 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:33.649385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cf13a-c71d-4387-a4d7-334e9172e149 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:33.650987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cf13a-c71d-4387-a4d7-334e9172e149 service glance] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:33.661558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1135/2289] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:34.049095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c125200-12ec-4f7a-a19c-453dcde820c6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:34.049446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c125200-12ec-4f7a-a19c-453dcde820c6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:34.050387 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c125200-12ec-4f7a-a19c-453dcde820c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:34.069789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4c125200-12ec-4f7a-a19c-453dcde820c6 None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:34.071031 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4c125200-12ec-4f7a-a19c-453dcde820c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:34.108542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c65342-29f7-4b80-b54b-f5f72bcc6bee None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:34.108542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c65342-29f7-4b80-b54b-f5f72bcc6bee None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:34.108542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c65342-29f7-4b80-b54b-f5f72bcc6bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:34.132233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-13c65342-29f7-4b80-b54b-f5f72bcc6bee None None] MFA Rules not processed for user `56f23722191b4d8dac153ffea9e743c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:34.133708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-13c65342-29f7-4b80-b54b-f5f72bcc6bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:34.144702 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1155/2290] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 20 19:37:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:34.198598 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c125200-12ec-4f7a-a19c-453dcde820c6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:34.200182 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4c125200-12ec-4f7a-a19c-453dcde820c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:34.208885 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1136/2291] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:34.281224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c125200-12ec-4f7a-a19c-453dcde820c6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:34.290215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fb54a-b90d-458f-8627-6e847aeaa85c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:34.291514 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fb54a-b90d-458f-8627-6e847aeaa85c service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:34.294089 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fb54a-b90d-458f-8627-6e847aeaa85c service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:34.294089 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fb54a-b90d-458f-8627-6e847aeaa85c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:34.307610 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fb54a-b90d-458f-8627-6e847aeaa85c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:34.311588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fb54a-b90d-458f-8627-6e847aeaa85c service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:34.334142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1156/2292] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:37:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:37:36.279645 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:36.624645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:37.699352 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:39.219786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:41.191843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:41.835897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c65342-29f7-4b80-b54b-f5f72bcc6bee None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:41.960970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c65342-29f7-4b80-b54b-f5f72bcc6bee None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:41.970376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10d3f6-e9d1-4050-bbe5-2d7af015107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:41.972785 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10d3f6-e9d1-4050-bbe5-2d7af015107f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:41.973074 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10d3f6-e9d1-4050-bbe5-2d7af015107f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:41.973351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10d3f6-e9d1-4050-bbe5-2d7af015107f admin admin] PATH_INFO: `/v3/users/52058139f9264845b33625a52ebe7a02` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:41.976636 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10d3f6-e9d1-4050-bbe5-2d7af015107f admin admin] RBAC: Authorizing `identity:delete_user(user_id=52058139f9264845b33625a52ebe7a02)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:41.980638 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10d3f6-e9d1-4050-bbe5-2d7af015107f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:42.149799 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fb54a-b90d-458f-8627-6e847aeaa85c service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:42.168799 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fb54a-b90d-458f-8627-6e847aeaa85c service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:42.174223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18875e40-a714-4002-8cc7-7c07e10a493c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:42.174223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18875e40-a714-4002-8cc7-7c07e10a493c service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:42.174223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18875e40-a714-4002-8cc7-7c07e10a493c service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:42.174223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18875e40-a714-4002-8cc7-7c07e10a493c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:42.175951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-18875e40-a714-4002-8cc7-7c07e10a493c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:42.267569 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ee10d3f6-e9d1-4050-bbe5-2d7af015107f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52058139f9264845b33625a52ebe7a02'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:42.274230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18875e40-a714-4002-8cc7-7c07e10a493c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:42.275821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18875e40-a714-4002-8cc7-7c07e10a493c service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:42.294998 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1157/2293] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:42 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:42.391949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ee10d3f6-e9d1-4050-bbe5-2d7af015107f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52058139f9264845b33625a52ebe7a02'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:42.405189 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ee10d3f6-e9d1-4050-bbe5-2d7af015107f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52058139f9264845b33625a52ebe7a02'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:42.422923 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ee10d3f6-e9d1-4050-bbe5-2d7af015107f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52058139f9264845b33625a52ebe7a02'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:42.423548 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ee10d3f6-e9d1-4050-bbe5-2d7af015107f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52058139f9264845b33625a52ebe7a02'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:42.435488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1137/2294] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:41 2022] DELETE /identity/v3/users/52058139f9264845b33625a52ebe7a02 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:42.438665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e7034-347b-4c53-b62b-4b8570a30cc6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:42.438665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e7034-347b-4c53-b62b-4b8570a30cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:42.438665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e7034-347b-4c53-b62b-4b8570a30cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:42.469069 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-357e7034-347b-4c53-b62b-4b8570a30cc6 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:42.470887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-357e7034-347b-4c53-b62b-4b8570a30cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:42.577980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1158/2295] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:42.589856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10d3f6-e9d1-4050-bbe5-2d7af015107f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:42.591251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ee10d3f6-e9d1-4050-bbe5-2d7af015107f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:42.690236 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10d3f6-e9d1-4050-bbe5-2d7af015107f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:42.698070 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33411c41-e8e1-4e9b-8399-c75ca5bc95f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:42.699442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411c41-e8e1-4e9b-8399-c75ca5bc95f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:42.699727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411c41-e8e1-4e9b-8399-c75ca5bc95f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:42.700053 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33411c41-e8e1-4e9b-8399-c75ca5bc95f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:42.713416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33411c41-e8e1-4e9b-8399-c75ca5bc95f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:42.715086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33411c41-e8e1-4e9b-8399-c75ca5bc95f6 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:42.729674 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1138/2296] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:42.935592 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:43.701495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e7034-347b-4c53-b62b-4b8570a30cc6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:43.703123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-357e7034-347b-4c53-b62b-4b8570a30cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:43.723836 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e7034-347b-4c53-b62b-4b8570a30cc6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:43.734410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a14ece-86a1-4c46-b133-d878d3eed7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:43.739015 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a14ece-86a1-4c46-b133-d878d3eed7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:43.739515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a14ece-86a1-4c46-b133-d878d3eed7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:43.740534 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a14ece-86a1-4c46-b133-d878d3eed7c0 admin admin] PATH_INFO: `/v3/projects/3b1b4d42f1da4766abd27b97cfac1cf4` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:43.742335 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a14ece-86a1-4c46-b133-d878d3eed7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1b4d42f1da4766abd27b97cfac1cf4)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:43.746075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a14ece-86a1-4c46-b133-d878d3eed7c0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:44.814613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-54a14ece-86a1-4c46-b133-d878d3eed7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1b4d42f1da4766abd27b97cfac1cf4', 'request_id': 'req-54a14ece-86a1-4c46-b133-d878d3eed7c0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:44.918624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-54a14ece-86a1-4c46-b133-d878d3eed7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1b4d42f1da4766abd27b97cfac1cf4', 'request_id': 'req-54a14ece-86a1-4c46-b133-d878d3eed7c0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:44.928770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-54a14ece-86a1-4c46-b133-d878d3eed7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1b4d42f1da4766abd27b97cfac1cf4', 'request_id': 'req-54a14ece-86a1-4c46-b133-d878d3eed7c0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:44.972029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-54a14ece-86a1-4c46-b133-d878d3eed7c0 admin admin] The token cache is being invalidate because project 3b1b4d42f1da4766abd27b97cfac1cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:44.972536 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-54a14ece-86a1-4c46-b133-d878d3eed7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:44.973354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-54a14ece-86a1-4c46-b133-d878d3eed7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:44.977346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1159/2297] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:43 2022] DELETE /identity/v3/projects/3b1b4d42f1da4766abd27b97cfac1cf4 => generated 0 bytes in 1275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:45.565599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:47.325372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:47.930398 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:50.134738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a5f6b-3b8d-477b-af53-1739a58be9d2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:50.135571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a5f6b-3b8d-477b-af53-1739a58be9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:50.135571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a5f6b-3b8d-477b-af53-1739a58be9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:50.161573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-627a5f6b-3b8d-477b-af53-1739a58be9d2 None None] MFA Rules not processed for user `384846a5204f484a8e5bf2c8c85d08e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:50.162926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-627a5f6b-3b8d-477b-af53-1739a58be9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:50.253266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1139/2298] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:50.835725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:51.395726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=8 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:52.218506 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46ad8b-72a3-4372-bf11-c171ccfad243 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:52.218506 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46ad8b-72a3-4372-bf11-c171ccfad243 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:52.218506 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46ad8b-72a3-4372-bf11-c171ccfad243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:52.239655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8d46ad8b-72a3-4372-bf11-c171ccfad243 None None] MFA Rules not processed for user `a46612adeaa0450d94c0e10eb385d083`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:52.241095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8d46ad8b-72a3-4372-bf11-c171ccfad243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:52.309826 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1160/2299] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:37:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:53.814220 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034b630-85b8-48f3-b2bd-eb672f23c898 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:53.817452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034b630-85b8-48f3-b2bd-eb672f23c898 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:53.817452 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034b630-85b8-48f3-b2bd-eb672f23c898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:53.835541 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c034b630-85b8-48f3-b2bd-eb672f23c898 None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:53.837103 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c034b630-85b8-48f3-b2bd-eb672f23c898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:53.906935 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1140/2300] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 20 19:37:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:53.921798 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46ad8b-72a3-4372-bf11-c171ccfad243 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:53.923408 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8d46ad8b-72a3-4372-bf11-c171ccfad243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:54.066007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46ad8b-72a3-4372-bf11-c171ccfad243 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:54.074409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217e113-adf2-45a3-8825-650f3ae12765 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:54.075551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217e113-adf2-45a3-8825-650f3ae12765 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:54.075661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217e113-adf2-45a3-8825-650f3ae12765 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:54.075940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217e113-adf2-45a3-8825-650f3ae12765 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:54.085410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217e113-adf2-45a3-8825-650f3ae12765 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:54.087761 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217e113-adf2-45a3-8825-650f3ae12765 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:54.100103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1161/2301] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:37:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:37:54.951168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:55.332558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc0141-832e-4f96-8d40-24f5686de42d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:55.332842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc0141-832e-4f96-8d40-24f5686de42d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:55.333309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc0141-832e-4f96-8d40-24f5686de42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:55.370436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f8cc0141-832e-4f96-8d40-24f5686de42d None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:55.373278 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f8cc0141-832e-4f96-8d40-24f5686de42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:55.391908 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1141/2302] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 20 19:37:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:55.402641 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:55.410010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217e113-adf2-45a3-8825-650f3ae12765 service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:55.424884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217e113-adf2-45a3-8825-650f3ae12765 service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:55.435232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111ecb6-8f6f-46f6-994e-e744553ce1f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:55.436487 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111ecb6-8f6f-46f6-994e-e744553ce1f9 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:55.437414 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111ecb6-8f6f-46f6-994e-e744553ce1f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:55.438074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111ecb6-8f6f-46f6-994e-e744553ce1f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:55.452155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111ecb6-8f6f-46f6-994e-e744553ce1f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:55.454911 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111ecb6-8f6f-46f6-994e-e744553ce1f9 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:55.476155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1162/2303] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:37:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 19:37:58.855190 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:59.845740 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:01.298290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:01.729879 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:05.056760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:06.033020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:09.125488 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:09.192285 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc0141-832e-4f96-8d40-24f5686de42d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:09.193596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f8cc0141-832e-4f96-8d40-24f5686de42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:09.284830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc0141-832e-4f96-8d40-24f5686de42d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:09.307573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e402dc-94fd-4436-b5fc-ca69f08bbc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:09.308492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e402dc-94fd-4436-b5fc-ca69f08bbc20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:09.308770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e402dc-94fd-4436-b5fc-ca69f08bbc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:09.309047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e402dc-94fd-4436-b5fc-ca69f08bbc20 admin admin] PATH_INFO: `/v3/users/83646396ef9a48299025fcf1af4c22a3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:09.322337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e402dc-94fd-4436-b5fc-ca69f08bbc20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83646396ef9a48299025fcf1af4c22a3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:09.325863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e402dc-94fd-4436-b5fc-ca69f08bbc20 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:09.697444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-19e402dc-94fd-4436-b5fc-ca69f08bbc20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83646396ef9a48299025fcf1af4c22a3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:09.819886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-19e402dc-94fd-4436-b5fc-ca69f08bbc20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83646396ef9a48299025fcf1af4c22a3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:09.838287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-19e402dc-94fd-4436-b5fc-ca69f08bbc20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83646396ef9a48299025fcf1af4c22a3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:09.875314 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-19e402dc-94fd-4436-b5fc-ca69f08bbc20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83646396ef9a48299025fcf1af4c22a3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:09.881909 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-19e402dc-94fd-4436-b5fc-ca69f08bbc20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83646396ef9a48299025fcf1af4c22a3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:09.895096 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1142/2304] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:09 2022] DELETE /identity/v3/users/83646396ef9a48299025fcf1af4c22a3 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:09.901271 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c2136-7735-44ad-8436-87d8ece12264 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:09.902078 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c2136-7735-44ad-8436-87d8ece12264 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:09.902524 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c2136-7735-44ad-8436-87d8ece12264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:09.952428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-285c2136-7735-44ad-8436-87d8ece12264 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:09.955338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-285c2136-7735-44ad-8436-87d8ece12264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:09.989017 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:10.088407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1163/2305] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:10.097407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e402dc-94fd-4436-b5fc-ca69f08bbc20 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:10.100061 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-19e402dc-94fd-4436-b5fc-ca69f08bbc20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:10.338914 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e402dc-94fd-4436-b5fc-ca69f08bbc20 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:10.358558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96275f9-5b58-4dcf-a702-db3172a5e547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:10.359682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96275f9-5b58-4dcf-a702-db3172a5e547 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:10.360164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96275f9-5b58-4dcf-a702-db3172a5e547 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:10.360632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96275f9-5b58-4dcf-a702-db3172a5e547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:10.435202 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96275f9-5b58-4dcf-a702-db3172a5e547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:10.454301 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96275f9-5b58-4dcf-a702-db3172a5e547 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:10.519196 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1143/2306] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:11.303374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c2136-7735-44ad-8436-87d8ece12264 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:11.304883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-285c2136-7735-44ad-8436-87d8ece12264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:11.322840 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c2136-7735-44ad-8436-87d8ece12264 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:11.330066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b207df-4651-4c2d-b50f-fdd3db4e5ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:11.338775 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b207df-4651-4c2d-b50f-fdd3db4e5ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:11.339287 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b207df-4651-4c2d-b50f-fdd3db4e5ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:11.339707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b207df-4651-4c2d-b50f-fdd3db4e5ecc admin admin] PATH_INFO: `/v3/projects/0372a05205b54e7b9d1052c0f1e142bd` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:11.342418 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b207df-4651-4c2d-b50f-fdd3db4e5ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0372a05205b54e7b9d1052c0f1e142bd)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:11.344600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b207df-4651-4c2d-b50f-fdd3db4e5ecc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:11.577428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-77b207df-4651-4c2d-b50f-fdd3db4e5ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0372a05205b54e7b9d1052c0f1e142bd', 'request_id': 'req-77b207df-4651-4c2d-b50f-fdd3db4e5ecc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:11.755039 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-77b207df-4651-4c2d-b50f-fdd3db4e5ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0372a05205b54e7b9d1052c0f1e142bd', 'request_id': 'req-77b207df-4651-4c2d-b50f-fdd3db4e5ecc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:11.771838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-77b207df-4651-4c2d-b50f-fdd3db4e5ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0372a05205b54e7b9d1052c0f1e142bd', 'request_id': 'req-77b207df-4651-4c2d-b50f-fdd3db4e5ecc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:11.816424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-77b207df-4651-4c2d-b50f-fdd3db4e5ecc admin admin] The token cache is being invalidate because project 0372a05205b54e7b9d1052c0f1e142bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:11.816742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-77b207df-4651-4c2d-b50f-fdd3db4e5ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:11.817583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-77b207df-4651-4c2d-b50f-fdd3db4e5ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:11.820622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1164/2307] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:11 2022] DELETE /identity/v3/projects/0372a05205b54e7b9d1052c0f1e142bd => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:11.826564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc0fe6-dc53-4f3d-ad88-2ff48aa4133d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:11.827966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc0fe6-dc53-4f3d-ad88-2ff48aa4133d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:11.829322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc0fe6-dc53-4f3d-ad88-2ff48aa4133d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:11.882584 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cffc0fe6-dc53-4f3d-ad88-2ff48aa4133d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:11.885095 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cffc0fe6-dc53-4f3d-ad88-2ff48aa4133d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:11.990107 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:12.007125 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1144/2308] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:12.015735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb6b93-75ba-4cc0-9bf1-04813d6b550e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:12.026423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb6b93-75ba-4cc0-9bf1-04813d6b550e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:12.026423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb6b93-75ba-4cc0-9bf1-04813d6b550e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:12.038746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-89eb6b93-75ba-4cc0-9bf1-04813d6b550e None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:12.039975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-89eb6b93-75ba-4cc0-9bf1-04813d6b550e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:12.050779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1165/2309] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:12.061965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc0fe6-dc53-4f3d-ad88-2ff48aa4133d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:12.074523 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc0fe6-dc53-4f3d-ad88-2ff48aa4133d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:12.080672 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048894e5-ea22-4065-9a1d-f8802df7972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:12.081551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048894e5-ea22-4065-9a1d-f8802df7972e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:12.082000 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048894e5-ea22-4065-9a1d-f8802df7972e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:12.082429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048894e5-ea22-4065-9a1d-f8802df7972e admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:12.083353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048894e5-ea22-4065-9a1d-f8802df7972e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:38:12.083817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048894e5-ea22-4065-9a1d-f8802df7972e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:12.085693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048894e5-ea22-4065-9a1d-f8802df7972e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:12.100561 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1145/2310] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:38:12.105731 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb6b93-75ba-4cc0-9bf1-04813d6b550e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:12.117510 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb6b93-75ba-4cc0-9bf1-04813d6b550e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:12.123763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667bb65-25c4-416a-bc37-40d5e6f9d203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:12.124990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667bb65-25c4-416a-bc37-40d5e6f9d203 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:12.125374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667bb65-25c4-416a-bc37-40d5e6f9d203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:12.125723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667bb65-25c4-416a-bc37-40d5e6f9d203 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:12.126900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667bb65-25c4-416a-bc37-40d5e6f9d203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:12.129367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667bb65-25c4-416a-bc37-40d5e6f9d203 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:12.329955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1166/2311] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:38:12 2022] POST /identity/v3/projects => generated 373 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:12.331606 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048894e5-ea22-4065-9a1d-f8802df7972e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:12.351076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048894e5-ea22-4065-9a1d-f8802df7972e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:12.413775 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:12.486889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55a31f-abc7-480a-8c77-b73456fd8f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:12.487661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55a31f-abc7-480a-8c77-b73456fd8f8b admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:12.487986 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55a31f-abc7-480a-8c77-b73456fd8f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:12.488310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55a31f-abc7-480a-8c77-b73456fd8f8b admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:12.489190 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55a31f-abc7-480a-8c77-b73456fd8f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:12.491850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55a31f-abc7-480a-8c77-b73456fd8f8b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:12.658722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1146/2312] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:38:12 2022] POST /identity/v3/users => generated 287 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:12.659259 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667bb65-25c4-416a-bc37-40d5e6f9d203 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:12.673379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667bb65-25c4-416a-bc37-40d5e6f9d203 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:12.693714 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051f770-54dd-4721-8ca6-eac2b5d4bd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:12.693714 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f770-54dd-4721-8ca6-eac2b5d4bd80 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:12.694374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f770-54dd-4721-8ca6-eac2b5d4bd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:12.695474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f770-54dd-4721-8ca6-eac2b5d4bd80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:12.711642 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051f770-54dd-4721-8ca6-eac2b5d4bd80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:12.715387 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051f770-54dd-4721-8ca6-eac2b5d4bd80 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:12.749310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55a31f-abc7-480a-8c77-b73456fd8f8b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:12.750143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1167/2313] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:12.789951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55a31f-abc7-480a-8c77-b73456fd8f8b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:12.796515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16a7e7-b0c1-46b1-b1c8-0065222b5327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:12.797966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16a7e7-b0c1-46b1-b1c8-0065222b5327 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:12.800792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16a7e7-b0c1-46b1-b1c8-0065222b5327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:12.801083 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16a7e7-b0c1-46b1-b1c8-0065222b5327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:12.801866 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16a7e7-b0c1-46b1-b1c8-0065222b5327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:12.808172 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16a7e7-b0c1-46b1-b1c8-0065222b5327 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:12.830583 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051f770-54dd-4721-8ca6-eac2b5d4bd80 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:12.841030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1147/2314] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:38:12.846360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051f770-54dd-4721-8ca6-eac2b5d4bd80 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:12.854082 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55854dad-c3d6-4b7e-b5c0-040caa3b00e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:12.855889 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55854dad-c3d6-4b7e-b5c0-040caa3b00e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:12.856404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55854dad-c3d6-4b7e-b5c0-040caa3b00e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:12.858249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55854dad-c3d6-4b7e-b5c0-040caa3b00e5 admin admin] PATH_INFO: `/v3/projects/e1cce73eca1040ec8be16b60cfadfcf3/users/fc9fa6d6c6ff46809f0b5ed05f559187/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:12.899178 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55854dad-c3d6-4b7e-b5c0-040caa3b00e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1cce73eca1040ec8be16b60cfadfcf3, user_id=fc9fa6d6c6ff46809f0b5ed05f559187, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:12.911241 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55854dad-c3d6-4b7e-b5c0-040caa3b00e5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:13.111604 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1168/2315] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:12 2022] PUT /identity/v3/projects/e1cce73eca1040ec8be16b60cfadfcf3/users/fc9fa6d6c6ff46809f0b5ed05f559187/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:38:13.121987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a94de8-c21f-47de-b523-c0a50910f268 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:13.122277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a94de8-c21f-47de-b523-c0a50910f268 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:13.122571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a94de8-c21f-47de-b523-c0a50910f268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:13.151422 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-45a94de8-c21f-47de-b523-c0a50910f268 None None] MFA Rules not processed for user `fc9fa6d6c6ff46809f0b5ed05f559187`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:13.152655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-45a94de8-c21f-47de-b523-c0a50910f268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:13.219091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1148/2316] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:13.229667 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55854dad-c3d6-4b7e-b5c0-040caa3b00e5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:13.231359 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-55854dad-c3d6-4b7e-b5c0-040caa3b00e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:13.289336 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55854dad-c3d6-4b7e-b5c0-040caa3b00e5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:13.293364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda7b75-a055-49ca-a404-53f5e5c7f3af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:13.294045 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda7b75-a055-49ca-a404-53f5e5c7f3af service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:13.294324 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda7b75-a055-49ca-a404-53f5e5c7f3af service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:13.294596 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda7b75-a055-49ca-a404-53f5e5c7f3af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:13.304275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda7b75-a055-49ca-a404-53f5e5c7f3af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:13.305706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda7b75-a055-49ca-a404-53f5e5c7f3af service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:13.319265 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1169/2317] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:14.240891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:14.880788 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:16.562506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:16.694358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:18.050614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:18.373555 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:18.951113 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a94de8-c21f-47de-b523-c0a50910f268 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:18.953450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-45a94de8-c21f-47de-b523-c0a50910f268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:19.048276 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a94de8-c21f-47de-b523-c0a50910f268 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:19.053143 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d18e7-0a4c-460a-b08e-37c7ca8781c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:19.054035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d18e7-0a4c-460a-b08e-37c7ca8781c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:19.054505 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d18e7-0a4c-460a-b08e-37c7ca8781c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:19.054814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d18e7-0a4c-460a-b08e-37c7ca8781c8 admin admin] PATH_INFO: `/v3/users/3da8db4043a642ac8bfcf01e7c0a6d3b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:19.056231 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d18e7-0a4c-460a-b08e-37c7ca8781c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da8db4043a642ac8bfcf01e7c0a6d3b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:19.058184 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d18e7-0a4c-460a-b08e-37c7ca8781c8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:19.277611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d76d18e7-0a4c-460a-b08e-37c7ca8781c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da8db4043a642ac8bfcf01e7c0a6d3b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:19.350315 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d76d18e7-0a4c-460a-b08e-37c7ca8781c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da8db4043a642ac8bfcf01e7c0a6d3b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:19.362855 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d76d18e7-0a4c-460a-b08e-37c7ca8781c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da8db4043a642ac8bfcf01e7c0a6d3b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:19.382447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d76d18e7-0a4c-460a-b08e-37c7ca8781c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da8db4043a642ac8bfcf01e7c0a6d3b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:19.389584 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d76d18e7-0a4c-460a-b08e-37c7ca8781c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da8db4043a642ac8bfcf01e7c0a6d3b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:19.395237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1149/2318] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:18 2022] DELETE /identity/v3/users/3da8db4043a642ac8bfcf01e7c0a6d3b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:19.400720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e6e92-4d87-4a4d-9170-9918c526a2cd None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:19.401749 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e6e92-4d87-4a4d-9170-9918c526a2cd None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:19.402180 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e6e92-4d87-4a4d-9170-9918c526a2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:19.424098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-266e6e92-4d87-4a4d-9170-9918c526a2cd None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:19.425378 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-266e6e92-4d87-4a4d-9170-9918c526a2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:19.509972 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1170/2319] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:19.530065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d18e7-0a4c-460a-b08e-37c7ca8781c8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:19.533179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d76d18e7-0a4c-460a-b08e-37c7ca8781c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:19.668939 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d18e7-0a4c-460a-b08e-37c7ca8781c8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:19.674916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440aded-1ca5-4a02-ac69-0cf84a59fcae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:19.675774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440aded-1ca5-4a02-ac69-0cf84a59fcae service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:19.676253 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440aded-1ca5-4a02-ac69-0cf84a59fcae service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:19.676734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440aded-1ca5-4a02-ac69-0cf84a59fcae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:19.690790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440aded-1ca5-4a02-ac69-0cf84a59fcae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:19.693030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440aded-1ca5-4a02-ac69-0cf84a59fcae service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:19.715028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1150/2320] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:19.885337 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0ea6e-70fb-495d-b0f4-2157675d6002 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:19.885628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0ea6e-70fb-495d-b0f4-2157675d6002 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:19.885628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0ea6e-70fb-495d-b0f4-2157675d6002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:19.909541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-dec0ea6e-70fb-495d-b0f4-2157675d6002 None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:19.911610 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dec0ea6e-70fb-495d-b0f4-2157675d6002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:20.001554 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1171/2321] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 20 19:38:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:20.021139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440aded-1ca5-4a02-ac69-0cf84a59fcae service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:20.023067 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a440aded-1ca5-4a02-ac69-0cf84a59fcae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:20.125993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440aded-1ca5-4a02-ac69-0cf84a59fcae service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:20.132537 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83664ef4-185f-4a72-a5c4-da25b47f5c10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:20.133500 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83664ef4-185f-4a72-a5c4-da25b47f5c10 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:20.133898 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83664ef4-185f-4a72-a5c4-da25b47f5c10 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:20.134269 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83664ef4-185f-4a72-a5c4-da25b47f5c10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:20.146100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83664ef4-185f-4a72-a5c4-da25b47f5c10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:20.148809 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83664ef4-185f-4a72-a5c4-da25b47f5c10 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:20.160404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1151/2322] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:38:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:38:20.220126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:20.455951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0ea6e-70fb-495d-b0f4-2157675d6002 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:20.461253 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dec0ea6e-70fb-495d-b0f4-2157675d6002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:20.529081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0ea6e-70fb-495d-b0f4-2157675d6002 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:20.537125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e25e5-828e-4d51-9860-2bb1eeb75a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:20.538948 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e25e5-828e-4d51-9860-2bb1eeb75a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:20.539490 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e25e5-828e-4d51-9860-2bb1eeb75a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:20.539967 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e25e5-828e-4d51-9860-2bb1eeb75a01 admin admin] PATH_INFO: `/v3/projects/6fb435b3ec2e4b1995325a4e23b489d5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:20.541657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e25e5-828e-4d51-9860-2bb1eeb75a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb435b3ec2e4b1995325a4e23b489d5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:20.545178 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e25e5-828e-4d51-9860-2bb1eeb75a01 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:21.324456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-597e25e5-828e-4d51-9860-2bb1eeb75a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb435b3ec2e4b1995325a4e23b489d5', 'request_id': 'req-597e25e5-828e-4d51-9860-2bb1eeb75a01'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:21.414243 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-597e25e5-828e-4d51-9860-2bb1eeb75a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb435b3ec2e4b1995325a4e23b489d5', 'request_id': 'req-597e25e5-828e-4d51-9860-2bb1eeb75a01'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:21.425664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-597e25e5-828e-4d51-9860-2bb1eeb75a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb435b3ec2e4b1995325a4e23b489d5', 'request_id': 'req-597e25e5-828e-4d51-9860-2bb1eeb75a01'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:21.445941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-597e25e5-828e-4d51-9860-2bb1eeb75a01 admin admin] The token cache is being invalidate because project 6fb435b3ec2e4b1995325a4e23b489d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:21.448067 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-597e25e5-828e-4d51-9860-2bb1eeb75a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:21.449870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:21.451027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-597e25e5-828e-4d51-9860-2bb1eeb75a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:21.455794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1172/2323] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:20 2022] DELETE /identity/v3/projects/6fb435b3ec2e4b1995325a4e23b489d5 => generated 0 bytes in 1000 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:21.459735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83664ef4-185f-4a72-a5c4-da25b47f5c10 service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:21.480239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83664ef4-185f-4a72-a5c4-da25b47f5c10 service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:21.627479 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393309f4-691d-4f61-8c0d-acb5323545c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:21.629460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393309f4-691d-4f61-8c0d-acb5323545c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:21.633164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393309f4-691d-4f61-8c0d-acb5323545c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:21.633164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393309f4-691d-4f61-8c0d-acb5323545c2 admin admin] PATH_INFO: `/v3/users/1b14a04af1614da386932835f1af08c3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:21.633164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393309f4-691d-4f61-8c0d-acb5323545c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b14a04af1614da386932835f1af08c3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:21.642689 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393309f4-691d-4f61-8c0d-acb5323545c2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:21.914300 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-393309f4-691d-4f61-8c0d-acb5323545c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b14a04af1614da386932835f1af08c3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:22.002615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-393309f4-691d-4f61-8c0d-acb5323545c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b14a04af1614da386932835f1af08c3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:22.012218 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-393309f4-691d-4f61-8c0d-acb5323545c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b14a04af1614da386932835f1af08c3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:22.051942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-393309f4-691d-4f61-8c0d-acb5323545c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b14a04af1614da386932835f1af08c3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:22.051942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-393309f4-691d-4f61-8c0d-acb5323545c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b14a04af1614da386932835f1af08c3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:22.058078 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1152/2324] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:21 2022] DELETE /identity/v3/users/1b14a04af1614da386932835f1af08c3 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:22.323617 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77660f19-4c9d-4879-a4a9-051331945a50 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:22.324186 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77660f19-4c9d-4879-a4a9-051331945a50 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:22.324186 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77660f19-4c9d-4879-a4a9-051331945a50 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:22.326014 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1173/2325] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 20 19:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:38:22.337501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71b9d-8d6b-4839-9933-b1d2847e05c8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:22.340194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71b9d-8d6b-4839-9933-b1d2847e05c8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:22.340194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71b9d-8d6b-4839-9933-b1d2847e05c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:22.388077 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ceb71b9d-8d6b-4839-9933-b1d2847e05c8 None None] MFA Rules not processed for user `e3fd38ebb5514af686204d0b02a91edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:22.394293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ceb71b9d-8d6b-4839-9933-b1d2847e05c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:22.503106 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:22.536482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1153/2326] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 20 19:38:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:38:22.544340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77660f19-4c9d-4879-a4a9-051331945a50 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:22.545716 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-77660f19-4c9d-4879-a4a9-051331945a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:22.770165 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77660f19-4c9d-4879-a4a9-051331945a50 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:22.779980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c856457-1c7f-40f9-8a36-4c93def218b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc7e1bc2eb943eba57a0009635de70d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:22.781053 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c856457-1c7f-40f9-8a36-4c93def218b7 service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:22.781897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c856457-1c7f-40f9-8a36-4c93def218b7 service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:22.783021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c856457-1c7f-40f9-8a36-4c93def218b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:22.812033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c856457-1c7f-40f9-8a36-4c93def218b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:22.817210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c856457-1c7f-40f9-8a36-4c93def218b7 service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:22.865549 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1174/2327] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:23.019373 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb71b9d-8d6b-4839-9933-b1d2847e05c8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:23.020835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ceb71b9d-8d6b-4839-9933-b1d2847e05c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:23.130275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb71b9d-8d6b-4839-9933-b1d2847e05c8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:23.139124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da148c1-06e3-4d72-9b38-c96d11b5d5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:23.140604 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da148c1-06e3-4d72-9b38-c96d11b5d5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:23.141868 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da148c1-06e3-4d72-9b38-c96d11b5d5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:23.142586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da148c1-06e3-4d72-9b38-c96d11b5d5fd admin admin] PATH_INFO: `/v3/projects/5e88e2073c39447aa4e6b695b70b7d20` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:23.156908 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da148c1-06e3-4d72-9b38-c96d11b5d5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e88e2073c39447aa4e6b695b70b7d20)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:23.161102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da148c1-06e3-4d72-9b38-c96d11b5d5fd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:23.221372 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054bbbc-230b-4742-81f2-c2a79507bbd7 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:23.222055 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054bbbc-230b-4742-81f2-c2a79507bbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:23.222055 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054bbbc-230b-4742-81f2-c2a79507bbd7 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:23.223383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1175/2328] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 20 19:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:38:23.230948 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45db8da-1c03-4d1e-86a1-ca0ca43b0102 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:23.231415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45db8da-1c03-4d1e-86a1-ca0ca43b0102 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:23.231848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45db8da-1c03-4d1e-86a1-ca0ca43b0102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:23.283244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d45db8da-1c03-4d1e-86a1-ca0ca43b0102 None None] MFA Rules not processed for user `454b9259519c4332a8a36131c8273786`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:23.287300 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d45db8da-1c03-4d1e-86a1-ca0ca43b0102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:23.396223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:23.399316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7da148c1-06e3-4d72-9b38-c96d11b5d5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e88e2073c39447aa4e6b695b70b7d20', 'request_id': 'req-7da148c1-06e3-4d72-9b38-c96d11b5d5fd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:23.401552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1176/2329] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 20 19:38:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:38:23.409312 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7da148c1-06e3-4d72-9b38-c96d11b5d5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e88e2073c39447aa4e6b695b70b7d20', 'request_id': 'req-7da148c1-06e3-4d72-9b38-c96d11b5d5fd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:23.419044 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45db8da-1c03-4d1e-86a1-ca0ca43b0102 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:23.425525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d45db8da-1c03-4d1e-86a1-ca0ca43b0102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:23.440767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45db8da-1c03-4d1e-86a1-ca0ca43b0102 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:23.494974 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7da148c1-06e3-4d72-9b38-c96d11b5d5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e88e2073c39447aa4e6b695b70b7d20', 'request_id': 'req-7da148c1-06e3-4d72-9b38-c96d11b5d5fd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:23.512421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7da148c1-06e3-4d72-9b38-c96d11b5d5fd admin admin] The token cache is being invalidate because project 5e88e2073c39447aa4e6b695b70b7d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:23.513431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7da148c1-06e3-4d72-9b38-c96d11b5d5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:23.513431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7da148c1-06e3-4d72-9b38-c96d11b5d5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:23.526000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7435878-4f3c-463a-9682-26b3e3ca1663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:23.527065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7435878-4f3c-463a-9682-26b3e3ca1663 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:23.527512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7435878-4f3c-463a-9682-26b3e3ca1663 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:23.527928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7435878-4f3c-463a-9682-26b3e3ca1663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:23.530034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f7435878-4f3c-463a-9682-26b3e3ca1663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:23.535385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1154/2330] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:23 2022] DELETE /identity/v3/projects/5e88e2073c39447aa4e6b695b70b7d20 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:23.537752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c06eeb-7170-4607-9ac5-191428c3fd72 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:23.537752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c06eeb-7170-4607-9ac5-191428c3fd72 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:23.537752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c06eeb-7170-4607-9ac5-191428c3fd72 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:23.539409 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1155/2331] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 20 19:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:38:23.544533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5eb570-b1d0-47f3-97cf-a1c252975c3b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:23.544533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5eb570-b1d0-47f3-97cf-a1c252975c3b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:23.544533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5eb570-b1d0-47f3-97cf-a1c252975c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:23.544950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7435878-4f3c-463a-9682-26b3e3ca1663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:23.544950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7435878-4f3c-463a-9682-26b3e3ca1663 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:23.558822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1177/2332] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:23.571253 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5b5eb570-b1d0-47f3-97cf-a1c252975c3b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:23.573146 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5b5eb570-b1d0-47f3-97cf-a1c252975c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:23.669215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683f8f5-2ec9-42ba-8675-fdab105812ad None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:23.669597 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683f8f5-2ec9-42ba-8675-fdab105812ad None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:23.669999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683f8f5-2ec9-42ba-8675-fdab105812ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:23.739154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a683f8f5-2ec9-42ba-8675-fdab105812ad None None] MFA Rules not processed for user `dbc616ed904d43d2b160b8d2766f7bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:23.739154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a683f8f5-2ec9-42ba-8675-fdab105812ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:23.767928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1156/2333] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:23.783857 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5ed41-0f87-42ca-9a80-2d60de0e5bac None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:23.784735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5ed41-0f87-42ca-9a80-2d60de0e5bac None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:23.784735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5ed41-0f87-42ca-9a80-2d60de0e5bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:23.900882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-88e5ed41-0f87-42ca-9a80-2d60de0e5bac None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:23.902123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-88e5ed41-0f87-42ca-9a80-2d60de0e5bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:23.952751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1157/2334] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:23.952751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d42d0-2317-4305-93fe-73a48282c62b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:23.952751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d42d0-2317-4305-93fe-73a48282c62b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:23.952751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d42d0-2317-4305-93fe-73a48282c62b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:23.973046 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1158/2335] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 20 19:38:23 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:38:23.975906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d42d0-2317-4305-93fe-73a48282c62b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:24.015175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:24.023544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d42d0-2317-4305-93fe-73a48282c62b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:24.041199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1178/2336] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 20 19:38:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:38:24.045095 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180d613-8004-4bff-9f7e-ff80111a9d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:24.046529 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78de2d-71a2-456a-b07c-0f95382daeee None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:24.050353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180d613-8004-4bff-9f7e-ff80111a9d39 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:24.051272 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78de2d-71a2-456a-b07c-0f95382daeee None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:24.052066 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180d613-8004-4bff-9f7e-ff80111a9d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:24.052452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78de2d-71a2-456a-b07c-0f95382daeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:24.063938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180d613-8004-4bff-9f7e-ff80111a9d39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:24.073891 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180d613-8004-4bff-9f7e-ff80111a9d39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:38:24.074418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180d613-8004-4bff-9f7e-ff80111a9d39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:24.082164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180d613-8004-4bff-9f7e-ff80111a9d39 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:24.119292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1159/2337] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:38:24.120401 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180d613-8004-4bff-9f7e-ff80111a9d39 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:24.125349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2180d613-8004-4bff-9f7e-ff80111a9d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:24.165912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bf78de2d-71a2-456a-b07c-0f95382daeee None None] MFA Rules not processed for user `e3fd38ebb5514af686204d0b02a91edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:24.176900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:24.179955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bf78de2d-71a2-456a-b07c-0f95382daeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:24.189791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180d613-8004-4bff-9f7e-ff80111a9d39 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:24.205628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad05fba-2abc-4d46-a64e-a4a3ac48b533 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc616ed904d43d2b160b8d2766f7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:24.207589 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad05fba-2abc-4d46-a64e-a4a3ac48b533 service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:24.208001 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad05fba-2abc-4d46-a64e-a4a3ac48b533 service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:24.208414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad05fba-2abc-4d46-a64e-a4a3ac48b533 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:24.240750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad05fba-2abc-4d46-a64e-a4a3ac48b533 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:24.246034 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad05fba-2abc-4d46-a64e-a4a3ac48b533 service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:24.276929 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1160/2338] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:24.306227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad05fba-2abc-4d46-a64e-a4a3ac48b533 service placement] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:24.337225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad05fba-2abc-4d46-a64e-a4a3ac48b533 service placement] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:24.354524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7843560-729a-4f3d-b29a-78e468cc9b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:24.355488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7843560-729a-4f3d-b29a-78e468cc9b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:24.355924 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7843560-729a-4f3d-b29a-78e468cc9b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:24.356304 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7843560-729a-4f3d-b29a-78e468cc9b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:24.357361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7843560-729a-4f3d-b29a-78e468cc9b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:24.361544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7843560-729a-4f3d-b29a-78e468cc9b27 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:24.422698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1179/2339] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 20 19:38:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:24.441968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78de2d-71a2-456a-b07c-0f95382daeee None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:24.444278 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bf78de2d-71a2-456a-b07c-0f95382daeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:24.466161 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78de2d-71a2-456a-b07c-0f95382daeee None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:24.472423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadd987-f380-460f-a482-7dfba7be0ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:24.473261 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadd987-f380-460f-a482-7dfba7be0ceb service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:24.473670 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadd987-f380-460f-a482-7dfba7be0ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:24.473950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadd987-f380-460f-a482-7dfba7be0ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:24.492023 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadd987-f380-460f-a482-7dfba7be0ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:24.497334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadd987-f380-460f-a482-7dfba7be0ceb service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:24.509664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1180/2340] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:24.528863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1161/2341] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:38:24 2022] POST /identity/v3/projects => generated 373 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:24.536161 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadd987-f380-460f-a482-7dfba7be0ceb service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:24.551795 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadd987-f380-460f-a482-7dfba7be0ceb service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:24.745928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c5500-d068-4b32-8b9a-18dac2328923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:24.747275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5500-d068-4b32-8b9a-18dac2328923 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:24.747678 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5500-d068-4b32-8b9a-18dac2328923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:24.748071 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5500-d068-4b32-8b9a-18dac2328923 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:24.749105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c5500-d068-4b32-8b9a-18dac2328923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:24.756262 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c5500-d068-4b32-8b9a-18dac2328923 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:24.912476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1181/2342] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:38:24 2022] POST /identity/v3/users => generated 287 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:38:24.918983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7843560-729a-4f3d-b29a-78e468cc9b27 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:24.942091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7843560-729a-4f3d-b29a-78e468cc9b27 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:24.947809 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a82c34-1b72-479c-8f94-325723f929cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:24.948808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a82c34-1b72-479c-8f94-325723f929cb admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:24.949385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a82c34-1b72-479c-8f94-325723f929cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:24.950848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a82c34-1b72-479c-8f94-325723f929cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:24.952731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a82c34-1b72-479c-8f94-325723f929cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:24.963299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a82c34-1b72-479c-8f94-325723f929cb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:24.978892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1162/2343] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:24.985906 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c5500-d068-4b32-8b9a-18dac2328923 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:25.027562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c5500-d068-4b32-8b9a-18dac2328923 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:25.048322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009731f-d671-4652-a90d-f4d67e13e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:25.050560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009731f-d671-4652-a90d-f4d67e13e9ed admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:25.050887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009731f-d671-4652-a90d-f4d67e13e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:25.051150 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009731f-d671-4652-a90d-f4d67e13e9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:25.056488 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009731f-d671-4652-a90d-f4d67e13e9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:25.082922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009731f-d671-4652-a90d-f4d67e13e9ed admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:25.120858 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:25.132421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a82c34-1b72-479c-8f94-325723f929cb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:25.133086 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1182/2344] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:25.149944 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a82c34-1b72-479c-8f94-325723f929cb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:25.165311 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c2230-58f6-4ffc-b607-05e0f181d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:25.166277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c2230-58f6-4ffc-b607-05e0f181d5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:25.166660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c2230-58f6-4ffc-b607-05e0f181d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:25.170252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c2230-58f6-4ffc-b607-05e0f181d5b9 admin admin] PATH_INFO: `/v3/projects/689b094080e1473bbb8f11dc33dcaf16/users/87634b2648e74406b04af168a7da72ca/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:25.235679 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c2230-58f6-4ffc-b607-05e0f181d5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689b094080e1473bbb8f11dc33dcaf16, user_id=87634b2648e74406b04af168a7da72ca, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:25.243026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c2230-58f6-4ffc-b607-05e0f181d5b9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:25.335447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:25.338714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1163/2345] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:25 2022] PUT /identity/v3/projects/689b094080e1473bbb8f11dc33dcaf16/users/87634b2648e74406b04af168a7da72ca/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:25.352202 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37d57a-8706-4057-99bd-97815010faee None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:25.352686 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37d57a-8706-4057-99bd-97815010faee None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:25.353026 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37d57a-8706-4057-99bd-97815010faee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:25.451473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-df37d57a-8706-4057-99bd-97815010faee None None] MFA Rules not processed for user `87634b2648e74406b04af168a7da72ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:25.453705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-df37d57a-8706-4057-99bd-97815010faee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:25.606024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1183/2346] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:25.617235 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c2230-58f6-4ffc-b607-05e0f181d5b9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:25.909324 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c2230-58f6-4ffc-b607-05e0f181d5b9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:25.931519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a95b5-45e4-4ece-9e33-f00aea512cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:25.932220 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a95b5-45e4-4ece-9e33-f00aea512cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:25.932535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a95b5-45e4-4ece-9e33-f00aea512cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:25.932778 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a95b5-45e4-4ece-9e33-f00aea512cb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:25.933513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a95b5-45e4-4ece-9e33-f00aea512cb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:25.936874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a95b5-45e4-4ece-9e33-f00aea512cb3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:26.091880 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1164/2347] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:38:25 2022] POST /identity/v3/projects => generated 373 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:26.098316 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37d57a-8706-4057-99bd-97815010faee None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:26.117924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37d57a-8706-4057-99bd-97815010faee None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:26.221234 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a95b5-45e4-4ece-9e33-f00aea512cb3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:26.223448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-796a95b5-45e4-4ece-9e33-f00aea512cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:26.260448 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1722da-f234-4c08-a3fa-11928c42c548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:26.261146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1722da-f234-4c08-a3fa-11928c42c548 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:26.261797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1722da-f234-4c08-a3fa-11928c42c548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:26.262243 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1722da-f234-4c08-a3fa-11928c42c548 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:26.262993 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1722da-f234-4c08-a3fa-11928c42c548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:26.277575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1722da-f234-4c08-a3fa-11928c42c548 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:26.308890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:26.380075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a95b5-45e4-4ece-9e33-f00aea512cb3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:26.385415 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9b811-f0d2-4e52-9a46-b0d6ba6ccc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:26.386379 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9b811-f0d2-4e52-9a46-b0d6ba6ccc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:26.386665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9b811-f0d2-4e52-9a46-b0d6ba6ccc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:26.387161 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9b811-f0d2-4e52-9a46-b0d6ba6ccc88 admin admin] PATH_INFO: `/v3/users/9af15e811258481ba8244c596c3eef21` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:26.388519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9b811-f0d2-4e52-9a46-b0d6ba6ccc88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af15e811258481ba8244c596c3eef21)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:26.391229 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9b811-f0d2-4e52-9a46-b0d6ba6ccc88 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:26.439651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1184/2348] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:38:26 2022] POST /identity/v3/users => generated 293 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:26.439651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1722da-f234-4c08-a3fa-11928c42c548 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:26.473408 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1722da-f234-4c08-a3fa-11928c42c548 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:26.489404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e6695-8363-4d19-98aa-876dc61dac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:26.490534 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e6695-8363-4d19-98aa-876dc61dac01 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:26.491434 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e6695-8363-4d19-98aa-876dc61dac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:26.491887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e6695-8363-4d19-98aa-876dc61dac01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:26.493737 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e6695-8363-4d19-98aa-876dc61dac01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:26.495660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e6695-8363-4d19-98aa-876dc61dac01 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:26.512670 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1185/2349] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:38:26.515591 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e6695-8363-4d19-98aa-876dc61dac01 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:26.556770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e6695-8363-4d19-98aa-876dc61dac01 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:26.564888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0d680-8458-49bd-b433-0efdad770240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:26.565876 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0d680-8458-49bd-b433-0efdad770240 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:26.566156 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0d680-8458-49bd-b433-0efdad770240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:26.566437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0d680-8458-49bd-b433-0efdad770240 admin admin] PATH_INFO: `/v3/projects/630a5178f8ba40d287fc98e707d849a9/users/961cbf64af0146bcaeb0abdda6b7c996/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:26.613577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0d680-8458-49bd-b433-0efdad770240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630a5178f8ba40d287fc98e707d849a9, user_id=961cbf64af0146bcaeb0abdda6b7c996, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:26.622204 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0d680-8458-49bd-b433-0efdad770240 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:26.659833 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cdf9b811-f0d2-4e52-9a46-b0d6ba6ccc88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af15e811258481ba8244c596c3eef21'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:26.669485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:26.763566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1186/2350] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:26 2022] PUT /identity/v3/projects/630a5178f8ba40d287fc98e707d849a9/users/961cbf64af0146bcaeb0abdda6b7c996/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:26.769437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0d680-8458-49bd-b433-0efdad770240 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:26.783149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cdf9b811-f0d2-4e52-9a46-b0d6ba6ccc88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af15e811258481ba8244c596c3eef21'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:26.806506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cdf9b811-f0d2-4e52-9a46-b0d6ba6ccc88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af15e811258481ba8244c596c3eef21'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:26.902232 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cdf9b811-f0d2-4e52-9a46-b0d6ba6ccc88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af15e811258481ba8244c596c3eef21'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:26.904685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-cdf9b811-f0d2-4e52-9a46-b0d6ba6ccc88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af15e811258481ba8244c596c3eef21'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:26.955992 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1165/2351] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:26 2022] DELETE /identity/v3/users/9af15e811258481ba8244c596c3eef21 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:38:26.959371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0d680-8458-49bd-b433-0efdad770240 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:27.080994 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c6b4f-70d7-472a-970c-2bd25f9d8df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:27.084749 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c6b4f-70d7-472a-970c-2bd25f9d8df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:27.085235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c6b4f-70d7-472a-970c-2bd25f9d8df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:27.085757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c6b4f-70d7-472a-970c-2bd25f9d8df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:27.086772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c6b4f-70d7-472a-970c-2bd25f9d8df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:27.089153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c6b4f-70d7-472a-970c-2bd25f9d8df6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:27.110340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1187/2352] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:27.112037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9b811-f0d2-4e52-9a46-b0d6ba6ccc88 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:27.114213 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cdf9b811-f0d2-4e52-9a46-b0d6ba6ccc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:27.147894 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9b811-f0d2-4e52-9a46-b0d6ba6ccc88 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:27.160013 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7d9a2-b83f-4e4e-87f2-d8849e008497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:27.161307 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7d9a2-b83f-4e4e-87f2-d8849e008497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:27.161792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7d9a2-b83f-4e4e-87f2-d8849e008497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:27.162599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7d9a2-b83f-4e4e-87f2-d8849e008497 admin admin] PATH_INFO: `/v3/projects/630a5178f8ba40d287fc98e707d849a9/users/961cbf64af0146bcaeb0abdda6b7c996/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:27.171466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7d9a2-b83f-4e4e-87f2-d8849e008497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630a5178f8ba40d287fc98e707d849a9, user_id=961cbf64af0146bcaeb0abdda6b7c996, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:27.179244 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7d9a2-b83f-4e4e-87f2-d8849e008497 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:27.198243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1166/2353] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:27 2022] PUT /identity/v3/projects/630a5178f8ba40d287fc98e707d849a9/users/961cbf64af0146bcaeb0abdda6b7c996/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:27.213539 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ac497-5a0c-4a69-a27e-78462e9b0153 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:27.216545 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ac497-5a0c-4a69-a27e-78462e9b0153 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:27.216545 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ac497-5a0c-4a69-a27e-78462e9b0153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:27.278462 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-538ac497-5a0c-4a69-a27e-78462e9b0153 None None] MFA Rules not processed for user `961cbf64af0146bcaeb0abdda6b7c996`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:27.280289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-538ac497-5a0c-4a69-a27e-78462e9b0153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:27.313188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:27.505767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7d9a2-b83f-4e4e-87f2-d8849e008497 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:27.511896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1188/2354] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:27.512633 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-01f7d9a2-b83f-4e4e-87f2-d8849e008497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:27.619502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7d9a2-b83f-4e4e-87f2-d8849e008497 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:27.625067 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be061ba-e574-49a6-b4bd-5698926d15b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:27.625751 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be061ba-e574-49a6-b4bd-5698926d15b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:27.626028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be061ba-e574-49a6-b4bd-5698926d15b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:27.626200 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be061ba-e574-49a6-b4bd-5698926d15b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:27.638711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be061ba-e574-49a6-b4bd-5698926d15b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:27.640346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be061ba-e574-49a6-b4bd-5698926d15b7 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:27.667021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1167/2355] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:27.729471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ac497-5a0c-4a69-a27e-78462e9b0153 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:27.731564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-538ac497-5a0c-4a69-a27e-78462e9b0153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:27.876704 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ac497-5a0c-4a69-a27e-78462e9b0153 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:27.885001 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:27.886512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:27.886891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:27.887248 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3 admin admin] PATH_INFO: `/v3/projects/10e2a2f79e7946fe879b5b3f3fb3b799` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:27.888676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e2a2f79e7946fe879b5b3f3fb3b799)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:27.893998 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:28.056496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:28.090292 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e2a2f79e7946fe879b5b3f3fb3b799', 'request_id': 'req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:28.117294 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:28.239674 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e2a2f79e7946fe879b5b3f3fb3b799', 'request_id': 'req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:28.249635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e2a2f79e7946fe879b5b3f3fb3b799', 'request_id': 'req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:28.312758 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3 admin admin] The token cache is being invalidate because project 10e2a2f79e7946fe879b5b3f3fb3b799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:28.313809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:28.318904 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:28.321169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1189/2356] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:27 2022] DELETE /identity/v3/projects/10e2a2f79e7946fe879b5b3f3fb3b799 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:28.326850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be061ba-e574-49a6-b4bd-5698926d15b7 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:28.351301 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be061ba-e574-49a6-b4bd-5698926d15b7 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:28.606246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868f010-bb91-432f-a9dc-fad9f9f516fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:28.607707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868f010-bb91-432f-a9dc-fad9f9f516fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:28.608170 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868f010-bb91-432f-a9dc-fad9f9f516fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:28.608559 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868f010-bb91-432f-a9dc-fad9f9f516fc admin admin] PATH_INFO: `/v3/users/f04363f8a167469a946071d10a9fff62` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:28.613118 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868f010-bb91-432f-a9dc-fad9f9f516fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04363f8a167469a946071d10a9fff62)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:28.617478 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868f010-bb91-432f-a9dc-fad9f9f516fc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:28.894520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0868f010-bb91-432f-a9dc-fad9f9f516fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04363f8a167469a946071d10a9fff62'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:29.028234 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0868f010-bb91-432f-a9dc-fad9f9f516fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04363f8a167469a946071d10a9fff62'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:29.043455 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0868f010-bb91-432f-a9dc-fad9f9f516fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04363f8a167469a946071d10a9fff62'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:29.075792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0868f010-bb91-432f-a9dc-fad9f9f516fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04363f8a167469a946071d10a9fff62'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:29.076840 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0868f010-bb91-432f-a9dc-fad9f9f516fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04363f8a167469a946071d10a9fff62'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:29.085534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1168/2357] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:28 2022] DELETE /identity/v3/users/f04363f8a167469a946071d10a9fff62 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:38:29.264507 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:29.265996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:29.286739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54f9ff-965b-4248-b57d-2cb5a9d4e8f3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:29.324666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:29.359456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:29.510104 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488a2a6-f52d-4f5b-a444-ea3b7df7c6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:29.514033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488a2a6-f52d-4f5b-a444-ea3b7df7c6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:29.514326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488a2a6-f52d-4f5b-a444-ea3b7df7c6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:29.514599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488a2a6-f52d-4f5b-a444-ea3b7df7c6b9 admin admin] PATH_INFO: `/v3/users/87634b2648e74406b04af168a7da72ca` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:29.521948 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488a2a6-f52d-4f5b-a444-ea3b7df7c6b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87634b2648e74406b04af168a7da72ca)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:29.524501 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488a2a6-f52d-4f5b-a444-ea3b7df7c6b9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:29.704036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868f010-bb91-432f-a9dc-fad9f9f516fc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:29.706942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0868f010-bb91-432f-a9dc-fad9f9f516fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:29.750529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868f010-bb91-432f-a9dc-fad9f9f516fc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:29.761439 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77716db2-3df9-416f-a388-9fe6a78b0bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:29.762796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77716db2-3df9-416f-a388-9fe6a78b0bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:29.763464 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77716db2-3df9-416f-a388-9fe6a78b0bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:29.764200 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77716db2-3df9-416f-a388-9fe6a78b0bb8 admin admin] PATH_INFO: `/v3/projects/90dab315e7d3405ea9c80933c6cde1fa` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:29.766116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77716db2-3df9-416f-a388-9fe6a78b0bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90dab315e7d3405ea9c80933c6cde1fa)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:29.769629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77716db2-3df9-416f-a388-9fe6a78b0bb8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:29.875318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1488a2a6-f52d-4f5b-a444-ea3b7df7c6b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87634b2648e74406b04af168a7da72ca'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:29.966099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1488a2a6-f52d-4f5b-a444-ea3b7df7c6b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87634b2648e74406b04af168a7da72ca'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:29.966753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1488a2a6-f52d-4f5b-a444-ea3b7df7c6b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87634b2648e74406b04af168a7da72ca'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:30.016393 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-77716db2-3df9-416f-a388-9fe6a78b0bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90dab315e7d3405ea9c80933c6cde1fa', 'request_id': 'req-77716db2-3df9-416f-a388-9fe6a78b0bb8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:30.016968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1488a2a6-f52d-4f5b-a444-ea3b7df7c6b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87634b2648e74406b04af168a7da72ca'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:30.032305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-77716db2-3df9-416f-a388-9fe6a78b0bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90dab315e7d3405ea9c80933c6cde1fa', 'request_id': 'req-77716db2-3df9-416f-a388-9fe6a78b0bb8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:30.041199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1488a2a6-f52d-4f5b-a444-ea3b7df7c6b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87634b2648e74406b04af168a7da72ca'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:30.053055 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1190/2358] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:29 2022] DELETE /identity/v3/users/87634b2648e74406b04af168a7da72ca => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:30.059949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9c063-ef01-44c7-b22b-4ce418e40418 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:30.060739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9c063-ef01-44c7-b22b-4ce418e40418 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:30.061218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9c063-ef01-44c7-b22b-4ce418e40418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:30.116471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8db9c063-ef01-44c7-b22b-4ce418e40418 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:30.122632 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8db9c063-ef01-44c7-b22b-4ce418e40418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:30.127125 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-77716db2-3df9-416f-a388-9fe6a78b0bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90dab315e7d3405ea9c80933c6cde1fa', 'request_id': 'req-77716db2-3df9-416f-a388-9fe6a78b0bb8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:30.158850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-77716db2-3df9-416f-a388-9fe6a78b0bb8 admin admin] The token cache is being invalidate because project 90dab315e7d3405ea9c80933c6cde1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:30.164199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-77716db2-3df9-416f-a388-9fe6a78b0bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:30.166183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-77716db2-3df9-416f-a388-9fe6a78b0bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:30.185827 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1169/2359] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:29 2022] DELETE /identity/v3/projects/90dab315e7d3405ea9c80933c6cde1fa => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:30.194010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1728bc1-a8b9-4021-ab64-fac0e9be0f4e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:30.194383 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1728bc1-a8b9-4021-ab64-fac0e9be0f4e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:30.194906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1728bc1-a8b9-4021-ab64-fac0e9be0f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:30.238401 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d1728bc1-a8b9-4021-ab64-fac0e9be0f4e None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:30.239904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d1728bc1-a8b9-4021-ab64-fac0e9be0f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:30.301056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1191/2360] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:30.327467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9c063-ef01-44c7-b22b-4ce418e40418 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:30.329403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8db9c063-ef01-44c7-b22b-4ce418e40418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:30.389369 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1170/2361] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:30.398170 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c4f7d-fe0b-4da8-aa68-724b645b978a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:30.398728 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c4f7d-fe0b-4da8-aa68-724b645b978a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:30.399160 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c4f7d-fe0b-4da8-aa68-724b645b978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:30.438820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0c4c4f7d-fe0b-4da8-aa68-724b645b978a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:30.440837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0c4c4f7d-fe0b-4da8-aa68-724b645b978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:30.464699 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1171/2362] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:30.467364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c4f7d-fe0b-4da8-aa68-724b645b978a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:30.475183 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9c063-ef01-44c7-b22b-4ce418e40418 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:30.482834 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c4f7d-fe0b-4da8-aa68-724b645b978a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:30.485316 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f860142-3241-4eb7-9163-2c793d7e1ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:30.486220 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f860142-3241-4eb7-9163-2c793d7e1ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:30.487261 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f860142-3241-4eb7-9163-2c793d7e1ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:30.487757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f860142-3241-4eb7-9163-2c793d7e1ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:30.501807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30426de-6bb8-4f19-9c13-62f13eaa1fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:30.503228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30426de-6bb8-4f19-9c13-62f13eaa1fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:30.503516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30426de-6bb8-4f19-9c13-62f13eaa1fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:30.503989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30426de-6bb8-4f19-9c13-62f13eaa1fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:30.505305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30426de-6bb8-4f19-9c13-62f13eaa1fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:38:30.505449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30426de-6bb8-4f19-9c13-62f13eaa1fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:30.507253 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30426de-6bb8-4f19-9c13-62f13eaa1fc2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:30.511557 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f860142-3241-4eb7-9163-2c793d7e1ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:30.513251 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f860142-3241-4eb7-9163-2c793d7e1ea3 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:30.526843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1192/2363] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:38:30.548003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1172/2364] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:38:30.548818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f860142-3241-4eb7-9163-2c793d7e1ea3 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:30.597771 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f860142-3241-4eb7-9163-2c793d7e1ea3 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:30.609300 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57454478-b076-44e7-9ec9-fedd8a250d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:30.610566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57454478-b076-44e7-9ec9-fedd8a250d59 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:30.610566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57454478-b076-44e7-9ec9-fedd8a250d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:30.613093 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57454478-b076-44e7-9ec9-fedd8a250d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:30.613093 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57454478-b076-44e7-9ec9-fedd8a250d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:30.618556 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57454478-b076-44e7-9ec9-fedd8a250d59 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:30.628865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:30.678523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:30.808904 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1193/2365] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:38:30 2022] POST /identity/v3/projects => generated 381 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:30.811315 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30426de-6bb8-4f19-9c13-62f13eaa1fc2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:30.843396 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30426de-6bb8-4f19-9c13-62f13eaa1fc2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:30.969763 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae481ce-397a-48cc-a2f0-fddca2f55a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:30.970860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae481ce-397a-48cc-a2f0-fddca2f55a49 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:30.971998 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae481ce-397a-48cc-a2f0-fddca2f55a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:30.972515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae481ce-397a-48cc-a2f0-fddca2f55a49 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:30.973477 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae481ce-397a-48cc-a2f0-fddca2f55a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:30.976945 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae481ce-397a-48cc-a2f0-fddca2f55a49 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:31.072454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1173/2366] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:38:30 2022] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:31.076837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57454478-b076-44e7-9ec9-fedd8a250d59 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:31.097309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57454478-b076-44e7-9ec9-fedd8a250d59 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:31.128966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83230e-c0d7-4fd9-a1d1-699e003bb553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:31.130114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83230e-c0d7-4fd9-a1d1-699e003bb553 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:31.130731 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83230e-c0d7-4fd9-a1d1-699e003bb553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:31.131449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83230e-c0d7-4fd9-a1d1-699e003bb553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:31.132429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83230e-c0d7-4fd9-a1d1-699e003bb553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:31.136340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83230e-c0d7-4fd9-a1d1-699e003bb553 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:31.172925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae481ce-397a-48cc-a2f0-fddca2f55a49 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:31.176135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1ae481ce-397a-48cc-a2f0-fddca2f55a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:31.196357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1194/2367] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:31.204031 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83230e-c0d7-4fd9-a1d1-699e003bb553 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:31.213852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae481ce-397a-48cc-a2f0-fddca2f55a49 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:31.238414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620534aa-c2ed-48fb-8176-6dd83ce393ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:31.243976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620534aa-c2ed-48fb-8176-6dd83ce393ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:31.243976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620534aa-c2ed-48fb-8176-6dd83ce393ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:31.243976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620534aa-c2ed-48fb-8176-6dd83ce393ff admin admin] PATH_INFO: `/v3/users/fc9fa6d6c6ff46809f0b5ed05f559187` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:31.247344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83230e-c0d7-4fd9-a1d1-699e003bb553 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:31.252383 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620534aa-c2ed-48fb-8176-6dd83ce393ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc9fa6d6c6ff46809f0b5ed05f559187)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:31.260831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620534aa-c2ed-48fb-8176-6dd83ce393ff admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:31.276256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279e02b-5397-45c3-9183-19eda84fbeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:31.278485 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279e02b-5397-45c3-9183-19eda84fbeac admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:31.279367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279e02b-5397-45c3-9183-19eda84fbeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:31.279959 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279e02b-5397-45c3-9183-19eda84fbeac admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:31.280997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279e02b-5397-45c3-9183-19eda84fbeac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:31.283159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279e02b-5397-45c3-9183-19eda84fbeac admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:31.317546 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1195/2368] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:31.325630 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279e02b-5397-45c3-9183-19eda84fbeac admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:31.344942 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279e02b-5397-45c3-9183-19eda84fbeac admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:31.350143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3564b-1db1-40ac-bc7b-82a788127c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:31.351137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3564b-1db1-40ac-bc7b-82a788127c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:31.351443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3564b-1db1-40ac-bc7b-82a788127c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:31.351766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3564b-1db1-40ac-bc7b-82a788127c75 admin admin] PATH_INFO: `/v3/projects/dd5bd179ea864a2f8667da84f8bee470/users/70ffc39498e348b4ab2513633b388f23/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:31.372607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3564b-1db1-40ac-bc7b-82a788127c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5bd179ea864a2f8667da84f8bee470, user_id=70ffc39498e348b4ab2513633b388f23, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:31.375950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3564b-1db1-40ac-bc7b-82a788127c75 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:31.465773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:31.503047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1196/2369] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:31 2022] PUT /identity/v3/projects/dd5bd179ea864a2f8667da84f8bee470/users/70ffc39498e348b4ab2513633b388f23/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:38:31.503047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3564b-1db1-40ac-bc7b-82a788127c75 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:31.507982 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3ab3564b-1db1-40ac-bc7b-82a788127c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:31.608872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-620534aa-c2ed-48fb-8176-6dd83ce393ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc9fa6d6c6ff46809f0b5ed05f559187'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:31.616371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3564b-1db1-40ac-bc7b-82a788127c75 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:31.623231 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe62c42-6510-4a8f-8a26-bbc839ffdee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:31.624262 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe62c42-6510-4a8f-8a26-bbc839ffdee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:31.624555 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe62c42-6510-4a8f-8a26-bbc839ffdee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:31.625101 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe62c42-6510-4a8f-8a26-bbc839ffdee7 admin admin] PATH_INFO: `/v3/projects/689b094080e1473bbb8f11dc33dcaf16` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:31.629049 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe62c42-6510-4a8f-8a26-bbc839ffdee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=689b094080e1473bbb8f11dc33dcaf16)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:31.630530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe62c42-6510-4a8f-8a26-bbc839ffdee7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:31.668825 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-620534aa-c2ed-48fb-8176-6dd83ce393ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc9fa6d6c6ff46809f0b5ed05f559187'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:31.688474 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-620534aa-c2ed-48fb-8176-6dd83ce393ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc9fa6d6c6ff46809f0b5ed05f559187'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:31.709508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-620534aa-c2ed-48fb-8176-6dd83ce393ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc9fa6d6c6ff46809f0b5ed05f559187'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:31.710513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-620534aa-c2ed-48fb-8176-6dd83ce393ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc9fa6d6c6ff46809f0b5ed05f559187'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:31.717318 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1174/2370] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:31 2022] DELETE /identity/v3/users/fc9fa6d6c6ff46809f0b5ed05f559187 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:38:31.718956 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc559895-b999-49c4-a369-728913673582 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:31.719241 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc559895-b999-49c4-a369-728913673582 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:31.719515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc559895-b999-49c4-a369-728913673582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:31.754175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-dc559895-b999-49c4-a369-728913673582 None None] MFA Rules not processed for user `70ffc39498e348b4ab2513633b388f23`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:31.755501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dc559895-b999-49c4-a369-728913673582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:31.760863 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0fe62c42-6510-4a8f-8a26-bbc839ffdee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689b094080e1473bbb8f11dc33dcaf16', 'request_id': 'req-0fe62c42-6510-4a8f-8a26-bbc839ffdee7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:31.793977 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:31.847367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1175/2371] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:31.847367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969b01d-5842-43e5-ab5f-5e59f91796ba None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:31.847367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969b01d-5842-43e5-ab5f-5e59f91796ba None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:31.847367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969b01d-5842-43e5-ab5f-5e59f91796ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:31.857334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0fe62c42-6510-4a8f-8a26-bbc839ffdee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689b094080e1473bbb8f11dc33dcaf16', 'request_id': 'req-0fe62c42-6510-4a8f-8a26-bbc839ffdee7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:31.870893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0fe62c42-6510-4a8f-8a26-bbc839ffdee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689b094080e1473bbb8f11dc33dcaf16', 'request_id': 'req-0fe62c42-6510-4a8f-8a26-bbc839ffdee7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:31.885170 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b969b01d-5842-43e5-ab5f-5e59f91796ba None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:31.887650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b969b01d-5842-43e5-ab5f-5e59f91796ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:31.893866 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0fe62c42-6510-4a8f-8a26-bbc839ffdee7 admin admin] The token cache is being invalidate because project 689b094080e1473bbb8f11dc33dcaf16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:31.894339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0fe62c42-6510-4a8f-8a26-bbc839ffdee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:31.895480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0fe62c42-6510-4a8f-8a26-bbc839ffdee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:31.898263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1197/2372] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:31 2022] DELETE /identity/v3/projects/689b094080e1473bbb8f11dc33dcaf16 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:31.899814 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae72c48-2f3a-4fc6-8bfe-4b990a8dfd70 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:31.900322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae72c48-2f3a-4fc6-8bfe-4b990a8dfd70 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:31.900924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae72c48-2f3a-4fc6-8bfe-4b990a8dfd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:31.936447 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-eae72c48-2f3a-4fc6-8bfe-4b990a8dfd70 None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:31.939071 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-eae72c48-2f3a-4fc6-8bfe-4b990a8dfd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:32.002707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1176/2373] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:32.004109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969b01d-5842-43e5-ab5f-5e59f91796ba None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:32.005520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b969b01d-5842-43e5-ab5f-5e59f91796ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:32.022563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969b01d-5842-43e5-ab5f-5e59f91796ba None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:32.029700 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cff5f-ba91-42d1-b7ca-a682e9a33582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:32.030414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cff5f-ba91-42d1-b7ca-a682e9a33582 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:32.030824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cff5f-ba91-42d1-b7ca-a682e9a33582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:32.031093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cff5f-ba91-42d1-b7ca-a682e9a33582 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:32.031817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cff5f-ba91-42d1-b7ca-a682e9a33582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:32.034125 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cff5f-ba91-42d1-b7ca-a682e9a33582 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:32.121028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1198/2374] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 20 19:38:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:32.137737 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae72c48-2f3a-4fc6-8bfe-4b990a8dfd70 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:32.144878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-eae72c48-2f3a-4fc6-8bfe-4b990a8dfd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:32.175852 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae72c48-2f3a-4fc6-8bfe-4b990a8dfd70 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:32.184036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998aabe1-3186-40c6-b1cb-68b7a2b5e4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:32.184960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998aabe1-3186-40c6-b1cb-68b7a2b5e4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:32.198977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998aabe1-3186-40c6-b1cb-68b7a2b5e4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:32.198977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998aabe1-3186-40c6-b1cb-68b7a2b5e4ea admin admin] PATH_INFO: `/v3/users/961cbf64af0146bcaeb0abdda6b7c996` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:32.198977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998aabe1-3186-40c6-b1cb-68b7a2b5e4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=961cbf64af0146bcaeb0abdda6b7c996)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:32.198977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998aabe1-3186-40c6-b1cb-68b7a2b5e4ea admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:32.442490 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1177/2375] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:38:32 2022] POST /identity/v3/projects => generated 385 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:32.443629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cff5f-ba91-42d1-b7ca-a682e9a33582 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:32.445595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fd5cff5f-ba91-42d1-b7ca-a682e9a33582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:32.508685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cff5f-ba91-42d1-b7ca-a682e9a33582 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:32.512865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e29cc-73d4-4b9a-adf7-9a805a531532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:32.518039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e29cc-73d4-4b9a-adf7-9a805a531532 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:32.518039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e29cc-73d4-4b9a-adf7-9a805a531532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:32.518039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e29cc-73d4-4b9a-adf7-9a805a531532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:32.599530 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e29cc-73d4-4b9a-adf7-9a805a531532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:32.601081 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e29cc-73d4-4b9a-adf7-9a805a531532 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:32.615221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1178/2376] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:32.615825 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e29cc-73d4-4b9a-adf7-9a805a531532 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:32.617175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0b8e29cc-73d4-4b9a-adf7-9a805a531532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:32.660669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-998aabe1-3186-40c6-b1cb-68b7a2b5e4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961cbf64af0146bcaeb0abdda6b7c996'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:32.747818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e29cc-73d4-4b9a-adf7-9a805a531532 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:32.761582 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7100656-665e-4ece-af7a-86a3967cfb1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:32.762823 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7100656-665e-4ece-af7a-86a3967cfb1f service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:32.763250 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7100656-665e-4ece-af7a-86a3967cfb1f service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:32.764646 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7100656-665e-4ece-af7a-86a3967cfb1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:32.765152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-998aabe1-3186-40c6-b1cb-68b7a2b5e4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961cbf64af0146bcaeb0abdda6b7c996'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:32.765949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-998aabe1-3186-40c6-b1cb-68b7a2b5e4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961cbf64af0146bcaeb0abdda6b7c996'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:32.777392 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b7100656-665e-4ece-af7a-86a3967cfb1f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:32.787647 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-998aabe1-3186-40c6-b1cb-68b7a2b5e4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961cbf64af0146bcaeb0abdda6b7c996'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:32.797795 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-998aabe1-3186-40c6-b1cb-68b7a2b5e4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961cbf64af0146bcaeb0abdda6b7c996'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:32.821759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1199/2377] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:32 2022] DELETE /identity/v3/users/961cbf64af0146bcaeb0abdda6b7c996 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:32.822830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998aabe1-3186-40c6-b1cb-68b7a2b5e4ea admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:32.824687 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-998aabe1-3186-40c6-b1cb-68b7a2b5e4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:32.872081 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7100656-665e-4ece-af7a-86a3967cfb1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:32.874183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7100656-665e-4ece-af7a-86a3967cfb1f service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:32.888957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1179/2378] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:38:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:38:32.975664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998aabe1-3186-40c6-b1cb-68b7a2b5e4ea admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:33.000198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2caf35-1412-4448-b4a4-08dbf0a96cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:33.006294 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2caf35-1412-4448-b4a4-08dbf0a96cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:33.006715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2caf35-1412-4448-b4a4-08dbf0a96cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:33.006998 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2caf35-1412-4448-b4a4-08dbf0a96cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:33.011573 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2caf35-1412-4448-b4a4-08dbf0a96cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:33.017059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2caf35-1412-4448-b4a4-08dbf0a96cf9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:33.152920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1200/2379] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:38:32 2022] POST /identity/v3/users => generated 299 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:33.154052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7100656-665e-4ece-af7a-86a3967cfb1f service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:33.167786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7100656-665e-4ece-af7a-86a3967cfb1f service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:33.175409 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047bb97-1db1-44c0-9e97-bd54aec60d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:33.194999 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:33.196604 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047bb97-1db1-44c0-9e97-bd54aec60d14 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:33.197051 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047bb97-1db1-44c0-9e97-bd54aec60d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:33.197383 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047bb97-1db1-44c0-9e97-bd54aec60d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:33.199295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047bb97-1db1-44c0-9e97-bd54aec60d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:33.201156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047bb97-1db1-44c0-9e97-bd54aec60d14 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:33.230741 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1180/2380] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:38:33.235632 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2caf35-1412-4448-b4a4-08dbf0a96cf9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:33.244656 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:33.263322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2caf35-1412-4448-b4a4-08dbf0a96cf9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:33.295388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8c219-432e-4574-a4fe-83add3e651ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:33.298545 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8c219-432e-4574-a4fe-83add3e651ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:33.299147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8c219-432e-4574-a4fe-83add3e651ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:33.299701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8c219-432e-4574-a4fe-83add3e651ca admin admin] PATH_INFO: `/v3/projects/2aadc3f46cc14659a92d602221f372ae/users/61ef1fec5e644d0e93b96e38bd986b45/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:33.423721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8c219-432e-4574-a4fe-83add3e651ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aadc3f46cc14659a92d602221f372ae, user_id=61ef1fec5e644d0e93b96e38bd986b45, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:33.427938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8c219-432e-4574-a4fe-83add3e651ca admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:33.561226 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1201/2381] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:33 2022] PUT /identity/v3/projects/2aadc3f46cc14659a92d602221f372ae/users/61ef1fec5e644d0e93b96e38bd986b45/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:33.566135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047bb97-1db1-44c0-9e97-bd54aec60d14 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:33.599192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047bb97-1db1-44c0-9e97-bd54aec60d14 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:33.600611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8c219-432e-4574-a4fe-83add3e651ca admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:33.602720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-efe8c219-432e-4574-a4fe-83add3e651ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:33.847256 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:33.859594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bcc88-f5d0-41bc-b4a7-30e07ccf93b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:33.860438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bcc88-f5d0-41bc-b4a7-30e07ccf93b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:33.860698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bcc88-f5d0-41bc-b4a7-30e07ccf93b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:33.861007 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bcc88-f5d0-41bc-b4a7-30e07ccf93b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:33.862027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11bcc88-f5d0-41bc-b4a7-30e07ccf93b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:33.866069 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8c219-432e-4574-a4fe-83add3e651ca admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:33.870204 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11bcc88-f5d0-41bc-b4a7-30e07ccf93b4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:33.887417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14120cc-30ab-4d60-9b31-5ab534f2abfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:33.888717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14120cc-30ab-4d60-9b31-5ab534f2abfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:33.891842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14120cc-30ab-4d60-9b31-5ab534f2abfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:33.892449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14120cc-30ab-4d60-9b31-5ab534f2abfe admin admin] PATH_INFO: `/v3/projects/e1cce73eca1040ec8be16b60cfadfcf3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:33.898507 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14120cc-30ab-4d60-9b31-5ab534f2abfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1cce73eca1040ec8be16b60cfadfcf3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:33.907479 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1181/2382] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:33.913053 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bcc88-f5d0-41bc-b4a7-30e07ccf93b4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:33.918395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14120cc-30ab-4d60-9b31-5ab534f2abfe admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:33.921085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d11bcc88-f5d0-41bc-b4a7-30e07ccf93b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:33.944789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bcc88-f5d0-41bc-b4a7-30e07ccf93b4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:33.971500 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cd78d-be3c-4615-9deb-4ec11ce1a1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:33.972984 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cd78d-be3c-4615-9deb-4ec11ce1a1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:33.973346 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cd78d-be3c-4615-9deb-4ec11ce1a1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:33.973624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cd78d-be3c-4615-9deb-4ec11ce1a1b1 admin admin] PATH_INFO: `/v3/projects/630a5178f8ba40d287fc98e707d849a9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:33.988948 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cd78d-be3c-4615-9deb-4ec11ce1a1b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=630a5178f8ba40d287fc98e707d849a9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:33.993419 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cd78d-be3c-4615-9deb-4ec11ce1a1b1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:34.108252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c14120cc-30ab-4d60-9b31-5ab534f2abfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1cce73eca1040ec8be16b60cfadfcf3', 'request_id': 'req-c14120cc-30ab-4d60-9b31-5ab534f2abfe'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:34.224766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d21cd78d-be3c-4615-9deb-4ec11ce1a1b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630a5178f8ba40d287fc98e707d849a9', 'request_id': 'req-d21cd78d-be3c-4615-9deb-4ec11ce1a1b1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:34.235896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d21cd78d-be3c-4615-9deb-4ec11ce1a1b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630a5178f8ba40d287fc98e707d849a9', 'request_id': 'req-d21cd78d-be3c-4615-9deb-4ec11ce1a1b1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:34.246332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c14120cc-30ab-4d60-9b31-5ab534f2abfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1cce73eca1040ec8be16b60cfadfcf3', 'request_id': 'req-c14120cc-30ab-4d60-9b31-5ab534f2abfe'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:34.270391 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c14120cc-30ab-4d60-9b31-5ab534f2abfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1cce73eca1040ec8be16b60cfadfcf3', 'request_id': 'req-c14120cc-30ab-4d60-9b31-5ab534f2abfe'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:34.312316 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c14120cc-30ab-4d60-9b31-5ab534f2abfe admin admin] The token cache is being invalidate because project e1cce73eca1040ec8be16b60cfadfcf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:34.314024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c14120cc-30ab-4d60-9b31-5ab534f2abfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:34.315230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c14120cc-30ab-4d60-9b31-5ab534f2abfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:34.332516 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1202/2383] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:33 2022] DELETE /identity/v3/projects/e1cce73eca1040ec8be16b60cfadfcf3 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:38:34.338403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14120cc-30ab-4d60-9b31-5ab534f2abfe admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:34.345554 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c14120cc-30ab-4d60-9b31-5ab534f2abfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:34.354347 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d21cd78d-be3c-4615-9deb-4ec11ce1a1b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630a5178f8ba40d287fc98e707d849a9', 'request_id': 'req-d21cd78d-be3c-4615-9deb-4ec11ce1a1b1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:34.379669 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d21cd78d-be3c-4615-9deb-4ec11ce1a1b1 admin admin] The token cache is being invalidate because project 630a5178f8ba40d287fc98e707d849a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:34.391203 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d21cd78d-be3c-4615-9deb-4ec11ce1a1b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:34.395225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d21cd78d-be3c-4615-9deb-4ec11ce1a1b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:34.411845 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1182/2384] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:33 2022] DELETE /identity/v3/projects/630a5178f8ba40d287fc98e707d849a9 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:34.418405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5432d5-b999-4551-a2c4-99ebcd6bbee8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:34.419221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5432d5-b999-4551-a2c4-99ebcd6bbee8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:34.419989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5432d5-b999-4551-a2c4-99ebcd6bbee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:34.511985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0b5432d5-b999-4551-a2c4-99ebcd6bbee8 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:34.513335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0b5432d5-b999-4551-a2c4-99ebcd6bbee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:34.535399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:34.590169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14120cc-30ab-4d60-9b31-5ab534f2abfe admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:34.668383 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1183/2385] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:34.678102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584e4ba-2160-41b7-8541-da4152b5e1af None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:34.678423 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584e4ba-2160-41b7-8541-da4152b5e1af None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:34.678970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584e4ba-2160-41b7-8541-da4152b5e1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:34.714157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7584e4ba-2160-41b7-8541-da4152b5e1af None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:34.716266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7584e4ba-2160-41b7-8541-da4152b5e1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:34.739112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1184/2386] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:34.742230 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584e4ba-2160-41b7-8541-da4152b5e1af None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:34.748782 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e134d-93ec-477c-aa8d-923527dedd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:34.749790 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e134d-93ec-477c-aa8d-923527dedd16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:34.755653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e134d-93ec-477c-aa8d-923527dedd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:34.755653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e134d-93ec-477c-aa8d-923527dedd16 admin admin] PATH_INFO: `/v3/projects/2aadc3f46cc14659a92d602221f372ae/users/61ef1fec5e644d0e93b96e38bd986b45/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:34.756279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e134d-93ec-477c-aa8d-923527dedd16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aadc3f46cc14659a92d602221f372ae, user_id=61ef1fec5e644d0e93b96e38bd986b45, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:34.759989 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e134d-93ec-477c-aa8d-923527dedd16 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:34.766030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584e4ba-2160-41b7-8541-da4152b5e1af None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:34.775529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db3950-14ea-4f86-995e-d0187404c7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:34.776224 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db3950-14ea-4f86-995e-d0187404c7fe admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:34.776517 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db3950-14ea-4f86-995e-d0187404c7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:34.776782 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db3950-14ea-4f86-995e-d0187404c7fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:34.777533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db3950-14ea-4f86-995e-d0187404c7fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:38:34.777840 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db3950-14ea-4f86-995e-d0187404c7fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:34.779626 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db3950-14ea-4f86-995e-d0187404c7fe admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:34.792462 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1203/2387] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:34 2022] PUT /identity/v3/projects/2aadc3f46cc14659a92d602221f372ae/users/61ef1fec5e644d0e93b96e38bd986b45/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:34.804949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefe9ed-3590-41e9-a984-2c87f738bf5a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:34.807401 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefe9ed-3590-41e9-a984-2c87f738bf5a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:34.807401 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefe9ed-3590-41e9-a984-2c87f738bf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:34.815516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1185/2388] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:38:34.820455 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db3950-14ea-4f86-995e-d0187404c7fe admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:34.842083 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db3950-14ea-4f86-995e-d0187404c7fe admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:34.898352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-dbefe9ed-3590-41e9-a984-2c87f738bf5a None None] MFA Rules not processed for user `61ef1fec5e644d0e93b96e38bd986b45`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:34.904044 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dbefe9ed-3590-41e9-a984-2c87f738bf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:34.948901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:34.999337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfab2b-8262-4c7a-b565-9615e7733629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:35.000715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfab2b-8262-4c7a-b565-9615e7733629 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:35.001351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfab2b-8262-4c7a-b565-9615e7733629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:35.001938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfab2b-8262-4c7a-b565-9615e7733629 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:35.003272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfab2b-8262-4c7a-b565-9615e7733629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:35.006564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfab2b-8262-4c7a-b565-9615e7733629 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:35.103988 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1204/2389] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:35.122760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefe9ed-3590-41e9-a984-2c87f738bf5a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:35.129581 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dbefe9ed-3590-41e9-a984-2c87f738bf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:35.133567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1186/2390] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:38:34 2022] POST /identity/v3/projects => generated 369 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:35.151506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfab2b-8262-4c7a-b565-9615e7733629 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:35.429552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefe9ed-3590-41e9-a984-2c87f738bf5a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:35.513476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfab2b-8262-4c7a-b565-9615e7733629 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:35.536031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d95db-8e78-4792-828a-e014938aada6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:35.543539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d95db-8e78-4792-828a-e014938aada6 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:35.543539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d95db-8e78-4792-828a-e014938aada6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:35.543539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d95db-8e78-4792-828a-e014938aada6 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:35.543539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d95db-8e78-4792-828a-e014938aada6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:35.544176 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:35.545740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d95db-8e78-4792-828a-e014938aada6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:35.596508 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf63860-b5d1-4cdb-8eaf-bcd1f90ac710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:35.603279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf63860-b5d1-4cdb-8eaf-bcd1f90ac710 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:35.603279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf63860-b5d1-4cdb-8eaf-bcd1f90ac710 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:35.603279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf63860-b5d1-4cdb-8eaf-bcd1f90ac710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:35.608286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3cf63860-b5d1-4cdb-8eaf-bcd1f90ac710 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:35.660396 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1187/2391] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:38:35 2022] POST /identity/v3/users => generated 285 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:35.666561 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d95db-8e78-4792-828a-e014938aada6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:35.724553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d95db-8e78-4792-828a-e014938aada6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:35.749906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336a491-0946-4a40-bab9-1b23602b403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:35.752696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336a491-0946-4a40-bab9-1b23602b403a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:35.752696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336a491-0946-4a40-bab9-1b23602b403a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:35.752696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336a491-0946-4a40-bab9-1b23602b403a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:35.752696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336a491-0946-4a40-bab9-1b23602b403a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:35.757052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336a491-0946-4a40-bab9-1b23602b403a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:35.791635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1188/2392] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:35.792694 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336a491-0946-4a40-bab9-1b23602b403a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:35.827499 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336a491-0946-4a40-bab9-1b23602b403a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:35.835507 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf63860-b5d1-4cdb-8eaf-bcd1f90ac710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:35.843124 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf63860-b5d1-4cdb-8eaf-bcd1f90ac710 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:35.843283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a470d5e-146c-4b93-8048-5578328147b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:35.843283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a470d5e-146c-4b93-8048-5578328147b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:35.843283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a470d5e-146c-4b93-8048-5578328147b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:35.843283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a470d5e-146c-4b93-8048-5578328147b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:35.843628 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a470d5e-146c-4b93-8048-5578328147b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:35.846951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a470d5e-146c-4b93-8048-5578328147b9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:35.853114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1205/2393] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:35.902146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf63860-b5d1-4cdb-8eaf-bcd1f90ac710 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:35.902930 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1189/2394] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:35.935819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf63860-b5d1-4cdb-8eaf-bcd1f90ac710 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:35.969160 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c6bf2-5d87-49a0-8909-b80afa96670d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:35.971147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c6bf2-5d87-49a0-8909-b80afa96670d admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:35.971690 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c6bf2-5d87-49a0-8909-b80afa96670d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:35.975160 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c6bf2-5d87-49a0-8909-b80afa96670d admin admin] PATH_INFO: `/v3/projects/d79377fc32c447248f3c5e2b4fd16929/users/2378b8940a9846d09f8e1b35405fd3d5/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:36.048994 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c6bf2-5d87-49a0-8909-b80afa96670d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d79377fc32c447248f3c5e2b4fd16929, user_id=2378b8940a9846d09f8e1b35405fd3d5, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:36.059649 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c6bf2-5d87-49a0-8909-b80afa96670d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:36.704745 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1206/2395] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:35 2022] PUT /identity/v3/projects/d79377fc32c447248f3c5e2b4fd16929/users/2378b8940a9846d09f8e1b35405fd3d5/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:38:36.718563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42c8e0-d678-42ea-9eed-93e7c1dd5d54 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:36.718915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42c8e0-d678-42ea-9eed-93e7c1dd5d54 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:36.719172 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42c8e0-d678-42ea-9eed-93e7c1dd5d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:36.780401 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0b42c8e0-d678-42ea-9eed-93e7c1dd5d54 None None] MFA Rules not processed for user `2378b8940a9846d09f8e1b35405fd3d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:36.784143 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0b42c8e0-d678-42ea-9eed-93e7c1dd5d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:36.801625 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:36.933138 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1190/2396] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:36.944752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c6bf2-5d87-49a0-8909-b80afa96670d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:37.047122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c6bf2-5d87-49a0-8909-b80afa96670d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:37.052870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9d9c1-a7a0-4c21-ae75-d55dd627a046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:37.053851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9d9c1-a7a0-4c21-ae75-d55dd627a046 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:37.054027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9d9c1-a7a0-4c21-ae75-d55dd627a046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:37.054227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9d9c1-a7a0-4c21-ae75-d55dd627a046 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:37.054974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9d9c1-a7a0-4c21-ae75-d55dd627a046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:37.057491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9d9c1-a7a0-4c21-ae75-d55dd627a046 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:37.287006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1207/2397] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:38:36 2022] POST /identity/v3/projects => generated 367 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:37.288554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42c8e0-d678-42ea-9eed-93e7c1dd5d54 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:37.320144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42c8e0-d678-42ea-9eed-93e7c1dd5d54 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:37.428727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa320ec-afbc-4a5c-a6f6-4b840a2f1e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:37.429749 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa320ec-afbc-4a5c-a6f6-4b840a2f1e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:37.430178 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa320ec-afbc-4a5c-a6f6-4b840a2f1e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:37.430645 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa320ec-afbc-4a5c-a6f6-4b840a2f1e26 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:37.431820 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa320ec-afbc-4a5c-a6f6-4b840a2f1e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:37.435713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa320ec-afbc-4a5c-a6f6-4b840a2f1e26 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:37.470326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:37.528974 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1191/2398] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:38:37 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:37.533523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9d9c1-a7a0-4c21-ae75-d55dd627a046 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:37.558296 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9d9c1-a7a0-4c21-ae75-d55dd627a046 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:37.576646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a41753-facd-4a3c-b00a-ef7a2e5da843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:37.577529 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a41753-facd-4a3c-b00a-ef7a2e5da843 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:37.577909 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a41753-facd-4a3c-b00a-ef7a2e5da843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:37.578637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a41753-facd-4a3c-b00a-ef7a2e5da843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:37.580206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a41753-facd-4a3c-b00a-ef7a2e5da843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:37.592944 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a41753-facd-4a3c-b00a-ef7a2e5da843 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:37.638038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1208/2399] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:37.639381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa320ec-afbc-4a5c-a6f6-4b840a2f1e26 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:37.656192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa320ec-afbc-4a5c-a6f6-4b840a2f1e26 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:37.670861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b97471-e597-410d-867b-9554ba920323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:37.671909 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b97471-e597-410d-867b-9554ba920323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:37.672525 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b97471-e597-410d-867b-9554ba920323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:37.672921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b97471-e597-410d-867b-9554ba920323 admin admin] PATH_INFO: `/v3/projects/3d333c139b254b31a43fe2036e499a77/users/4e23ffd4366e4646adb22ec83fb54c2d/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:37.746614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b97471-e597-410d-867b-9554ba920323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d333c139b254b31a43fe2036e499a77, user_id=4e23ffd4366e4646adb22ec83fb54c2d, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:37.754915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b97471-e597-410d-867b-9554ba920323 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:37.892015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1192/2400] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:37 2022] PUT /identity/v3/projects/3d333c139b254b31a43fe2036e499a77/users/4e23ffd4366e4646adb22ec83fb54c2d/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:37.896748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a41753-facd-4a3c-b00a-ef7a2e5da843 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:37.939726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a41753-facd-4a3c-b00a-ef7a2e5da843 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:38.061338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a03266-fb0f-472e-b802-582544c8c6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:38.062490 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a03266-fb0f-472e-b802-582544c8c6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:38.062490 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a03266-fb0f-472e-b802-582544c8c6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:38.062844 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a03266-fb0f-472e-b802-582544c8c6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:38.063369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a03266-fb0f-472e-b802-582544c8c6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:38.065661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a03266-fb0f-472e-b802-582544c8c6a3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:38.080152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1209/2401] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:38.085544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b97471-e597-410d-867b-9554ba920323 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:38.101049 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b97471-e597-410d-867b-9554ba920323 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:38.106894 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fbb83-09d0-4df7-bae2-baf76f84c714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:38.110181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fbb83-09d0-4df7-bae2-baf76f84c714 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:38.110844 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fbb83-09d0-4df7-bae2-baf76f84c714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:38.111362 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fbb83-09d0-4df7-bae2-baf76f84c714 admin admin] PATH_INFO: `/v3/projects/3d333c139b254b31a43fe2036e499a77/users/4e23ffd4366e4646adb22ec83fb54c2d/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:38.114075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0fbb83-09d0-4df7-bae2-baf76f84c714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d333c139b254b31a43fe2036e499a77, user_id=4e23ffd4366e4646adb22ec83fb54c2d, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:38.117309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0fbb83-09d0-4df7-bae2-baf76f84c714 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:38.149998 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1193/2402] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:38 2022] PUT /identity/v3/projects/3d333c139b254b31a43fe2036e499a77/users/4e23ffd4366e4646adb22ec83fb54c2d/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:38:38.152138 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cc244-7b46-411e-b1ce-34a5eab5d17b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:38.152750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cc244-7b46-411e-b1ce-34a5eab5d17b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:38.153203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cc244-7b46-411e-b1ce-34a5eab5d17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:38.190357 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-570cc244-7b46-411e-b1ce-34a5eab5d17b None None] MFA Rules not processed for user `4e23ffd4366e4646adb22ec83fb54c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:38.192777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-570cc244-7b46-411e-b1ce-34a5eab5d17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:38.312498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1210/2403] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:38.331268 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fbb83-09d0-4df7-bae2-baf76f84c714 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:38.333995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fe0fbb83-09d0-4df7-bae2-baf76f84c714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:38.370328 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:38.445565 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fbb83-09d0-4df7-bae2-baf76f84c714 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:38.451524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434b3cf-097c-4602-bed0-2580914da835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:38.452192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434b3cf-097c-4602-bed0-2580914da835 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:38.452706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434b3cf-097c-4602-bed0-2580914da835 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:38.453026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434b3cf-097c-4602-bed0-2580914da835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:38.470195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434b3cf-097c-4602-bed0-2580914da835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:38.475515 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434b3cf-097c-4602-bed0-2580914da835 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:38.498496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1194/2404] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:38 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:38.795729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:38.950471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:40.111658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:40.524059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:41.174016 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:41.493912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:41.593389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:42.019789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:42.297556 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:42.563776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:42.740816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:42.751436 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cc244-7b46-411e-b1ce-34a5eab5d17b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:42.753066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-570cc244-7b46-411e-b1ce-34a5eab5d17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:42.894741 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:42.957918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:42.977772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cc244-7b46-411e-b1ce-34a5eab5d17b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:42.984427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cbd17-c4af-4b9f-a00b-aebbecb09773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:42.985594 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cbd17-c4af-4b9f-a00b-aebbecb09773 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:42.986430 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cbd17-c4af-4b9f-a00b-aebbecb09773 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:42.986995 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cbd17-c4af-4b9f-a00b-aebbecb09773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:42.990476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ae6cbd17-c4af-4b9f-a00b-aebbecb09773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:43.172187 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:43.233029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cbd17-c4af-4b9f-a00b-aebbecb09773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:43.237336 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cbd17-c4af-4b9f-a00b-aebbecb09773 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:43.253720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1211/2405] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:38:43.375770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:43.490577 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:44.774371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:44.922531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:45.055774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434b3cf-097c-4602-bed0-2580914da835 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:45.377838 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434b3cf-097c-4602-bed0-2580914da835 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:45.378029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cbd17-c4af-4b9f-a00b-aebbecb09773 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:45.378134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57cd0a-96c0-4321-b97c-5aebae300aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:45.378546 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57cd0a-96c0-4321-b97c-5aebae300aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:45.379085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57cd0a-96c0-4321-b97c-5aebae300aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:45.379582 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57cd0a-96c0-4321-b97c-5aebae300aa0 admin admin] PATH_INFO: `/v3/users/2378b8940a9846d09f8e1b35405fd3d5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:45.381903 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57cd0a-96c0-4321-b97c-5aebae300aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2378b8940a9846d09f8e1b35405fd3d5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:45.384356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57cd0a-96c0-4321-b97c-5aebae300aa0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:45.388212 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cbd17-c4af-4b9f-a00b-aebbecb09773 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:45.392444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022df26c-8953-4582-81ff-d1bcea6fe3fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:45.393167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022df26c-8953-4582-81ff-d1bcea6fe3fc service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:45.393450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022df26c-8953-4582-81ff-d1bcea6fe3fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:45.393717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022df26c-8953-4582-81ff-d1bcea6fe3fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:45.498024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022df26c-8953-4582-81ff-d1bcea6fe3fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:45.498024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022df26c-8953-4582-81ff-d1bcea6fe3fc service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:45.506918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1212/2406] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:45.729409 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0b57cd0a-96c0-4321-b97c-5aebae300aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2378b8940a9846d09f8e1b35405fd3d5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:45.769611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:45.834019 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0b57cd0a-96c0-4321-b97c-5aebae300aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2378b8940a9846d09f8e1b35405fd3d5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:45.867785 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0b57cd0a-96c0-4321-b97c-5aebae300aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2378b8940a9846d09f8e1b35405fd3d5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:45.931714 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0b57cd0a-96c0-4321-b97c-5aebae300aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2378b8940a9846d09f8e1b35405fd3d5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:45.933698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0b57cd0a-96c0-4321-b97c-5aebae300aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2378b8940a9846d09f8e1b35405fd3d5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:45.968411 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188fc44-dadb-47fe-9ce7-17862b005b66 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:45.969007 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1195/2407] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:45 2022] DELETE /identity/v3/users/2378b8940a9846d09f8e1b35405fd3d5 => generated 0 bytes in 909 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:45.969510 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188fc44-dadb-47fe-9ce7-17862b005b66 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:45.969997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188fc44-dadb-47fe-9ce7-17862b005b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:46.016745 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6188fc44-dadb-47fe-9ce7-17862b005b66 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:46.019189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6188fc44-dadb-47fe-9ce7-17862b005b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:46.163274 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1213/2408] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:38:46.186876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57cd0a-96c0-4321-b97c-5aebae300aa0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:46.191518 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0b57cd0a-96c0-4321-b97c-5aebae300aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:46.382709 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57cd0a-96c0-4321-b97c-5aebae300aa0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:46.391510 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c4536-3688-462f-885d-004019827332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:46.392681 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c4536-3688-462f-885d-004019827332 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:46.393188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c4536-3688-462f-885d-004019827332 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:46.393689 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c4536-3688-462f-885d-004019827332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:46.409229 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:46.417825 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c4536-3688-462f-885d-004019827332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:46.419792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c4536-3688-462f-885d-004019827332 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:46.441805 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1196/2409] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:46.730339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:47.003980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:47.340317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:47.348922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188fc44-dadb-47fe-9ce7-17862b005b66 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:47.351141 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6188fc44-dadb-47fe-9ce7-17862b005b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:47.382918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188fc44-dadb-47fe-9ce7-17862b005b66 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:47.410143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78456ef3-b306-4a18-ab90-5854ab1678dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:47.410143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456ef3-b306-4a18-ab90-5854ab1678dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:47.410143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456ef3-b306-4a18-ab90-5854ab1678dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:47.410143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456ef3-b306-4a18-ab90-5854ab1678dc admin admin] PATH_INFO: `/v3/projects/d79377fc32c447248f3c5e2b4fd16929` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:47.411442 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78456ef3-b306-4a18-ab90-5854ab1678dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d79377fc32c447248f3c5e2b4fd16929)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:47.413550 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78456ef3-b306-4a18-ab90-5854ab1678dc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:47.478840 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:47.560203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78456ef3-b306-4a18-ab90-5854ab1678dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd79377fc32c447248f3c5e2b4fd16929', 'request_id': 'req-78456ef3-b306-4a18-ab90-5854ab1678dc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:47.581034 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:47.654437 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78456ef3-b306-4a18-ab90-5854ab1678dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd79377fc32c447248f3c5e2b4fd16929', 'request_id': 'req-78456ef3-b306-4a18-ab90-5854ab1678dc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:47.668243 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78456ef3-b306-4a18-ab90-5854ab1678dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd79377fc32c447248f3c5e2b4fd16929', 'request_id': 'req-78456ef3-b306-4a18-ab90-5854ab1678dc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:47.714526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:47.722309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78456ef3-b306-4a18-ab90-5854ab1678dc admin admin] The token cache is being invalidate because project d79377fc32c447248f3c5e2b4fd16929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:47.722908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78456ef3-b306-4a18-ab90-5854ab1678dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:47.724170 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78456ef3-b306-4a18-ab90-5854ab1678dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:47.727904 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1214/2410] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:47 2022] DELETE /identity/v3/projects/d79377fc32c447248f3c5e2b4fd16929 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:47.733575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c4536-3688-462f-885d-004019827332 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:47.749969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c4536-3688-462f-885d-004019827332 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:47.865906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981d381-cd07-4e11-9564-c3b5c1ef4c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:47.868291 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981d381-cd07-4e11-9564-c3b5c1ef4c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:47.869052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981d381-cd07-4e11-9564-c3b5c1ef4c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:47.869675 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981d381-cd07-4e11-9564-c3b5c1ef4c20 admin admin] PATH_INFO: `/v3/users/4e23ffd4366e4646adb22ec83fb54c2d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:47.873455 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981d381-cd07-4e11-9564-c3b5c1ef4c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e23ffd4366e4646adb22ec83fb54c2d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:47.877797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981d381-cd07-4e11-9564-c3b5c1ef4c20 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:48.112435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:48.140632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9981d381-cd07-4e11-9564-c3b5c1ef4c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e23ffd4366e4646adb22ec83fb54c2d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:48.176790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:48.226273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9981d381-cd07-4e11-9564-c3b5c1ef4c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e23ffd4366e4646adb22ec83fb54c2d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:48.244173 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9981d381-cd07-4e11-9564-c3b5c1ef4c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e23ffd4366e4646adb22ec83fb54c2d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:48.257828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9981d381-cd07-4e11-9564-c3b5c1ef4c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e23ffd4366e4646adb22ec83fb54c2d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:48.258571 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9981d381-cd07-4e11-9564-c3b5c1ef4c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e23ffd4366e4646adb22ec83fb54c2d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:48.265377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1197/2411] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:47 2022] DELETE /identity/v3/users/4e23ffd4366e4646adb22ec83fb54c2d => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:38:48.559596 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:48.599022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50a35b-e7e7-4455-8340-28f1d61dcac7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:48.599474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50a35b-e7e7-4455-8340-28f1d61dcac7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:48.599983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50a35b-e7e7-4455-8340-28f1d61dcac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:48.646156 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bb50a35b-e7e7-4455-8340-28f1d61dcac7 None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:48.648337 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bb50a35b-e7e7-4455-8340-28f1d61dcac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:48.715972 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1215/2412] 10.222.0.16 () {58 vars in 967 bytes} [Wed Jul 20 19:38:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:48.730607 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981d381-cd07-4e11-9564-c3b5c1ef4c20 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:48.732240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9981d381-cd07-4e11-9564-c3b5c1ef4c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:48.807294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981d381-cd07-4e11-9564-c3b5c1ef4c20 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:48.818023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5bb71-6a23-4859-9d8d-ef2c15ecdeca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:48.818812 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5bb71-6a23-4859-9d8d-ef2c15ecdeca service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:48.819940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5bb71-6a23-4859-9d8d-ef2c15ecdeca service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:48.820385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5bb71-6a23-4859-9d8d-ef2c15ecdeca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:48.835728 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5bb71-6a23-4859-9d8d-ef2c15ecdeca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:48.838752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5bb71-6a23-4859-9d8d-ef2c15ecdeca service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:48.846351 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50a35b-e7e7-4455-8340-28f1d61dcac7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:48.848987 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bb50a35b-e7e7-4455-8340-28f1d61dcac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:48.852106 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1198/2413] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:38:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:38:48.922949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:48.957087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50a35b-e7e7-4455-8340-28f1d61dcac7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:48.962301 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb7813-9bbc-4a10-abcb-a07001c61f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:48.962949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7813-9bbc-4a10-abcb-a07001c61f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:48.963231 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7813-9bbc-4a10-abcb-a07001c61f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:48.963507 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7813-9bbc-4a10-abcb-a07001c61f3f admin admin] PATH_INFO: `/v3/projects/3d333c139b254b31a43fe2036e499a77` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:48.964786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb7813-9bbc-4a10-abcb-a07001c61f3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d333c139b254b31a43fe2036e499a77)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:48.966806 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb7813-9bbc-4a10-abcb-a07001c61f3f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:49.121006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1abb7813-9bbc-4a10-abcb-a07001c61f3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d333c139b254b31a43fe2036e499a77', 'request_id': 'req-1abb7813-9bbc-4a10-abcb-a07001c61f3f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:49.215699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1abb7813-9bbc-4a10-abcb-a07001c61f3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d333c139b254b31a43fe2036e499a77', 'request_id': 'req-1abb7813-9bbc-4a10-abcb-a07001c61f3f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:49.224050 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1abb7813-9bbc-4a10-abcb-a07001c61f3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d333c139b254b31a43fe2036e499a77', 'request_id': 'req-1abb7813-9bbc-4a10-abcb-a07001c61f3f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:49.246261 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1abb7813-9bbc-4a10-abcb-a07001c61f3f admin admin] The token cache is being invalidate because project 3d333c139b254b31a43fe2036e499a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:49.248469 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1abb7813-9bbc-4a10-abcb-a07001c61f3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:49.249870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1abb7813-9bbc-4a10-abcb-a07001c61f3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:49.258955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1216/2414] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:48 2022] DELETE /identity/v3/projects/3d333c139b254b31a43fe2036e499a77 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:49.260823 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6150d-85c7-4641-b17f-76f2a406d5a3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:49.263410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6150d-85c7-4641-b17f-76f2a406d5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:49.263410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6150d-85c7-4641-b17f-76f2a406d5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:49.283179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-47b6150d-85c7-4641-b17f-76f2a406d5a3 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:49.284491 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-47b6150d-85c7-4641-b17f-76f2a406d5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:49.375216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1199/2415] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:38:49.383709 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02468084-02e8-435f-86ee-aca82b8da80f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:49.386595 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02468084-02e8-435f-86ee-aca82b8da80f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:49.386595 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02468084-02e8-435f-86ee-aca82b8da80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:49.407216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-02468084-02e8-435f-86ee-aca82b8da80f None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:49.408472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-02468084-02e8-435f-86ee-aca82b8da80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:49.422898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1217/2416] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:49.423672 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6150d-85c7-4641-b17f-76f2a406d5a3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:49.439841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6150d-85c7-4641-b17f-76f2a406d5a3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:49.447435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847d8d3-813e-4e3b-9702-ee35dda667e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:49.448241 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847d8d3-813e-4e3b-9702-ee35dda667e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:49.448564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847d8d3-813e-4e3b-9702-ee35dda667e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:49.448942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847d8d3-813e-4e3b-9702-ee35dda667e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:49.450971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847d8d3-813e-4e3b-9702-ee35dda667e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:38:49.451288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847d8d3-813e-4e3b-9702-ee35dda667e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:49.453031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847d8d3-813e-4e3b-9702-ee35dda667e2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:49.468088 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1200/2417] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:38:49.473647 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02468084-02e8-435f-86ee-aca82b8da80f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:49.484733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02468084-02e8-435f-86ee-aca82b8da80f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:49.489671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c086b-f69a-4ad5-b17f-d66e5c325cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:49.492791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c086b-f69a-4ad5-b17f-d66e5c325cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:49.492791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c086b-f69a-4ad5-b17f-d66e5c325cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:49.492791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c086b-f69a-4ad5-b17f-d66e5c325cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:49.492791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c086b-f69a-4ad5-b17f-d66e5c325cf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:49.493594 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c086b-f69a-4ad5-b17f-d66e5c325cf3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:49.642325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1218/2418] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:38:49 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:49.648254 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847d8d3-813e-4e3b-9702-ee35dda667e2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:49.649905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:49.658599 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847d8d3-813e-4e3b-9702-ee35dda667e2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:49.728256 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b7aa0-827a-44d8-bc3b-dee409571c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:49.728951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b7aa0-827a-44d8-bc3b-dee409571c8b admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:49.729222 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b7aa0-827a-44d8-bc3b-dee409571c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:49.729494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b7aa0-827a-44d8-bc3b-dee409571c8b admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:49.730282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b7aa0-827a-44d8-bc3b-dee409571c8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:49.732837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b7aa0-827a-44d8-bc3b-dee409571c8b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:49.896748 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1201/2419] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:38:49 2022] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:49.902060 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c086b-f69a-4ad5-b17f-d66e5c325cf3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:49.924667 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c086b-f69a-4ad5-b17f-d66e5c325cf3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:49.930532 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81430d-92fb-4478-855e-2d94cc20e311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:49.931339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81430d-92fb-4478-855e-2d94cc20e311 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:49.931621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81430d-92fb-4478-855e-2d94cc20e311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:49.931889 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81430d-92fb-4478-855e-2d94cc20e311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:49.932627 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81430d-92fb-4478-855e-2d94cc20e311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:49.934254 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81430d-92fb-4478-855e-2d94cc20e311 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:49.950572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1219/2420] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:49.970904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b7aa0-827a-44d8-bc3b-dee409571c8b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:49.970904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b7aa0-827a-44d8-bc3b-dee409571c8b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:49.971438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646a5cd-047a-4a05-93dc-890fe248475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:49.971955 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646a5cd-047a-4a05-93dc-890fe248475a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:49.972447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646a5cd-047a-4a05-93dc-890fe248475a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:49.972886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646a5cd-047a-4a05-93dc-890fe248475a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:49.973826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646a5cd-047a-4a05-93dc-890fe248475a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:49.976336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646a5cd-047a-4a05-93dc-890fe248475a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:49.988028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1202/2421] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:38:49.995607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81430d-92fb-4478-855e-2d94cc20e311 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:50.017433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81430d-92fb-4478-855e-2d94cc20e311 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:50.022863 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268791eb-9c8a-4d79-a8ff-68f2b9336fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:50.023781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268791eb-9c8a-4d79-a8ff-68f2b9336fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:50.024062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268791eb-9c8a-4d79-a8ff-68f2b9336fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:50.024335 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268791eb-9c8a-4d79-a8ff-68f2b9336fd0 admin admin] PATH_INFO: `/v3/projects/aafd9f4dc342416b96bf962e5b7c2fc4/users/c53ff064f33e48b8a9b9a48ee4821859/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:50.045000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268791eb-9c8a-4d79-a8ff-68f2b9336fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aafd9f4dc342416b96bf962e5b7c2fc4, user_id=c53ff064f33e48b8a9b9a48ee4821859, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:50.047746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268791eb-9c8a-4d79-a8ff-68f2b9336fd0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:50.193831 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1220/2422] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:49 2022] PUT /identity/v3/projects/aafd9f4dc342416b96bf962e5b7c2fc4/users/c53ff064f33e48b8a9b9a48ee4821859/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:50.207465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0fff8-f464-4f68-be8e-d8bc6fff6563 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:50.207769 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0fff8-f464-4f68-be8e-d8bc6fff6563 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:50.208049 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0fff8-f464-4f68-be8e-d8bc6fff6563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:50.241501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cfe0fff8-f464-4f68-be8e-d8bc6fff6563 None None] MFA Rules not processed for user `c53ff064f33e48b8a9b9a48ee4821859`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:50.241501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cfe0fff8-f464-4f68-be8e-d8bc6fff6563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:50.326444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1203/2423] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:50.333192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268791eb-9c8a-4d79-a8ff-68f2b9336fd0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:50.361913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:50.416595 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268791eb-9c8a-4d79-a8ff-68f2b9336fd0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:50.423084 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed3286-3a2d-4460-b9c0-defdbc207430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:50.425295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed3286-3a2d-4460-b9c0-defdbc207430 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:50.425295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed3286-3a2d-4460-b9c0-defdbc207430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:50.425295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed3286-3a2d-4460-b9c0-defdbc207430 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:50.425295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed3286-3a2d-4460-b9c0-defdbc207430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:50.427343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed3286-3a2d-4460-b9c0-defdbc207430 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:50.556613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1221/2424] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:38:50 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:38:50.557941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0fff8-f464-4f68-be8e-d8bc6fff6563 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:50.571004 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0fff8-f464-4f68-be8e-d8bc6fff6563 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:50.664854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd858c8-d085-4e1c-b7d3-037d6bbf7cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:50.666268 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd858c8-d085-4e1c-b7d3-037d6bbf7cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:50.666654 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd858c8-d085-4e1c-b7d3-037d6bbf7cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:50.667057 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd858c8-d085-4e1c-b7d3-037d6bbf7cc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:50.667970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd858c8-d085-4e1c-b7d3-037d6bbf7cc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:50.670381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd858c8-d085-4e1c-b7d3-037d6bbf7cc2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:50.794838 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1204/2425] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:38:50 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:50.798423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed3286-3a2d-4460-b9c0-defdbc207430 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:50.812902 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed3286-3a2d-4460-b9c0-defdbc207430 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:50.819229 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3295c-cddb-41de-a4e1-a824c479e7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:50.820767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3295c-cddb-41de-a4e1-a824c479e7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:50.821115 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3295c-cddb-41de-a4e1-a824c479e7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:50.822205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3295c-cddb-41de-a4e1-a824c479e7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:50.822205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3295c-cddb-41de-a4e1-a824c479e7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:50.824858 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3295c-cddb-41de-a4e1-a824c479e7f4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:50.842388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1222/2426] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:38:50.843895 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd858c8-d085-4e1c-b7d3-037d6bbf7cc2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:50.856687 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd858c8-d085-4e1c-b7d3-037d6bbf7cc2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:50.861577 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d24f0-6bb6-475b-8096-642cc6dd9001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:50.862492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d24f0-6bb6-475b-8096-642cc6dd9001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:50.869246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d24f0-6bb6-475b-8096-642cc6dd9001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:50.869246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d24f0-6bb6-475b-8096-642cc6dd9001 admin admin] PATH_INFO: `/v3/projects/b6e064ff0c20480f9d173872a7b00e22/users/a1b627440b76401e9c5cf505c9429f7a/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:50.879869 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d24f0-6bb6-475b-8096-642cc6dd9001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e064ff0c20480f9d173872a7b00e22, user_id=a1b627440b76401e9c5cf505c9429f7a, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:50.882603 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d24f0-6bb6-475b-8096-642cc6dd9001 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:50.987772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1205/2427] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:50 2022] PUT /identity/v3/projects/b6e064ff0c20480f9d173872a7b00e22/users/a1b627440b76401e9c5cf505c9429f7a/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:50.992536 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3295c-cddb-41de-a4e1-a824c479e7f4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:51.003058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3295c-cddb-41de-a4e1-a824c479e7f4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:51.073493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c24c1-82a9-4373-b770-a9560751585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:51.074280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c24c1-82a9-4373-b770-a9560751585d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:51.074547 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c24c1-82a9-4373-b770-a9560751585d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:51.074856 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c24c1-82a9-4373-b770-a9560751585d admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:51.075776 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c24c1-82a9-4373-b770-a9560751585d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:51.077790 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c24c1-82a9-4373-b770-a9560751585d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:51.098649 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1223/2428] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:38:51.102498 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d24f0-6bb6-475b-8096-642cc6dd9001 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:51.122482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d24f0-6bb6-475b-8096-642cc6dd9001 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:51.131327 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2ac73-f46e-446d-a938-230358fc8ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:51.133732 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ac73-f46e-446d-a938-230358fc8ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:51.133732 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ac73-f46e-446d-a938-230358fc8ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:51.133732 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ac73-f46e-446d-a938-230358fc8ff5 admin admin] PATH_INFO: `/v3/projects/b6e064ff0c20480f9d173872a7b00e22/users/a1b627440b76401e9c5cf505c9429f7a/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:51.136032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2ac73-f46e-446d-a938-230358fc8ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e064ff0c20480f9d173872a7b00e22, user_id=a1b627440b76401e9c5cf505c9429f7a, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:51.138895 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2ac73-f46e-446d-a938-230358fc8ff5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:51.152660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1206/2429] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:51 2022] PUT /identity/v3/projects/b6e064ff0c20480f9d173872a7b00e22/users/a1b627440b76401e9c5cf505c9429f7a/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:51.163585 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c780df1-6a9e-4246-ad84-b27ab42c0f65 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:51.163585 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c780df1-6a9e-4246-ad84-b27ab42c0f65 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:51.163917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c780df1-6a9e-4246-ad84-b27ab42c0f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:51.196418 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9c780df1-6a9e-4246-ad84-b27ab42c0f65 None None] MFA Rules not processed for user `a1b627440b76401e9c5cf505c9429f7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:51.197768 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9c780df1-6a9e-4246-ad84-b27ab42c0f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:51.224969 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:51.273863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:51.284210 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1224/2430] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:38:51.296863 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2ac73-f46e-446d-a938-230358fc8ff5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:51.298770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a5c2ac73-f46e-446d-a938-230358fc8ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:51.373348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2ac73-f46e-446d-a938-230358fc8ff5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:51.377170 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475731c-a03f-4b67-b325-68ffc7fc043e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:51.377848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475731c-a03f-4b67-b325-68ffc7fc043e service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:51.378156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475731c-a03f-4b67-b325-68ffc7fc043e service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:51.378434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475731c-a03f-4b67-b325-68ffc7fc043e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:51.389677 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475731c-a03f-4b67-b325-68ffc7fc043e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:51.391410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475731c-a03f-4b67-b325-68ffc7fc043e service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:51.402946 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1207/2431] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:52.549173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:52.560535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c780df1-6a9e-4246-ad84-b27ab42c0f65 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:52.575021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c780df1-6a9e-4246-ad84-b27ab42c0f65 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:52.582601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b50712-3418-467a-b57b-a242ee9a077f tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b627440b76401e9c5cf505c9429f7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6e064ff0c20480f9d173872a7b00e22', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:52.583847 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b50712-3418-467a-b57b-a242ee9a077f tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:52.584491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b50712-3418-467a-b57b-a242ee9a077f tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:52.584871 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b50712-3418-467a-b57b-a242ee9a077f tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:52.586465 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b50712-3418-467a-b57b-a242ee9a077f tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:38:52.587183 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b50712-3418-467a-b57b-a242ee9a077f tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:52.589203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b50712-3418-467a-b57b-a242ee9a077f tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:52.610864 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1225/2432] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:38:52.614945 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475731c-a03f-4b67-b325-68ffc7fc043e service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:52.640326 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475731c-a03f-4b67-b325-68ffc7fc043e service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:52.647236 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:52.657006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c4ca5-4525-483e-ab2e-acc4a936b442 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b627440b76401e9c5cf505c9429f7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6e064ff0c20480f9d173872a7b00e22', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:52.658368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c4ca5-4525-483e-ab2e-acc4a936b442 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:52.659136 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c4ca5-4525-483e-ab2e-acc4a936b442 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:52.659542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c4ca5-4525-483e-ab2e-acc4a936b442 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:52.661158 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c4ca5-4525-483e-ab2e-acc4a936b442 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:52.664508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c4ca5-4525-483e-ab2e-acc4a936b442 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:52.800253 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1208/2433] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:38:52 2022] POST /identity/v3/projects => generated 355 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:52.801769 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b50712-3418-467a-b57b-a242ee9a077f tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:52.814416 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b50712-3418-467a-b57b-a242ee9a077f tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:52.890234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d036c5-afc5-481d-974d-4891730ad3c9 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b627440b76401e9c5cf505c9429f7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6e064ff0c20480f9d173872a7b00e22', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:52.891390 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d036c5-afc5-481d-974d-4891730ad3c9 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:52.891575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d036c5-afc5-481d-974d-4891730ad3c9 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:52.891812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d036c5-afc5-481d-974d-4891730ad3c9 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:52.892599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d036c5-afc5-481d-974d-4891730ad3c9 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:38:52.892937 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d036c5-afc5-481d-974d-4891730ad3c9 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:52.894660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d036c5-afc5-481d-974d-4891730ad3c9 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:52.911218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1226/2434] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:38:52.962508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c4ca5-4525-483e-ab2e-acc4a936b442 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:52.974412 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c4ca5-4525-483e-ab2e-acc4a936b442 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:52.981265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339b181-5bc0-4268-8cbe-869dde824328 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b627440b76401e9c5cf505c9429f7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6e064ff0c20480f9d173872a7b00e22', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:52.982523 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339b181-5bc0-4268-8cbe-869dde824328 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:52.982969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339b181-5bc0-4268-8cbe-869dde824328 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:52.983316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339b181-5bc0-4268-8cbe-869dde824328 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] PATH_INFO: `/v3/projects/62c20929f010423c8dfde1e5f590ad5f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:52.984760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339b181-5bc0-4268-8cbe-869dde824328 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] RBAC: Authorizing `identity:delete_project(project_id=62c20929f010423c8dfde1e5f590ad5f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:52.987444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339b181-5bc0-4268-8cbe-869dde824328 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:53.201023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c339b181-5bc0-4268-8cbe-869dde824328 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c20929f010423c8dfde1e5f590ad5f', 'request_id': 'req-c339b181-5bc0-4268-8cbe-869dde824328'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:53.209130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c339b181-5bc0-4268-8cbe-869dde824328 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c20929f010423c8dfde1e5f590ad5f', 'request_id': 'req-c339b181-5bc0-4268-8cbe-869dde824328'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:53.308602 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c339b181-5bc0-4268-8cbe-869dde824328 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c20929f010423c8dfde1e5f590ad5f', 'request_id': 'req-c339b181-5bc0-4268-8cbe-869dde824328'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:53.324161 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c339b181-5bc0-4268-8cbe-869dde824328 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] The token cache is being invalidate because project 62c20929f010423c8dfde1e5f590ad5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:53.324527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c339b181-5bc0-4268-8cbe-869dde824328 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:53.325180 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c339b181-5bc0-4268-8cbe-869dde824328 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:53.327178 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1209/2435] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:52 2022] DELETE /identity/v3/projects/62c20929f010423c8dfde1e5f590ad5f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:53.393760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d036c5-afc5-481d-974d-4891730ad3c9 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:53.393760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b8d036c5-afc5-481d-974d-4891730ad3c9 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:53.463205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d036c5-afc5-481d-974d-4891730ad3c9 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:53.532161 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88101e0b-7321-4d1f-88c4-02ade21aa823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:53.533041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88101e0b-7321-4d1f-88c4-02ade21aa823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:53.533319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88101e0b-7321-4d1f-88c4-02ade21aa823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:53.533618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88101e0b-7321-4d1f-88c4-02ade21aa823 admin admin] PATH_INFO: `/v3/users/56f23722191b4d8dac153ffea9e743c3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:53.535153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88101e0b-7321-4d1f-88c4-02ade21aa823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f23722191b4d8dac153ffea9e743c3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:53.537092 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88101e0b-7321-4d1f-88c4-02ade21aa823 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:53.625723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339b181-5bc0-4268-8cbe-869dde824328 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:53.627375 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c339b181-5bc0-4268-8cbe-869dde824328 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:53.648836 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339b181-5bc0-4268-8cbe-869dde824328 tempest-VolumeQuotaClassesTest-1607311612 tempest-VolumeQuotaClassesTest-1607311612-project-admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:53.654112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c29cf-863e-4416-b4f9-d10725224413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:53.655134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c29cf-863e-4416-b4f9-d10725224413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:53.655489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c29cf-863e-4416-b4f9-d10725224413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:53.655837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c29cf-863e-4416-b4f9-d10725224413 admin admin] PATH_INFO: `/v3/users/70ffc39498e348b4ab2513633b388f23` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:53.657259 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c29cf-863e-4416-b4f9-d10725224413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ffc39498e348b4ab2513633b388f23)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:53.659504 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c29cf-863e-4416-b4f9-d10725224413 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:53.742723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-88101e0b-7321-4d1f-88c4-02ade21aa823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f23722191b4d8dac153ffea9e743c3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:53.852755 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-88101e0b-7321-4d1f-88c4-02ade21aa823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f23722191b4d8dac153ffea9e743c3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:53.853958 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-88101e0b-7321-4d1f-88c4-02ade21aa823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f23722191b4d8dac153ffea9e743c3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:53.874760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-88101e0b-7321-4d1f-88c4-02ade21aa823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f23722191b4d8dac153ffea9e743c3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:53.886989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-546c29cf-863e-4416-b4f9-d10725224413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ffc39498e348b4ab2513633b388f23'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:53.890480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-88101e0b-7321-4d1f-88c4-02ade21aa823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f23722191b4d8dac153ffea9e743c3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:53.900064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1227/2436] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:53 2022] DELETE /identity/v3/users/56f23722191b4d8dac153ffea9e743c3 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:53.967224 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-546c29cf-863e-4416-b4f9-d10725224413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ffc39498e348b4ab2513633b388f23'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:53.986403 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-546c29cf-863e-4416-b4f9-d10725224413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ffc39498e348b4ab2513633b388f23'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:54.015299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-546c29cf-863e-4416-b4f9-d10725224413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ffc39498e348b4ab2513633b388f23'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:54.016793 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-546c29cf-863e-4416-b4f9-d10725224413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ffc39498e348b4ab2513633b388f23'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:54.036732 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1210/2437] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:53 2022] DELETE /identity/v3/users/70ffc39498e348b4ab2513633b388f23 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:38:54.042244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8afdd7-9643-4b0c-966c-ae63c1b13ab6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:54.042939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8afdd7-9643-4b0c-966c-ae63c1b13ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:54.043427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8afdd7-9643-4b0c-966c-ae63c1b13ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:54.079759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9a8afdd7-9643-4b0c-966c-ae63c1b13ab6 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:54.081180 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9a8afdd7-9643-4b0c-966c-ae63c1b13ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:54.155286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1228/2438] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:54.172367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c29cf-863e-4416-b4f9-d10725224413 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:54.174424 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-546c29cf-863e-4416-b4f9-d10725224413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:54.185949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8afdd7-9643-4b0c-966c-ae63c1b13ab6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:54.187502 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9a8afdd7-9643-4b0c-966c-ae63c1b13ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:54.200157 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8afdd7-9643-4b0c-966c-ae63c1b13ab6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:54.205514 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cc3ab-8fcc-4253-9a7c-4c569293c02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:54.206341 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cc3ab-8fcc-4253-9a7c-4c569293c02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:54.206621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cc3ab-8fcc-4253-9a7c-4c569293c02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:54.206950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cc3ab-8fcc-4253-9a7c-4c569293c02e admin admin] PATH_INFO: `/v3/users/c53ff064f33e48b8a9b9a48ee4821859` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:54.208267 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cc3ab-8fcc-4253-9a7c-4c569293c02e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c53ff064f33e48b8a9b9a48ee4821859)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:54.210343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cc3ab-8fcc-4253-9a7c-4c569293c02e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:54.229474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:54.260697 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c29cf-863e-4416-b4f9-d10725224413 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:54.264367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865e8d8-18d0-44f9-b002-0d27a75ea86b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:54.265020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865e8d8-18d0-44f9-b002-0d27a75ea86b service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:54.265302 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865e8d8-18d0-44f9-b002-0d27a75ea86b service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:54.265569 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865e8d8-18d0-44f9-b002-0d27a75ea86b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:54.276414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865e8d8-18d0-44f9-b002-0d27a75ea86b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:54.277892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865e8d8-18d0-44f9-b002-0d27a75ea86b service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:54.295635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1211/2439] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:54.296409 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865e8d8-18d0-44f9-b002-0d27a75ea86b service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:54.297763 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6865e8d8-18d0-44f9-b002-0d27a75ea86b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:54.314568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:54.319292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865e8d8-18d0-44f9-b002-0d27a75ea86b service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:54.335217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78d3e9-2cca-46b7-9d66-471066d27108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:54.337761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78d3e9-2cca-46b7-9d66-471066d27108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:54.338051 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78d3e9-2cca-46b7-9d66-471066d27108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:54.338327 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78d3e9-2cca-46b7-9d66-471066d27108 admin admin] PATH_INFO: `/v3/projects/dbe1b78ac89a45ca9701946d274b736f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:54.339788 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78d3e9-2cca-46b7-9d66-471066d27108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe1b78ac89a45ca9701946d274b736f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:54.341889 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78d3e9-2cca-46b7-9d66-471066d27108 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:54.447490 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-126cc3ab-8fcc-4253-9a7c-4c569293c02e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c53ff064f33e48b8a9b9a48ee4821859'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:54.495935 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5d78d3e9-2cca-46b7-9d66-471066d27108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe1b78ac89a45ca9701946d274b736f', 'request_id': 'req-5d78d3e9-2cca-46b7-9d66-471066d27108'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:54.502485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5d78d3e9-2cca-46b7-9d66-471066d27108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe1b78ac89a45ca9701946d274b736f', 'request_id': 'req-5d78d3e9-2cca-46b7-9d66-471066d27108'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:54.530816 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-126cc3ab-8fcc-4253-9a7c-4c569293c02e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c53ff064f33e48b8a9b9a48ee4821859'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:54.531637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-126cc3ab-8fcc-4253-9a7c-4c569293c02e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c53ff064f33e48b8a9b9a48ee4821859'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:54.545619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-126cc3ab-8fcc-4253-9a7c-4c569293c02e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c53ff064f33e48b8a9b9a48ee4821859'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:54.553315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-126cc3ab-8fcc-4253-9a7c-4c569293c02e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c53ff064f33e48b8a9b9a48ee4821859'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:54.562155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1229/2440] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:54 2022] DELETE /identity/v3/users/c53ff064f33e48b8a9b9a48ee4821859 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:54.566826 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebe571-5e82-4534-9a5c-ea5264876ca3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:54.567136 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebe571-5e82-4534-9a5c-ea5264876ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:54.567410 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebe571-5e82-4534-9a5c-ea5264876ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:54.589915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-77ebe571-5e82-4534-9a5c-ea5264876ca3 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:54.591427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-77ebe571-5e82-4534-9a5c-ea5264876ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:54.622461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5d78d3e9-2cca-46b7-9d66-471066d27108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe1b78ac89a45ca9701946d274b736f', 'request_id': 'req-5d78d3e9-2cca-46b7-9d66-471066d27108'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:54.636596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5d78d3e9-2cca-46b7-9d66-471066d27108 admin admin] The token cache is being invalidate because project dbe1b78ac89a45ca9701946d274b736f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:54.637477 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5d78d3e9-2cca-46b7-9d66-471066d27108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:54.638042 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5d78d3e9-2cca-46b7-9d66-471066d27108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:54.640472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1212/2441] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:54 2022] DELETE /identity/v3/projects/dbe1b78ac89a45ca9701946d274b736f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:54.644832 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9b37d-c25e-4667-9244-6e0778ca2bb2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:54.645285 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9b37d-c25e-4667-9244-6e0778ca2bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:54.645656 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9b37d-c25e-4667-9244-6e0778ca2bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:54.667054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4be9b37d-c25e-4667-9244-6e0778ca2bb2 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:54.668406 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4be9b37d-c25e-4667-9244-6e0778ca2bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:54.669129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1230/2442] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:54.679204 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebe571-5e82-4534-9a5c-ea5264876ca3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:54.681260 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-77ebe571-5e82-4534-9a5c-ea5264876ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:54.686362 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1213/2443] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:38:54.694436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e88af1-985f-450d-b445-d2a7683a53fe None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:54.695439 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e88af1-985f-450d-b445-d2a7683a53fe None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:54.695918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e88af1-985f-450d-b445-d2a7683a53fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:54.720517 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-87e88af1-985f-450d-b445-d2a7683a53fe None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:54.722438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-87e88af1-985f-450d-b445-d2a7683a53fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:54.732114 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1214/2444] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:38:54.736603 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e88af1-985f-450d-b445-d2a7683a53fe None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:54.750808 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e88af1-985f-450d-b445-d2a7683a53fe None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:54.755627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d637b-1b71-460b-8ee4-6955ba7ec2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:54.756329 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d637b-1b71-460b-8ee4-6955ba7ec2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:54.756736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d637b-1b71-460b-8ee4-6955ba7ec2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:54.757042 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d637b-1b71-460b-8ee4-6955ba7ec2c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:54.758361 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d637b-1b71-460b-8ee4-6955ba7ec2c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:38:54.758846 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d637b-1b71-460b-8ee4-6955ba7ec2c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:54.758975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebe571-5e82-4534-9a5c-ea5264876ca3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:54.760474 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d637b-1b71-460b-8ee4-6955ba7ec2c8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:54.762919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1aea8-9206-42b9-8952-dd8412464dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:54.763732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1aea8-9206-42b9-8952-dd8412464dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:54.764010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1aea8-9206-42b9-8952-dd8412464dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:54.764467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1aea8-9206-42b9-8952-dd8412464dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:54.772966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1215/2445] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:38:54.775176 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1aea8-9206-42b9-8952-dd8412464dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:54.776761 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1aea8-9206-42b9-8952-dd8412464dc6 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:54.778015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d637b-1b71-460b-8ee4-6955ba7ec2c8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:54.787693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1231/2446] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:38:54.788113 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d637b-1b71-460b-8ee4-6955ba7ec2c8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:54.793792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd58151-e27d-41d8-a093-665a0c021cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:54.794467 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd58151-e27d-41d8-a093-665a0c021cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:54.794780 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd58151-e27d-41d8-a093-665a0c021cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:54.795062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd58151-e27d-41d8-a093-665a0c021cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:54.795771 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd58151-e27d-41d8-a093-665a0c021cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:54.797916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd58151-e27d-41d8-a093-665a0c021cb2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:54.864747 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1aea8-9206-42b9-8952-dd8412464dc6 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:54.866722 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-88d1aea8-9206-42b9-8952-dd8412464dc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:54.881774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1aea8-9206-42b9-8952-dd8412464dc6 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:54.887018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77be519-0bbc-4d5a-9aea-23bf88bd5383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:54.888218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77be519-0bbc-4d5a-9aea-23bf88bd5383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:54.888669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77be519-0bbc-4d5a-9aea-23bf88bd5383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:54.888940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77be519-0bbc-4d5a-9aea-23bf88bd5383 admin admin] PATH_INFO: `/v3/projects/dd5bd179ea864a2f8667da84f8bee470` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:54.890477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77be519-0bbc-4d5a-9aea-23bf88bd5383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5bd179ea864a2f8667da84f8bee470)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:54.892514 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77be519-0bbc-4d5a-9aea-23bf88bd5383 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:54.906896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1216/2447] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:38:54 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:38:54.911664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd58151-e27d-41d8-a093-665a0c021cb2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:54.988691 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd58151-e27d-41d8-a093-665a0c021cb2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:54.993496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadafa4-7096-40d6-9c49-605456b8cdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:54.994182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadafa4-7096-40d6-9c49-605456b8cdd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:54.994457 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadafa4-7096-40d6-9c49-605456b8cdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:54.994760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadafa4-7096-40d6-9c49-605456b8cdd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:54.995468 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadafa4-7096-40d6-9c49-605456b8cdd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:54.997416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadafa4-7096-40d6-9c49-605456b8cdd7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:55.032154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d77be519-0bbc-4d5a-9aea-23bf88bd5383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5bd179ea864a2f8667da84f8bee470', 'request_id': 'req-d77be519-0bbc-4d5a-9aea-23bf88bd5383'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:55.125891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:55.193858 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d77be519-0bbc-4d5a-9aea-23bf88bd5383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5bd179ea864a2f8667da84f8bee470', 'request_id': 'req-d77be519-0bbc-4d5a-9aea-23bf88bd5383'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:55.202709 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d77be519-0bbc-4d5a-9aea-23bf88bd5383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5bd179ea864a2f8667da84f8bee470', 'request_id': 'req-d77be519-0bbc-4d5a-9aea-23bf88bd5383'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:55.203003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1217/2448] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:38:54 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:55.206648 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadafa4-7096-40d6-9c49-605456b8cdd7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:55.216907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d77be519-0bbc-4d5a-9aea-23bf88bd5383 admin admin] The token cache is being invalidate because project dd5bd179ea864a2f8667da84f8bee470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:55.217284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d77be519-0bbc-4d5a-9aea-23bf88bd5383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:55.218053 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d77be519-0bbc-4d5a-9aea-23bf88bd5383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:55.219770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1232/2449] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:54 2022] DELETE /identity/v3/projects/dd5bd179ea864a2f8667da84f8bee470 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:38:55.224114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77be519-0bbc-4d5a-9aea-23bf88bd5383 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:55.225612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d77be519-0bbc-4d5a-9aea-23bf88bd5383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:55.229322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadafa4-7096-40d6-9c49-605456b8cdd7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:55.299501 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77be519-0bbc-4d5a-9aea-23bf88bd5383 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:55.307258 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971083f-e19e-4547-8c1f-a1605f0dc092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:55.307496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd9013-f0a0-43af-bf4d-2ee9db248868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:55.308089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd9013-f0a0-43af-bf4d-2ee9db248868 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:55.308427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd9013-f0a0-43af-bf4d-2ee9db248868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:55.308700 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd9013-f0a0-43af-bf4d-2ee9db248868 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:55.309184 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971083f-e19e-4547-8c1f-a1605f0dc092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:55.309445 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd9013-f0a0-43af-bf4d-2ee9db248868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:55.309818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971083f-e19e-4547-8c1f-a1605f0dc092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:55.311005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971083f-e19e-4547-8c1f-a1605f0dc092 admin admin] PATH_INFO: `/v3/users/61ef1fec5e644d0e93b96e38bd986b45` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:55.311446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd9013-f0a0-43af-bf4d-2ee9db248868 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:55.312501 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971083f-e19e-4547-8c1f-a1605f0dc092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ef1fec5e644d0e93b96e38bd986b45)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:55.316104 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971083f-e19e-4547-8c1f-a1605f0dc092 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:55.322879 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1218/2450] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:38:55.323998 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd9013-f0a0-43af-bf4d-2ee9db248868 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:55.327883 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c1dd9013-f0a0-43af-bf4d-2ee9db248868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:55.344413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd9013-f0a0-43af-bf4d-2ee9db248868 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:55.349549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad1ba1-8041-4d50-b85f-fe6e14f8b963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:55.350409 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad1ba1-8041-4d50-b85f-fe6e14f8b963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:55.350719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad1ba1-8041-4d50-b85f-fe6e14f8b963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:55.350994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad1ba1-8041-4d50-b85f-fe6e14f8b963 admin admin] PATH_INFO: `/v3/projects/aafd9f4dc342416b96bf962e5b7c2fc4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:55.353397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad1ba1-8041-4d50-b85f-fe6e14f8b963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aafd9f4dc342416b96bf962e5b7c2fc4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:55.355348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad1ba1-8041-4d50-b85f-fe6e14f8b963 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:55.533541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5971083f-e19e-4547-8c1f-a1605f0dc092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ef1fec5e644d0e93b96e38bd986b45'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:55.534493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a8ad1ba1-8041-4d50-b85f-fe6e14f8b963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aafd9f4dc342416b96bf962e5b7c2fc4', 'request_id': 'req-a8ad1ba1-8041-4d50-b85f-fe6e14f8b963'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:55.542364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a8ad1ba1-8041-4d50-b85f-fe6e14f8b963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aafd9f4dc342416b96bf962e5b7c2fc4', 'request_id': 'req-a8ad1ba1-8041-4d50-b85f-fe6e14f8b963'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:55.611069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:55.639445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5971083f-e19e-4547-8c1f-a1605f0dc092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ef1fec5e644d0e93b96e38bd986b45'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:55.640062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5971083f-e19e-4547-8c1f-a1605f0dc092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ef1fec5e644d0e93b96e38bd986b45'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:55.653196 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5971083f-e19e-4547-8c1f-a1605f0dc092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ef1fec5e644d0e93b96e38bd986b45'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:55.660447 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5971083f-e19e-4547-8c1f-a1605f0dc092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ef1fec5e644d0e93b96e38bd986b45'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:55.666533 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1233/2451] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:55 2022] DELETE /identity/v3/users/61ef1fec5e644d0e93b96e38bd986b45 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:38:55.669531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971083f-e19e-4547-8c1f-a1605f0dc092 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:55.669531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5971083f-e19e-4547-8c1f-a1605f0dc092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:55.726841 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a8ad1ba1-8041-4d50-b85f-fe6e14f8b963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aafd9f4dc342416b96bf962e5b7c2fc4', 'request_id': 'req-a8ad1ba1-8041-4d50-b85f-fe6e14f8b963'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:55.743084 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971083f-e19e-4547-8c1f-a1605f0dc092 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:55.744931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a8ad1ba1-8041-4d50-b85f-fe6e14f8b963 admin admin] The token cache is being invalidate because project aafd9f4dc342416b96bf962e5b7c2fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:55.745450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a8ad1ba1-8041-4d50-b85f-fe6e14f8b963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:55.746358 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a8ad1ba1-8041-4d50-b85f-fe6e14f8b963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:55.747927 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b185411-2292-4291-9463-62c17f1b814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:55.748523 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1219/2452] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:55 2022] DELETE /identity/v3/projects/aafd9f4dc342416b96bf962e5b7c2fc4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:55.748638 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b185411-2292-4291-9463-62c17f1b814b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:55.748940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b185411-2292-4291-9463-62c17f1b814b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:55.749230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b185411-2292-4291-9463-62c17f1b814b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:55.750058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b185411-2292-4291-9463-62c17f1b814b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:55.750906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20084b6-0310-495b-af7e-4a350ae5de34 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:55.751417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20084b6-0310-495b-af7e-4a350ae5de34 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:55.751892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20084b6-0310-495b-af7e-4a350ae5de34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:55.760389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b185411-2292-4291-9463-62c17f1b814b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:55.774431 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b20084b6-0310-495b-af7e-4a350ae5de34 None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:55.775780 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b20084b6-0310-495b-af7e-4a350ae5de34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:55.782427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1234/2453] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:55.783636 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b185411-2292-4291-9463-62c17f1b814b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:55.785654 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0b185411-2292-4291-9463-62c17f1b814b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:55.799617 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b185411-2292-4291-9463-62c17f1b814b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:55.807669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803e069-93c2-4947-b127-defff7f76e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:55.808113 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803e069-93c2-4947-b127-defff7f76e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:55.808646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803e069-93c2-4947-b127-defff7f76e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:55.809184 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803e069-93c2-4947-b127-defff7f76e51 admin admin] PATH_INFO: `/v3/users/a1b627440b76401e9c5cf505c9429f7a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:55.811827 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803e069-93c2-4947-b127-defff7f76e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b627440b76401e9c5cf505c9429f7a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:55.815041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803e069-93c2-4947-b127-defff7f76e51 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:55.841921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1220/2454] 10.222.0.16 () {58 vars in 967 bytes} [Wed Jul 20 19:38:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:55.842810 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20084b6-0310-495b-af7e-4a350ae5de34 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:55.844174 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b20084b6-0310-495b-af7e-4a350ae5de34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:55.859582 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20084b6-0310-495b-af7e-4a350ae5de34 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:55.864312 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847aa4b-0b7c-490a-b55d-89c65d303455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:55.865212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847aa4b-0b7c-490a-b55d-89c65d303455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:55.865491 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847aa4b-0b7c-490a-b55d-89c65d303455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:55.865757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847aa4b-0b7c-490a-b55d-89c65d303455 admin admin] PATH_INFO: `/v3/projects/29a90df642c443caaae6ad41496f71c3/users/c3e8119fc5784598b663c380b25c59cd/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:55.884977 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847aa4b-0b7c-490a-b55d-89c65d303455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a90df642c443caaae6ad41496f71c3, user_id=c3e8119fc5784598b663c380b25c59cd, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:55.887719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847aa4b-0b7c-490a-b55d-89c65d303455 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:55.908878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:55.984151 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1221/2455] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:55 2022] PUT /identity/v3/projects/29a90df642c443caaae6ad41496f71c3/users/c3e8119fc5784598b663c380b25c59cd/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:55.993352 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847aa4b-0b7c-490a-b55d-89c65d303455 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:55.995099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2847aa4b-0b7c-490a-b55d-89c65d303455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:56.066786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b803e069-93c2-4947-b127-defff7f76e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b627440b76401e9c5cf505c9429f7a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:56.079301 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847aa4b-0b7c-490a-b55d-89c65d303455 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:56.084534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223ad83-f272-4947-952f-7c75af7db8c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:56.085196 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ad83-f272-4947-952f-7c75af7db8c7 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:56.085477 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ad83-f272-4947-952f-7c75af7db8c7 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:56.085750 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ad83-f272-4947-952f-7c75af7db8c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:56.150077 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223ad83-f272-4947-952f-7c75af7db8c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:56.151724 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223ad83-f272-4947-952f-7c75af7db8c7 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:56.160135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1222/2456] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:38:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:38:56.161419 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1c450-ae0d-4821-a885-9a2f1030d505 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:56.161953 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1c450-ae0d-4821-a885-9a2f1030d505 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:56.161953 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1c450-ae0d-4821-a885-9a2f1030d505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:56.197033 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-94f1c450-ae0d-4821-a885-9a2f1030d505 None None] MFA Rules not processed for user `c3e8119fc5784598b663c380b25c59cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:56.198568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-94f1c450-ae0d-4821-a885-9a2f1030d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:56.200054 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b803e069-93c2-4947-b127-defff7f76e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b627440b76401e9c5cf505c9429f7a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:56.202407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b803e069-93c2-4947-b127-defff7f76e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b627440b76401e9c5cf505c9429f7a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:56.218729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b803e069-93c2-4947-b127-defff7f76e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b627440b76401e9c5cf505c9429f7a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:56.224899 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b803e069-93c2-4947-b127-defff7f76e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b627440b76401e9c5cf505c9429f7a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:56.231624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1235/2457] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:55 2022] DELETE /identity/v3/users/a1b627440b76401e9c5cf505c9429f7a => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:56.232516 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803e069-93c2-4947-b127-defff7f76e51 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:56.233918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b803e069-93c2-4947-b127-defff7f76e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:56.269907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:56.274640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1223/2458] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:56.290942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1c450-ae0d-4821-a885-9a2f1030d505 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:56.297685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-94f1c450-ae0d-4821-a885-9a2f1030d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:56.331563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:56.335098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803e069-93c2-4947-b127-defff7f76e51 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:56.342950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb673c8-c46f-4153-996a-4316ca96fc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:56.343913 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb673c8-c46f-4153-996a-4316ca96fc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:56.344275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb673c8-c46f-4153-996a-4316ca96fc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:56.344676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb673c8-c46f-4153-996a-4316ca96fc29 admin admin] PATH_INFO: `/v3/projects/2aadc3f46cc14659a92d602221f372ae` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:56.346428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb673c8-c46f-4153-996a-4316ca96fc29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aadc3f46cc14659a92d602221f372ae)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:56.349665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb673c8-c46f-4153-996a-4316ca96fc29 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:56.378292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1c450-ae0d-4821-a885-9a2f1030d505 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:56.428209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe789b-92a4-49c5-a5b7-06169119e909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:56.428861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe789b-92a4-49c5-a5b7-06169119e909 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:56.429141 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe789b-92a4-49c5-a5b7-06169119e909 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:56.429414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe789b-92a4-49c5-a5b7-06169119e909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:56.495192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe789b-92a4-49c5-a5b7-06169119e909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:56.497062 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe789b-92a4-49c5-a5b7-06169119e909 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:56.505607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbb673c8-c46f-4153-996a-4316ca96fc29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aadc3f46cc14659a92d602221f372ae', 'request_id': 'req-bbb673c8-c46f-4153-996a-4316ca96fc29'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:56.507178 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1224/2459] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:38:56.617201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbb673c8-c46f-4153-996a-4316ca96fc29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aadc3f46cc14659a92d602221f372ae', 'request_id': 'req-bbb673c8-c46f-4153-996a-4316ca96fc29'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:56.625974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbb673c8-c46f-4153-996a-4316ca96fc29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aadc3f46cc14659a92d602221f372ae', 'request_id': 'req-bbb673c8-c46f-4153-996a-4316ca96fc29'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:56.638700 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbb673c8-c46f-4153-996a-4316ca96fc29 admin admin] The token cache is being invalidate because project 2aadc3f46cc14659a92d602221f372ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:56.639203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbb673c8-c46f-4153-996a-4316ca96fc29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:56.639967 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bbb673c8-c46f-4153-996a-4316ca96fc29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:56.641875 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1236/2460] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:56 2022] DELETE /identity/v3/projects/2aadc3f46cc14659a92d602221f372ae => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:56.647871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c5e6e-a13a-4a3b-8146-c066c4108e51 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:56.648232 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c5e6e-a13a-4a3b-8146-c066c4108e51 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:56.648632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c5e6e-a13a-4a3b-8146-c066c4108e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:56.670022 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b76c5e6e-a13a-4a3b-8146-c066c4108e51 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:56.671450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b76c5e6e-a13a-4a3b-8146-c066c4108e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:56.734588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1225/2461] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:56.743429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335612a-e718-4ec2-8b26-9daa445be74c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:56.743721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335612a-e718-4ec2-8b26-9daa445be74c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:56.743995 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335612a-e718-4ec2-8b26-9daa445be74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:56.762942 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0335612a-e718-4ec2-8b26-9daa445be74c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:56.764241 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0335612a-e718-4ec2-8b26-9daa445be74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:56.772277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1237/2462] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:56.777348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c5e6e-a13a-4a3b-8146-c066c4108e51 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:56.787168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c5e6e-a13a-4a3b-8146-c066c4108e51 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:56.792454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d323697-07fc-49b2-8500-12b030796b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:56.793115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d323697-07fc-49b2-8500-12b030796b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:56.793397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d323697-07fc-49b2-8500-12b030796b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:56.793676 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d323697-07fc-49b2-8500-12b030796b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:56.794404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d323697-07fc-49b2-8500-12b030796b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:38:56.794743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d323697-07fc-49b2-8500-12b030796b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:56.796390 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d323697-07fc-49b2-8500-12b030796b02 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:56.808468 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1226/2463] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:38:56.814854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335612a-e718-4ec2-8b26-9daa445be74c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:56.825308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335612a-e718-4ec2-8b26-9daa445be74c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:56.832167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255ac83-fb3d-4681-81fd-b02cc0182960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:56.832167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255ac83-fb3d-4681-81fd-b02cc0182960 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:56.832167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255ac83-fb3d-4681-81fd-b02cc0182960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:56.832167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255ac83-fb3d-4681-81fd-b02cc0182960 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:56.832519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255ac83-fb3d-4681-81fd-b02cc0182960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:56.834983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255ac83-fb3d-4681-81fd-b02cc0182960 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:56.835116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d323697-07fc-49b2-8500-12b030796b02 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:56.837834 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0d323697-07fc-49b2-8500-12b030796b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:56.852438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d323697-07fc-49b2-8500-12b030796b02 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:56.860593 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b11b5-77e9-4cf7-ae7f-627a4965146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:56.860593 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b11b5-77e9-4cf7-ae7f-627a4965146e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:56.860593 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b11b5-77e9-4cf7-ae7f-627a4965146e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:56.861086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b11b5-77e9-4cf7-ae7f-627a4965146e admin admin] PATH_INFO: `/v3/projects/b6e064ff0c20480f9d173872a7b00e22` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:56.862020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b11b5-77e9-4cf7-ae7f-627a4965146e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e064ff0c20480f9d173872a7b00e22)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:56.864064 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b11b5-77e9-4cf7-ae7f-627a4965146e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:57.007449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1238/2464] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:38:56 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:38:57.013515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255ac83-fb3d-4681-81fd-b02cc0182960 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:57.030796 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9f4b11b5-77e9-4cf7-ae7f-627a4965146e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e064ff0c20480f9d173872a7b00e22', 'request_id': 'req-9f4b11b5-77e9-4cf7-ae7f-627a4965146e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:57.041102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9f4b11b5-77e9-4cf7-ae7f-627a4965146e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e064ff0c20480f9d173872a7b00e22', 'request_id': 'req-9f4b11b5-77e9-4cf7-ae7f-627a4965146e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:57.093066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255ac83-fb3d-4681-81fd-b02cc0182960 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:57.098435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d5c69-dfff-4b2f-a5b3-a39a089ea316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:57.099248 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d5c69-dfff-4b2f-a5b3-a39a089ea316 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.099527 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d5c69-dfff-4b2f-a5b3-a39a089ea316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:57.099801 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d5c69-dfff-4b2f-a5b3-a39a089ea316 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:57.100511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d5c69-dfff-4b2f-a5b3-a39a089ea316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:57.102878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d5c69-dfff-4b2f-a5b3-a39a089ea316 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:57.154284 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9f4b11b5-77e9-4cf7-ae7f-627a4965146e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e064ff0c20480f9d173872a7b00e22', 'request_id': 'req-9f4b11b5-77e9-4cf7-ae7f-627a4965146e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:57.165660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9f4b11b5-77e9-4cf7-ae7f-627a4965146e admin admin] The token cache is being invalidate because project b6e064ff0c20480f9d173872a7b00e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:57.165949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9f4b11b5-77e9-4cf7-ae7f-627a4965146e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:57.166568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9f4b11b5-77e9-4cf7-ae7f-627a4965146e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:57.168175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1227/2465] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:56 2022] DELETE /identity/v3/projects/b6e064ff0c20480f9d173872a7b00e22 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:57.173828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b6fa3-7716-442b-a800-805b3ada8491 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.174122 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b6fa3-7716-442b-a800-805b3ada8491 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:57.174417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b6fa3-7716-442b-a800-805b3ada8491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:57.192328 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4c3b6fa3-7716-442b-a800-805b3ada8491 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:57.193602 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4c3b6fa3-7716-442b-a800-805b3ada8491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:57.204873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1228/2466] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:38:57.213319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1239/2467] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:38:57 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:57.216923 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b6fa3-7716-442b-a800-805b3ada8491 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:57.218374 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84663ac-5960-4d26-b942-2fb90285c84a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.218507 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4c3b6fa3-7716-442b-a800-805b3ada8491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:57.218607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84663ac-5960-4d26-b942-2fb90285c84a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:57.218910 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84663ac-5960-4d26-b942-2fb90285c84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:57.234753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b6fa3-7716-442b-a800-805b3ada8491 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:57.241152 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238a08f-855a-446c-a5bb-1e9f9964a2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:57.244968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238a08f-855a-446c-a5bb-1e9f9964a2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.244968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238a08f-855a-446c-a5bb-1e9f9964a2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:57.244968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238a08f-855a-446c-a5bb-1e9f9964a2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:57.245286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f84663ac-5960-4d26-b942-2fb90285c84a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:57.245560 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238a08f-855a-446c-a5bb-1e9f9964a2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:57.246179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f84663ac-5960-4d26-b942-2fb90285c84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:57.247304 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238a08f-855a-446c-a5bb-1e9f9964a2b6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:57.256823 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1240/2468] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:57.262635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1229/2469] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:57.262830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84663ac-5960-4d26-b942-2fb90285c84a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:57.263695 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238a08f-855a-446c-a5bb-1e9f9964a2b6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:57.271787 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84663ac-5960-4d26-b942-2fb90285c84a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:57.277084 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238a08f-855a-446c-a5bb-1e9f9964a2b6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:57.279547 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df3f88-0046-41d5-af29-34c7061a374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:57.280186 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df3f88-0046-41d5-af29-34c7061a374c admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.280463 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df3f88-0046-41d5-af29-34c7061a374c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:57.280733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df3f88-0046-41d5-af29-34c7061a374c admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:57.281472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df3f88-0046-41d5-af29-34c7061a374c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:38:57.281768 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df3f88-0046-41d5-af29-34c7061a374c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:57.283548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df3f88-0046-41d5-af29-34c7061a374c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:57.286391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0c80d-635d-40f6-a827-8f0b16f64d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:57.287200 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0c80d-635d-40f6-a827-8f0b16f64d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.288028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0c80d-635d-40f6-a827-8f0b16f64d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:57.288028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0c80d-635d-40f6-a827-8f0b16f64d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:57.288724 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0c80d-635d-40f6-a827-8f0b16f64d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:57.290542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0c80d-635d-40f6-a827-8f0b16f64d6a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:57.301972 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1230/2470] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:57.305849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1241/2471] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:38:57.307137 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0c80d-635d-40f6-a827-8f0b16f64d6a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:57.308143 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df3f88-0046-41d5-af29-34c7061a374c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:57.317842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df3f88-0046-41d5-af29-34c7061a374c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:57.327618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0c80d-635d-40f6-a827-8f0b16f64d6a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:57.330345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:57.330476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2163e-d9fe-41b6-8b3c-7ad7659b2d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:57.331421 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2163e-d9fe-41b6-8b3c-7ad7659b2d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.331703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2163e-d9fe-41b6-8b3c-7ad7659b2d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:57.336975 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2163e-d9fe-41b6-8b3c-7ad7659b2d98 admin admin] PATH_INFO: `/v3/projects/a9193c9565754aa29d6483d360e565c4/users/22506309e816477d839cc993f299ecdf/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:57.337371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb2d2d-f9e2-4be0-8a85-46990d3cad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:57.337371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb2d2d-f9e2-4be0-8a85-46990d3cad5a admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.337371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb2d2d-f9e2-4be0-8a85-46990d3cad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:57.337371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb2d2d-f9e2-4be0-8a85-46990d3cad5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:57.337678 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb2d2d-f9e2-4be0-8a85-46990d3cad5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:57.339378 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb2d2d-f9e2-4be0-8a85-46990d3cad5a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:57.352900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2163e-d9fe-41b6-8b3c-7ad7659b2d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9193c9565754aa29d6483d360e565c4, user_id=22506309e816477d839cc993f299ecdf, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:57.355739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2163e-d9fe-41b6-8b3c-7ad7659b2d98 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:57.453492 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1242/2472] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:57 2022] PUT /identity/v3/projects/a9193c9565754aa29d6483d360e565c4/users/22506309e816477d839cc993f299ecdf/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:57.455855 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1231/2473] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:38:57 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:57.458838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2163e-d9fe-41b6-8b3c-7ad7659b2d98 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:57.466228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ffb6b-e32e-4c1f-8690-fd38fb5f9f5f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.466228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ffb6b-e32e-4c1f-8690-fd38fb5f9f5f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:57.466228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ffb6b-e32e-4c1f-8690-fd38fb5f9f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:57.498582 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-df1ffb6b-e32e-4c1f-8690-fd38fb5f9f5f None None] MFA Rules not processed for user `22506309e816477d839cc993f299ecdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:57.499967 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-df1ffb6b-e32e-4c1f-8690-fd38fb5f9f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:57.529004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2163e-d9fe-41b6-8b3c-7ad7659b2d98 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:57.575011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1232/2474] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:38:57.589612 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ffb6b-e32e-4c1f-8690-fd38fb5f9f5f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:57.589806 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b6cd1-8a4d-44bd-a717-fd241f91221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:57.590441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b6cd1-8a4d-44bd-a717-fd241f91221b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.590792 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b6cd1-8a4d-44bd-a717-fd241f91221b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:57.591073 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b6cd1-8a4d-44bd-a717-fd241f91221b admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:57.591323 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-df1ffb6b-e32e-4c1f-8690-fd38fb5f9f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:57.591803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b6cd1-8a4d-44bd-a717-fd241f91221b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:57.593692 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b6cd1-8a4d-44bd-a717-fd241f91221b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:57.623162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:57.653501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ffb6b-e32e-4c1f-8690-fd38fb5f9f5f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:57.657402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91936a1c-d06d-46a9-8d48-73a19386cf18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:57.658086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91936a1c-d06d-46a9-8d48-73a19386cf18 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.658371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91936a1c-d06d-46a9-8d48-73a19386cf18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:57.658646 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91936a1c-d06d-46a9-8d48-73a19386cf18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:57.668711 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91936a1c-d06d-46a9-8d48-73a19386cf18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:57.670206 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91936a1c-d06d-46a9-8d48-73a19386cf18 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:57.679451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1233/2475] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:38:57.700026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91936a1c-d06d-46a9-8d48-73a19386cf18 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:57.710727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91936a1c-d06d-46a9-8d48-73a19386cf18 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:57.715480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d0ecb-ff77-44d9-b524-96a187dfc096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:57.716330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d0ecb-ff77-44d9-b524-96a187dfc096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.716607 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d0ecb-ff77-44d9-b524-96a187dfc096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:57.716866 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d0ecb-ff77-44d9-b524-96a187dfc096 admin admin] PATH_INFO: `/v3/users/22506309e816477d839cc993f299ecdf` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:57.718078 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d0ecb-ff77-44d9-b524-96a187dfc096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22506309e816477d839cc993f299ecdf)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:57.720045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d0ecb-ff77-44d9-b524-96a187dfc096 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:57.727031 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1243/2476] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:38:57 2022] POST /identity/v3/users => generated 283 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:57.731091 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b6cd1-8a4d-44bd-a717-fd241f91221b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:57.740863 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b6cd1-8a4d-44bd-a717-fd241f91221b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:57.746205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e365a5-6398-4a23-9404-131ed933dd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:57.746987 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e365a5-6398-4a23-9404-131ed933dd18 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.747277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e365a5-6398-4a23-9404-131ed933dd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:57.747551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e365a5-6398-4a23-9404-131ed933dd18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:57.748282 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e365a5-6398-4a23-9404-131ed933dd18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:57.749928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e365a5-6398-4a23-9404-131ed933dd18 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:57.761054 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1244/2477] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:38:57.767935 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e365a5-6398-4a23-9404-131ed933dd18 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:57.778546 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e365a5-6398-4a23-9404-131ed933dd18 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:57.783401 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd81ea-d402-406c-bc67-c25a30915368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:57.784065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd81ea-d402-406c-bc67-c25a30915368 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.784342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd81ea-d402-406c-bc67-c25a30915368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:57.784620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd81ea-d402-406c-bc67-c25a30915368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:57.790195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd81ea-d402-406c-bc67-c25a30915368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:57.790195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd81ea-d402-406c-bc67-c25a30915368 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:57.798657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1245/2478] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:38:57.802749 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd81ea-d402-406c-bc67-c25a30915368 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:57.812853 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd81ea-d402-406c-bc67-c25a30915368 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:57.821318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28497289-26a8-49c6-9e41-2c4932f13362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:57.821318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28497289-26a8-49c6-9e41-2c4932f13362 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.821318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28497289-26a8-49c6-9e41-2c4932f13362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:57.821318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28497289-26a8-49c6-9e41-2c4932f13362 admin admin] PATH_INFO: `/v3/projects/9fb3e94cec6a43e3828e44e2995c08d3/users/7a93b0c1d3684d969f0b8a3f7b986fe6/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:57.835242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28497289-26a8-49c6-9e41-2c4932f13362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb3e94cec6a43e3828e44e2995c08d3, user_id=7a93b0c1d3684d969f0b8a3f7b986fe6, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:57.838662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28497289-26a8-49c6-9e41-2c4932f13362 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:57.911173 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b3d0ecb-ff77-44d9-b524-96a187dfc096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22506309e816477d839cc993f299ecdf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:57.927705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1246/2479] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:57 2022] PUT /identity/v3/projects/9fb3e94cec6a43e3828e44e2995c08d3/users/7a93b0c1d3684d969f0b8a3f7b986fe6/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:38:57.960115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b3d0ecb-ff77-44d9-b524-96a187dfc096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22506309e816477d839cc993f299ecdf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:57.971382 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b3d0ecb-ff77-44d9-b524-96a187dfc096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22506309e816477d839cc993f299ecdf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:57.989624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b3d0ecb-ff77-44d9-b524-96a187dfc096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22506309e816477d839cc993f299ecdf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:57.990385 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6b3d0ecb-ff77-44d9-b524-96a187dfc096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22506309e816477d839cc993f299ecdf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:57.999041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba8146-bc54-4969-b85c-24c7a3dfbdc7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:57.999325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba8146-bc54-4969-b85c-24c7a3dfbdc7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:58.007383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba8146-bc54-4969-b85c-24c7a3dfbdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:58.007547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1234/2480] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:57 2022] DELETE /identity/v3/users/22506309e816477d839cc993f299ecdf => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:38:58.007547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e56fe-e90c-4a57-9ecf-26ecd3ea8759 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:58.007547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e56fe-e90c-4a57-9ecf-26ecd3ea8759 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:58.007547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e56fe-e90c-4a57-9ecf-26ecd3ea8759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:58.024698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-008e56fe-e90c-4a57-9ecf-26ecd3ea8759 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:58.026397 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-008e56fe-e90c-4a57-9ecf-26ecd3ea8759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:58.032293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-85ba8146-bc54-4969-b85c-24c7a3dfbdc7 None None] MFA Rules not processed for user `7a93b0c1d3684d969f0b8a3f7b986fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:58.033806 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-85ba8146-bc54-4969-b85c-24c7a3dfbdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:58.094172 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1235/2481] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:38:58.107272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e56fe-e90c-4a57-9ecf-26ecd3ea8759 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:58.108662 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-008e56fe-e90c-4a57-9ecf-26ecd3ea8759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:58.112706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1247/2482] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:38:58.116857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba8146-bc54-4969-b85c-24c7a3dfbdc7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:58.118804 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-85ba8146-bc54-4969-b85c-24c7a3dfbdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:58.133807 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba8146-bc54-4969-b85c-24c7a3dfbdc7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:58.139497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea694935-04e3-446d-914f-9f542fe864b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:58.140152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea694935-04e3-446d-914f-9f542fe864b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:58.140429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea694935-04e3-446d-914f-9f542fe864b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:58.140765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea694935-04e3-446d-914f-9f542fe864b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:58.141451 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea694935-04e3-446d-914f-9f542fe864b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:58.144166 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea694935-04e3-446d-914f-9f542fe864b9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:58.180794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e56fe-e90c-4a57-9ecf-26ecd3ea8759 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:58.184659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbaa02-5002-4b8d-a7b9-b61c90ed9270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:58.185313 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbaa02-5002-4b8d-a7b9-b61c90ed9270 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:58.185595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbaa02-5002-4b8d-a7b9-b61c90ed9270 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:58.185871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbaa02-5002-4b8d-a7b9-b61c90ed9270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:58.196590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbaa02-5002-4b8d-a7b9-b61c90ed9270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:58.198082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbaa02-5002-4b8d-a7b9-b61c90ed9270 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:58.208280 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1236/2483] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:38:58.266077 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1248/2484] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:38:58 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:58.270011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbaa02-5002-4b8d-a7b9-b61c90ed9270 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:58.280680 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbaa02-5002-4b8d-a7b9-b61c90ed9270 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:58.297972 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:58.375290 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14e89c-5d4c-4ab0-a26d-3939f4bb46d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:58.375974 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14e89c-5d4c-4ab0-a26d-3939f4bb46d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:58.376254 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14e89c-5d4c-4ab0-a26d-3939f4bb46d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:58.376746 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14e89c-5d4c-4ab0-a26d-3939f4bb46d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:58.377245 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14e89c-5d4c-4ab0-a26d-3939f4bb46d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:58.379203 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14e89c-5d4c-4ab0-a26d-3939f4bb46d7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:58.383985 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:58.603919 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1237/2485] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:38:58 2022] POST /identity/v3/users => generated 289 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:58.607666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea694935-04e3-446d-914f-9f542fe864b9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:58.618798 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea694935-04e3-446d-914f-9f542fe864b9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:58.627818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b02ad-d8ab-4daf-9259-833dde4f84c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:58.627818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b02ad-d8ab-4daf-9259-833dde4f84c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:58.627818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b02ad-d8ab-4daf-9259-833dde4f84c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:58.627818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b02ad-d8ab-4daf-9259-833dde4f84c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:58.628214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b02ad-d8ab-4daf-9259-833dde4f84c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:58.628214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b02ad-d8ab-4daf-9259-833dde4f84c9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:58.640396 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1249/2486] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:58.644266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14e89c-5d4c-4ab0-a26d-3939f4bb46d7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:58.655684 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14e89c-5d4c-4ab0-a26d-3939f4bb46d7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:58.660532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69947b24-e71a-4ccb-b5cc-64d858d67d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:58.661593 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69947b24-e71a-4ccb-b5cc-64d858d67d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:58.662188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69947b24-e71a-4ccb-b5cc-64d858d67d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:58.662467 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69947b24-e71a-4ccb-b5cc-64d858d67d7a admin admin] PATH_INFO: `/v3/projects/a72dc15db8654dc98ac39b537f2365c8/users/007248e9be7a4f4fbfbae14e6b5a05bb/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:58.678223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69947b24-e71a-4ccb-b5cc-64d858d67d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72dc15db8654dc98ac39b537f2365c8, user_id=007248e9be7a4f4fbfbae14e6b5a05bb, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:58.681312 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69947b24-e71a-4ccb-b5cc-64d858d67d7a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:58.701343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:58.789598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1238/2487] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:58 2022] PUT /identity/v3/projects/a72dc15db8654dc98ac39b537f2365c8/users/007248e9be7a4f4fbfbae14e6b5a05bb/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:58.793663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b02ad-d8ab-4daf-9259-833dde4f84c9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:58.804053 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b02ad-d8ab-4daf-9259-833dde4f84c9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:58.811888 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:58.818972 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69947b24-e71a-4ccb-b5cc-64d858d67d7a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:58.821748 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-69947b24-e71a-4ccb-b5cc-64d858d67d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:58.871617 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02bb3a-6e1c-48ca-ae1e-5ec4bbb1ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:58.872290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02bb3a-6e1c-48ca-ae1e-5ec4bbb1ffe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:58.872568 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02bb3a-6e1c-48ca-ae1e-5ec4bbb1ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:58.872841 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02bb3a-6e1c-48ca-ae1e-5ec4bbb1ffe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:58.873579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02bb3a-6e1c-48ca-ae1e-5ec4bbb1ffe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:58.875429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02bb3a-6e1c-48ca-ae1e-5ec4bbb1ffe5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:58.889883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1250/2488] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:38:58.891007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02bb3a-6e1c-48ca-ae1e-5ec4bbb1ffe5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:58.898779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:58.904085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02bb3a-6e1c-48ca-ae1e-5ec4bbb1ffe5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:58.906380 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69947b24-e71a-4ccb-b5cc-64d858d67d7a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:58.909159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d82af-90c6-46ba-b6ea-0dbc54717e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:58.910082 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d82af-90c6-46ba-b6ea-0dbc54717e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:58.910360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d82af-90c6-46ba-b6ea-0dbc54717e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:58.910637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d82af-90c6-46ba-b6ea-0dbc54717e26 admin admin] PATH_INFO: `/v3/projects/a72dc15db8654dc98ac39b537f2365c8/users/007248e9be7a4f4fbfbae14e6b5a05bb/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:58.911237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4425a47-81ba-43e8-8806-14de7aa82722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:58.912149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4425a47-81ba-43e8-8806-14de7aa82722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:58.912360 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4425a47-81ba-43e8-8806-14de7aa82722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:58.912625 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4425a47-81ba-43e8-8806-14de7aa82722 admin admin] PATH_INFO: `/v3/projects/a9193c9565754aa29d6483d360e565c4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:58.913123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d82af-90c6-46ba-b6ea-0dbc54717e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72dc15db8654dc98ac39b537f2365c8, user_id=007248e9be7a4f4fbfbae14e6b5a05bb, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:58.913953 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4425a47-81ba-43e8-8806-14de7aa82722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9193c9565754aa29d6483d360e565c4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:58.915927 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d82af-90c6-46ba-b6ea-0dbc54717e26 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:58.916064 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4425a47-81ba-43e8-8806-14de7aa82722 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:58.926591 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1251/2489] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:38:58 2022] PUT /identity/v3/projects/a72dc15db8654dc98ac39b537f2365c8/users/007248e9be7a4f4fbfbae14e6b5a05bb/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:58.940199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469297a6-d34e-47e7-90e5-cf41b508ac1e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:58.940487 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469297a6-d34e-47e7-90e5-cf41b508ac1e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:58.940766 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469297a6-d34e-47e7-90e5-cf41b508ac1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:58.969436 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-469297a6-d34e-47e7-90e5-cf41b508ac1e None None] MFA Rules not processed for user `007248e9be7a4f4fbfbae14e6b5a05bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:58.970717 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-469297a6-d34e-47e7-90e5-cf41b508ac1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:59.039225 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1252/2490] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:59.051283 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469297a6-d34e-47e7-90e5-cf41b508ac1e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:59.052698 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-469297a6-d34e-47e7-90e5-cf41b508ac1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:59.105045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f4425a47-81ba-43e8-8806-14de7aa82722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9193c9565754aa29d6483d360e565c4', 'request_id': 'req-f4425a47-81ba-43e8-8806-14de7aa82722'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:59.108551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:59.113086 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469297a6-d34e-47e7-90e5-cf41b508ac1e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:59.113257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f4425a47-81ba-43e8-8806-14de7aa82722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9193c9565754aa29d6483d360e565c4', 'request_id': 'req-f4425a47-81ba-43e8-8806-14de7aa82722'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:59.165902 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d8525-4193-4b6c-be34-f67dc82e0592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:59.166570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d8525-4193-4b6c-be34-f67dc82e0592 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:59.166877 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d8525-4193-4b6c-be34-f67dc82e0592 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:59.167156 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d8525-4193-4b6c-be34-f67dc82e0592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:59.226239 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d8525-4193-4b6c-be34-f67dc82e0592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:59.228319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d8525-4193-4b6c-be34-f67dc82e0592 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:59.238191 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1253/2491] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:38:59.326611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f4425a47-81ba-43e8-8806-14de7aa82722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9193c9565754aa29d6483d360e565c4', 'request_id': 'req-f4425a47-81ba-43e8-8806-14de7aa82722'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:59.340137 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f4425a47-81ba-43e8-8806-14de7aa82722 admin admin] The token cache is being invalidate because project a9193c9565754aa29d6483d360e565c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:59.340423 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f4425a47-81ba-43e8-8806-14de7aa82722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:59.341176 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f4425a47-81ba-43e8-8806-14de7aa82722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:59.346703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1239/2492] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:58 2022] DELETE /identity/v3/projects/a9193c9565754aa29d6483d360e565c4 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:59.352051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed6d27-2b89-49c2-b47e-da884f11c822 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:59.352873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed6d27-2b89-49c2-b47e-da884f11c822 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:59.353167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed6d27-2b89-49c2-b47e-da884f11c822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:59.372494 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-79ed6d27-2b89-49c2-b47e-da884f11c822 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:59.373704 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-79ed6d27-2b89-49c2-b47e-da884f11c822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:59.437819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1254/2493] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:59.448573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885736-43a2-4f7d-93d8-84fe66ab8be9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:59.448959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885736-43a2-4f7d-93d8-84fe66ab8be9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:59.449311 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885736-43a2-4f7d-93d8-84fe66ab8be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:59.469466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1e885736-43a2-4f7d-93d8-84fe66ab8be9 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:59.470721 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1e885736-43a2-4f7d-93d8-84fe66ab8be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:59.479873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1240/2494] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:59.496312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed6d27-2b89-49c2-b47e-da884f11c822 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:59.506460 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed6d27-2b89-49c2-b47e-da884f11c822 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:59.511734 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67c39-1ea8-4058-a2f5-d18b1cb4ad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:59.512393 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67c39-1ea8-4058-a2f5-d18b1cb4ad50 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:59.512674 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67c39-1ea8-4058-a2f5-d18b1cb4ad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:59.513007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67c39-1ea8-4058-a2f5-d18b1cb4ad50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:59.513676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa67c39-1ea8-4058-a2f5-d18b1cb4ad50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:38:59.513981 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa67c39-1ea8-4058-a2f5-d18b1cb4ad50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:59.515726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa67c39-1ea8-4058-a2f5-d18b1cb4ad50 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:59.529490 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1255/2495] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:38:59.537649 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e885736-43a2-4f7d-93d8-84fe66ab8be9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:59.549097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e885736-43a2-4f7d-93d8-84fe66ab8be9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:59.554912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380df6d-e8ad-46e2-a3d7-9c30a343a083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:59.556460 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380df6d-e8ad-46e2-a3d7-9c30a343a083 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:59.556853 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380df6d-e8ad-46e2-a3d7-9c30a343a083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:59.557190 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380df6d-e8ad-46e2-a3d7-9c30a343a083 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:59.557970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380df6d-e8ad-46e2-a3d7-9c30a343a083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:59.560023 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380df6d-e8ad-46e2-a3d7-9c30a343a083 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:59.584172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67c39-1ea8-4058-a2f5-d18b1cb4ad50 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:59.586077 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2aa67c39-1ea8-4058-a2f5-d18b1cb4ad50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:59.600385 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67c39-1ea8-4058-a2f5-d18b1cb4ad50 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:59.605180 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6adcbf-8b0e-4999-910e-bd6b505c7a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:59.605841 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6adcbf-8b0e-4999-910e-bd6b505c7a3e service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:59.606125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6adcbf-8b0e-4999-910e-bd6b505c7a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:59.606401 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6adcbf-8b0e-4999-910e-bd6b505c7a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:59.608246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2d6adcbf-8b0e-4999-910e-bd6b505c7a3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:59.659162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:59.672088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6adcbf-8b0e-4999-910e-bd6b505c7a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:59.674872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6adcbf-8b0e-4999-910e-bd6b505c7a3e service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:59.684362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1256/2496] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:38:59.705243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1241/2497] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:38:59 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:59.709462 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6adcbf-8b0e-4999-910e-bd6b505c7a3e service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:59.724215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6adcbf-8b0e-4999-910e-bd6b505c7a3e service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:59.771333 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380df6d-e8ad-46e2-a3d7-9c30a343a083 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:59.773271 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3380df6d-e8ad-46e2-a3d7-9c30a343a083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:59.788570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f286ba-0f52-4dea-86e0-164c9a48431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:59.789306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f286ba-0f52-4dea-86e0-164c9a48431a admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:59.789594 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f286ba-0f52-4dea-86e0-164c9a48431a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:59.795652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f286ba-0f52-4dea-86e0-164c9a48431a admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:59.795652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f286ba-0f52-4dea-86e0-164c9a48431a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:59.795652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f286ba-0f52-4dea-86e0-164c9a48431a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:59.847508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380df6d-e8ad-46e2-a3d7-9c30a343a083 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:59.853924 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637b264-165a-48db-8735-d8efc31806a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:59.854893 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637b264-165a-48db-8735-d8efc31806a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:59.855158 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637b264-165a-48db-8735-d8efc31806a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:59.855432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637b264-165a-48db-8735-d8efc31806a5 admin admin] PATH_INFO: `/v3/users/c3e8119fc5784598b663c380b25c59cd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:59.856675 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637b264-165a-48db-8735-d8efc31806a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e8119fc5784598b663c380b25c59cd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:59.858654 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637b264-165a-48db-8735-d8efc31806a5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:59.937699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1257/2498] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:38:59 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:38:59.941730 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f286ba-0f52-4dea-86e0-164c9a48431a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:59.952156 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f286ba-0f52-4dea-86e0-164c9a48431a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:59.957960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e768b63-9baf-4342-9536-468ddd2cdc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:59.958650 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e768b63-9baf-4342-9536-468ddd2cdc10 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:59.958968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e768b63-9baf-4342-9536-468ddd2cdc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:59.959244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e768b63-9baf-4342-9536-468ddd2cdc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:59.959998 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e768b63-9baf-4342-9536-468ddd2cdc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:59.962175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e768b63-9baf-4342-9536-468ddd2cdc10 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:59.973679 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1258/2499] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:38:59.978854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e768b63-9baf-4342-9536-468ddd2cdc10 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:59.989774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e768b63-9baf-4342-9536-468ddd2cdc10 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:59.995059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed287eb-b0d0-4e56-8abb-b126e4912bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:59.995741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed287eb-b0d0-4e56-8abb-b126e4912bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:59.996021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed287eb-b0d0-4e56-8abb-b126e4912bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:59.996302 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed287eb-b0d0-4e56-8abb-b126e4912bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:59.997058 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed287eb-b0d0-4e56-8abb-b126e4912bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:59.998756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed287eb-b0d0-4e56-8abb-b126e4912bf9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:00.011061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1259/2500] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:39:00.015332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed287eb-b0d0-4e56-8abb-b126e4912bf9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:00.026429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed287eb-b0d0-4e56-8abb-b126e4912bf9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:00.033832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf99ed-0321-4160-9691-d52d15feccea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:00.034999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf99ed-0321-4160-9691-d52d15feccea admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:00.035732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf99ed-0321-4160-9691-d52d15feccea admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:00.036062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf99ed-0321-4160-9691-d52d15feccea admin admin] PATH_INFO: `/v3/projects/f1edce3ea6f04103a8f80e0886cd23eb/users/325384444ddf435da94d9a4147e3f83d/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:00.054588 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf99ed-0321-4160-9691-d52d15feccea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1edce3ea6f04103a8f80e0886cd23eb, user_id=325384444ddf435da94d9a4147e3f83d, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:00.057682 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf99ed-0321-4160-9691-d52d15feccea admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:00.076544 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6637b264-165a-48db-8735-d8efc31806a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e8119fc5784598b663c380b25c59cd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:00.143989 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1260/2501] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:39:00 2022] PUT /identity/v3/projects/f1edce3ea6f04103a8f80e0886cd23eb/users/325384444ddf435da94d9a4147e3f83d/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:39:00.155837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b5e9-06c9-4785-aa09-f73120a50545 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:00.156127 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b5e9-06c9-4785-aa09-f73120a50545 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:00.156446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b5e9-06c9-4785-aa09-f73120a50545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:00.157071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:00.185227 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8ef8b5e9-06c9-4785-aa09-f73120a50545 None None] MFA Rules not processed for user `325384444ddf435da94d9a4147e3f83d`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:39:00.186592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8ef8b5e9-06c9-4785-aa09-f73120a50545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:00.259075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1261/2502] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:39:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:39:00.269123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6637b264-165a-48db-8735-d8efc31806a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e8119fc5784598b663c380b25c59cd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:00.271308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8b5e9-06c9-4785-aa09-f73120a50545 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:00.273128 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8ef8b5e9-06c9-4785-aa09-f73120a50545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:00.278100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6637b264-165a-48db-8735-d8efc31806a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e8119fc5784598b663c380b25c59cd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:00.296864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6637b264-165a-48db-8735-d8efc31806a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e8119fc5784598b663c380b25c59cd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:00.297695 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6637b264-165a-48db-8735-d8efc31806a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e8119fc5784598b663c380b25c59cd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:00.304281 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1242/2503] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:59 2022] DELETE /identity/v3/users/c3e8119fc5784598b663c380b25c59cd => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:39:00.309953 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3f998-5841-4524-9855-6f1c07edb3a2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:00.310233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3f998-5841-4524-9855-6f1c07edb3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:00.310506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3f998-5841-4524-9855-6f1c07edb3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:00.329986 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f4f3f998-5841-4524-9855-6f1c07edb3a2 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:39:00.331305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f4f3f998-5841-4524-9855-6f1c07edb3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:00.343220 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8b5e9-06c9-4785-aa09-f73120a50545 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:00.405203 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1243/2504] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:39:00.414516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3f998-5841-4524-9855-6f1c07edb3a2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:00.417174 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f4f3f998-5841-4524-9855-6f1c07edb3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:00.421805 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53ae08-278a-427a-a496-1837005f0807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:00.422497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53ae08-278a-427a-a496-1837005f0807 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:00.426869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53ae08-278a-427a-a496-1837005f0807 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:00.427399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53ae08-278a-427a-a496-1837005f0807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:00.429651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7a53ae08-278a-427a-a496-1837005f0807 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:00.460276 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:00.490340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3f998-5841-4524-9855-6f1c07edb3a2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:00.497219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8c75a-cfa4-4308-87c1-3145c514a69f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:00.497219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c75a-cfa4-4308-87c1-3145c514a69f service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:00.497219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c75a-cfa4-4308-87c1-3145c514a69f service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:00.497219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c75a-cfa4-4308-87c1-3145c514a69f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:00.500432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53ae08-278a-427a-a496-1837005f0807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:00.502732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53ae08-278a-427a-a496-1837005f0807 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:00.509516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8c75a-cfa4-4308-87c1-3145c514a69f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:00.511384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8c75a-cfa4-4308-87c1-3145c514a69f service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:00.515049 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1262/2505] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:39:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:39:00.526871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1244/2506] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:39:00.544209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:00.990997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53ae08-278a-427a-a496-1837005f0807 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:00.992451 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7a53ae08-278a-427a-a496-1837005f0807 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:01.006881 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53ae08-278a-427a-a496-1837005f0807 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:01.012201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ad164-e2ce-496d-a4f2-a3967a3973f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:01.013211 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ad164-e2ce-496d-a4f2-a3967a3973f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:01.013560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ad164-e2ce-496d-a4f2-a3967a3973f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:01.013837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ad164-e2ce-496d-a4f2-a3967a3973f3 admin admin] PATH_INFO: `/v3/projects/29a90df642c443caaae6ad41496f71c3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:01.015651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ad164-e2ce-496d-a4f2-a3967a3973f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29a90df642c443caaae6ad41496f71c3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:01.017659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ad164-e2ce-496d-a4f2-a3967a3973f3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:01.097920 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:01.252541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5a4ad164-e2ce-496d-a4f2-a3967a3973f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29a90df642c443caaae6ad41496f71c3', 'request_id': 'req-5a4ad164-e2ce-496d-a4f2-a3967a3973f3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:01.374783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5a4ad164-e2ce-496d-a4f2-a3967a3973f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29a90df642c443caaae6ad41496f71c3', 'request_id': 'req-5a4ad164-e2ce-496d-a4f2-a3967a3973f3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:01.382489 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5a4ad164-e2ce-496d-a4f2-a3967a3973f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29a90df642c443caaae6ad41496f71c3', 'request_id': 'req-5a4ad164-e2ce-496d-a4f2-a3967a3973f3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:01.394687 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5a4ad164-e2ce-496d-a4f2-a3967a3973f3 admin admin] The token cache is being invalidate because project 29a90df642c443caaae6ad41496f71c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:39:01.395343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5a4ad164-e2ce-496d-a4f2-a3967a3973f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:01.396190 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5a4ad164-e2ce-496d-a4f2-a3967a3973f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:01.398030 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1263/2507] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:39:00 2022] DELETE /identity/v3/projects/29a90df642c443caaae6ad41496f71c3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:39:01.405198 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee9e0e-8333-4087-b4a1-13146f4a30a2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:01.405675 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee9e0e-8333-4087-b4a1-13146f4a30a2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:01.405984 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee9e0e-8333-4087-b4a1-13146f4a30a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:01.406627 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:01.425546 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-07ee9e0e-8333-4087-b4a1-13146f4a30a2 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:39:01.426940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-07ee9e0e-8333-4087-b4a1-13146f4a30a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:01.514144 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1245/2508] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:39:01.522450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee8337-5c20-4a2a-b943-f8887f96ceb5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:01.522936 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee8337-5c20-4a2a-b943-f8887f96ceb5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:01.523315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee8337-5c20-4a2a-b943-f8887f96ceb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:01.560280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7bee8337-5c20-4a2a-b943-f8887f96ceb5 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:39:01.562653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7bee8337-5c20-4a2a-b943-f8887f96ceb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:01.575277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1264/2509] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:39:01.579386 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee9e0e-8333-4087-b4a1-13146f4a30a2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:01.589610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee9e0e-8333-4087-b4a1-13146f4a30a2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:01.595523 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72e6d5-8197-43ab-bc1c-f8e36a7c0f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:01.597572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72e6d5-8197-43ab-bc1c-f8e36a7c0f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:01.597572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72e6d5-8197-43ab-bc1c-f8e36a7c0f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:01.597572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72e6d5-8197-43ab-bc1c-f8e36a7c0f9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:01.597572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72e6d5-8197-43ab-bc1c-f8e36a7c0f9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:39:01.597936 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72e6d5-8197-43ab-bc1c-f8e36a7c0f9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:01.599858 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72e6d5-8197-43ab-bc1c-f8e36a7c0f9d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:01.612839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1246/2510] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:39:01.617370 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee8337-5c20-4a2a-b943-f8887f96ceb5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:01.627590 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee8337-5c20-4a2a-b943-f8887f96ceb5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:01.632310 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697f42b-2e78-4741-b965-2b94701e6ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:01.632991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697f42b-2e78-4741-b965-2b94701e6ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:01.633331 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697f42b-2e78-4741-b965-2b94701e6ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:01.633606 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697f42b-2e78-4741-b965-2b94701e6ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:01.634342 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697f42b-2e78-4741-b965-2b94701e6ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:01.636323 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697f42b-2e78-4741-b965-2b94701e6ae1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:01.753011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1265/2511] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:39:01 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:39:01.759286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72e6d5-8197-43ab-bc1c-f8e36a7c0f9d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:01.771437 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72e6d5-8197-43ab-bc1c-f8e36a7c0f9d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:01.831685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87049e-cb40-4df0-9ece-84254748b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:01.832363 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87049e-cb40-4df0-9ece-84254748b39a admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:01.832644 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87049e-cb40-4df0-9ece-84254748b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:01.833054 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87049e-cb40-4df0-9ece-84254748b39a admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:01.834955 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87049e-cb40-4df0-9ece-84254748b39a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:01.836272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87049e-cb40-4df0-9ece-84254748b39a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:01.967774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1247/2512] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:39:01 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:39:01.972008 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697f42b-2e78-4741-b965-2b94701e6ae1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:01.982443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697f42b-2e78-4741-b965-2b94701e6ae1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:01.987061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae58be8-823f-4928-aee6-8534edf178b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:01.987723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58be8-823f-4928-aee6-8534edf178b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:01.988007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58be8-823f-4928-aee6-8534edf178b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:01.988275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58be8-823f-4928-aee6-8534edf178b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:01.989000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae58be8-823f-4928-aee6-8534edf178b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:01.990589 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae58be8-823f-4928-aee6-8534edf178b8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:02.002077 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1266/2513] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:39:02.013892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87049e-cb40-4df0-9ece-84254748b39a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:02.024166 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87049e-cb40-4df0-9ece-84254748b39a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:02.028966 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cd306-1fa6-4213-abc2-a903bdc56925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:02.029627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cd306-1fa6-4213-abc2-a903bdc56925 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:02.029906 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cd306-1fa6-4213-abc2-a903bdc56925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:02.030184 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cd306-1fa6-4213-abc2-a903bdc56925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:02.030979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cd306-1fa6-4213-abc2-a903bdc56925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:02.032603 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cd306-1fa6-4213-abc2-a903bdc56925 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:02.043132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1248/2514] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:39:02.048430 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae58be8-823f-4928-aee6-8534edf178b8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:02.062099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae58be8-823f-4928-aee6-8534edf178b8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:02.072984 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40947f-f19a-47d9-abee-f17763be4e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:02.074232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40947f-f19a-47d9-abee-f17763be4e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:02.074518 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40947f-f19a-47d9-abee-f17763be4e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:02.074828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40947f-f19a-47d9-abee-f17763be4e3d admin admin] PATH_INFO: `/v3/projects/867aeaaf603345599b7cd26326140164/users/03268115f5e74d9a8683477bed367afa/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:02.099090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40947f-f19a-47d9-abee-f17763be4e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=867aeaaf603345599b7cd26326140164, user_id=03268115f5e74d9a8683477bed367afa, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:02.101775 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40947f-f19a-47d9-abee-f17763be4e3d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:02.263710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:02.269931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1267/2515] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:39:02 2022] PUT /identity/v3/projects/867aeaaf603345599b7cd26326140164/users/03268115f5e74d9a8683477bed367afa/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:39:02.282757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00c2c6-7839-4850-94ba-d27ed27c5178 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:02.282757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00c2c6-7839-4850-94ba-d27ed27c5178 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:02.282757 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00c2c6-7839-4850-94ba-d27ed27c5178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:02.311661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ec00c2c6-7839-4850-94ba-d27ed27c5178 None None] MFA Rules not processed for user `03268115f5e74d9a8683477bed367afa`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:39:02.312899 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ec00c2c6-7839-4850-94ba-d27ed27c5178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:02.379246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1249/2516] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:39:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:39:02.391995 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40947f-f19a-47d9-abee-f17763be4e3d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:02.393736 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0d40947f-f19a-47d9-abee-f17763be4e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:02.458360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40947f-f19a-47d9-abee-f17763be4e3d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:02.462960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276abc3b-c8b9-4575-b51f-08c3a0661cd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:02.463790 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276abc3b-c8b9-4575-b51f-08c3a0661cd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:02.464395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276abc3b-c8b9-4575-b51f-08c3a0661cd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:02.465019 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276abc3b-c8b9-4575-b51f-08c3a0661cd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:02.468229 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:02.475904 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276abc3b-c8b9-4575-b51f-08c3a0661cd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:02.479540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276abc3b-c8b9-4575-b51f-08c3a0661cd8 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:02.487255 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1268/2517] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:39:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:39:02.824883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:02.898598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:03.527222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:04.195921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:04.670535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:05.247937 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:05.482363 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:05.574433 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:06.019780 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:06.258927 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:06.573932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:07.014733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:07.019381 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00c2c6-7839-4850-94ba-d27ed27c5178 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:07.020892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ec00c2c6-7839-4850-94ba-d27ed27c5178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:07.109728 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00c2c6-7839-4850-94ba-d27ed27c5178 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:07.114844 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8a7b-eabb-4251-aa37-e5f0e5e61942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:07.115993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8a7b-eabb-4251-aa37-e5f0e5e61942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:07.115993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8a7b-eabb-4251-aa37-e5f0e5e61942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:07.116229 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8a7b-eabb-4251-aa37-e5f0e5e61942 admin admin] PATH_INFO: `/v3/users/7a93b0c1d3684d969f0b8a3f7b986fe6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:07.117376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c8a7b-eabb-4251-aa37-e5f0e5e61942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a93b0c1d3684d969f0b8a3f7b986fe6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:07.119534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c8a7b-eabb-4251-aa37-e5f0e5e61942 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:07.359326 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7d8c8a7b-eabb-4251-aa37-e5f0e5e61942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a93b0c1d3684d969f0b8a3f7b986fe6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:07.465251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7d8c8a7b-eabb-4251-aa37-e5f0e5e61942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a93b0c1d3684d969f0b8a3f7b986fe6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:07.473895 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7d8c8a7b-eabb-4251-aa37-e5f0e5e61942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a93b0c1d3684d969f0b8a3f7b986fe6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:07.493212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7d8c8a7b-eabb-4251-aa37-e5f0e5e61942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a93b0c1d3684d969f0b8a3f7b986fe6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:07.493970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7d8c8a7b-eabb-4251-aa37-e5f0e5e61942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a93b0c1d3684d969f0b8a3f7b986fe6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:07.502255 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1250/2518] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:39:07 2022] DELETE /identity/v3/users/7a93b0c1d3684d969f0b8a3f7b986fe6 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:39:07.507317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe4c5f-bbeb-436c-b9c6-e2cfdee0efa3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:07.507843 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe4c5f-bbeb-436c-b9c6-e2cfdee0efa3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:07.507971 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe4c5f-bbeb-436c-b9c6-e2cfdee0efa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:07.527819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-26fe4c5f-bbeb-436c-b9c6-e2cfdee0efa3 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:39:07.529733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-26fe4c5f-bbeb-436c-b9c6-e2cfdee0efa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:07.596622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1269/2519] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:39:07.607310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8a7b-eabb-4251-aa37-e5f0e5e61942 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:07.609673 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7d8c8a7b-eabb-4251-aa37-e5f0e5e61942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:07.669627 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8a7b-eabb-4251-aa37-e5f0e5e61942 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:07.673565 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b29aac-6480-438e-91d6-ed887171ff66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:07.674226 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b29aac-6480-438e-91d6-ed887171ff66 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:07.674507 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b29aac-6480-438e-91d6-ed887171ff66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:07.674826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b29aac-6480-438e-91d6-ed887171ff66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:07.684688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b29aac-6480-438e-91d6-ed887171ff66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:07.686448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b29aac-6480-438e-91d6-ed887171ff66 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:07.697088 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1251/2520] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:39:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:39:08.158188 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe4c5f-bbeb-436c-b9c6-e2cfdee0efa3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:08.160849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-26fe4c5f-bbeb-436c-b9c6-e2cfdee0efa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:08.178526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe4c5f-bbeb-436c-b9c6-e2cfdee0efa3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:08.185246 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad43217-bdee-4ad9-9cdd-2a1085be552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:08.186140 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad43217-bdee-4ad9-9cdd-2a1085be552b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:08.186581 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad43217-bdee-4ad9-9cdd-2a1085be552b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:08.189872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad43217-bdee-4ad9-9cdd-2a1085be552b admin admin] PATH_INFO: `/v3/projects/9fb3e94cec6a43e3828e44e2995c08d3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:08.189872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad43217-bdee-4ad9-9cdd-2a1085be552b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb3e94cec6a43e3828e44e2995c08d3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:08.190325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad43217-bdee-4ad9-9cdd-2a1085be552b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:08.364263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ad43217-bdee-4ad9-9cdd-2a1085be552b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb3e94cec6a43e3828e44e2995c08d3', 'request_id': 'req-2ad43217-bdee-4ad9-9cdd-2a1085be552b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:08.476764 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ad43217-bdee-4ad9-9cdd-2a1085be552b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb3e94cec6a43e3828e44e2995c08d3', 'request_id': 'req-2ad43217-bdee-4ad9-9cdd-2a1085be552b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:08.483028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ad43217-bdee-4ad9-9cdd-2a1085be552b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb3e94cec6a43e3828e44e2995c08d3', 'request_id': 'req-2ad43217-bdee-4ad9-9cdd-2a1085be552b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:08.494431 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ad43217-bdee-4ad9-9cdd-2a1085be552b admin admin] The token cache is being invalidate because project 9fb3e94cec6a43e3828e44e2995c08d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:39:08.494759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ad43217-bdee-4ad9-9cdd-2a1085be552b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:08.495421 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ad43217-bdee-4ad9-9cdd-2a1085be552b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:08.497051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1270/2521] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:39:08 2022] DELETE /identity/v3/projects/9fb3e94cec6a43e3828e44e2995c08d3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:39:08.501091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b29aac-6480-438e-91d6-ed887171ff66 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:08.510800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b29aac-6480-438e-91d6-ed887171ff66 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:08.567141 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c26da-f6a3-4410-b494-2390fcd8dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:08.568014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c26da-f6a3-4410-b494-2390fcd8dede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:08.568287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c26da-f6a3-4410-b494-2390fcd8dede admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:08.568554 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c26da-f6a3-4410-b494-2390fcd8dede admin admin] PATH_INFO: `/v3/users/007248e9be7a4f4fbfbae14e6b5a05bb` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:08.569747 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c26da-f6a3-4410-b494-2390fcd8dede admin admin] RBAC: Authorizing `identity:delete_user(user_id=007248e9be7a4f4fbfbae14e6b5a05bb)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:08.571715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c26da-f6a3-4410-b494-2390fcd8dede admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:08.788775 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2d0c26da-f6a3-4410-b494-2390fcd8dede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '007248e9be7a4f4fbfbae14e6b5a05bb'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:08.859263 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2d0c26da-f6a3-4410-b494-2390fcd8dede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '007248e9be7a4f4fbfbae14e6b5a05bb'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:08.868532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2d0c26da-f6a3-4410-b494-2390fcd8dede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '007248e9be7a4f4fbfbae14e6b5a05bb'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:08.883187 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2d0c26da-f6a3-4410-b494-2390fcd8dede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '007248e9be7a4f4fbfbae14e6b5a05bb'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:08.883989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2d0c26da-f6a3-4410-b494-2390fcd8dede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '007248e9be7a4f4fbfbae14e6b5a05bb'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:08.890690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1252/2522] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:39:08 2022] DELETE /identity/v3/users/007248e9be7a4f4fbfbae14e6b5a05bb => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:39:08.937421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:09.351788 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad43217-bdee-4ad9-9cdd-2a1085be552b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:09.356281 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2ad43217-bdee-4ad9-9cdd-2a1085be552b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:09.372424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad43217-bdee-4ad9-9cdd-2a1085be552b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:09.429271 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:09.443506 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3baf38c-21d8-40df-90c8-c35d3c0dce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:09.444411 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baf38c-21d8-40df-90c8-c35d3c0dce38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:09.444666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baf38c-21d8-40df-90c8-c35d3c0dce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:09.444960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baf38c-21d8-40df-90c8-c35d3c0dce38 admin admin] PATH_INFO: `/v3/projects/a72dc15db8654dc98ac39b537f2365c8` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:09.446224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3baf38c-21d8-40df-90c8-c35d3c0dce38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72dc15db8654dc98ac39b537f2365c8)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:09.448214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3baf38c-21d8-40df-90c8-c35d3c0dce38 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:09.588805 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e3baf38c-21d8-40df-90c8-c35d3c0dce38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72dc15db8654dc98ac39b537f2365c8', 'request_id': 'req-e3baf38c-21d8-40df-90c8-c35d3c0dce38'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:09.676591 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e3baf38c-21d8-40df-90c8-c35d3c0dce38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72dc15db8654dc98ac39b537f2365c8', 'request_id': 'req-e3baf38c-21d8-40df-90c8-c35d3c0dce38'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:09.684209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e3baf38c-21d8-40df-90c8-c35d3c0dce38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72dc15db8654dc98ac39b537f2365c8', 'request_id': 'req-e3baf38c-21d8-40df-90c8-c35d3c0dce38'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:09.697343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e3baf38c-21d8-40df-90c8-c35d3c0dce38 admin admin] The token cache is being invalidate because project a72dc15db8654dc98ac39b537f2365c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:39:09.697631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e3baf38c-21d8-40df-90c8-c35d3c0dce38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:09.698376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e3baf38c-21d8-40df-90c8-c35d3c0dce38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:09.699968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1271/2523] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:39:09 2022] DELETE /identity/v3/projects/a72dc15db8654dc98ac39b537f2365c8 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:39:09.711938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:17.555661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c26da-f6a3-4410-b494-2390fcd8dede admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:17.557229 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2d0c26da-f6a3-4410-b494-2390fcd8dede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:17.570542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c26da-f6a3-4410-b494-2390fcd8dede admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:17.598912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:17.629694 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210176f-e439-40ee-a559-dd95a9d7565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:17.630576 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210176f-e439-40ee-a559-dd95a9d7565b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:17.630888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210176f-e439-40ee-a559-dd95a9d7565b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:17.631386 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210176f-e439-40ee-a559-dd95a9d7565b admin admin] PATH_INFO: `/v3/users/325384444ddf435da94d9a4147e3f83d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:17.633090 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210176f-e439-40ee-a559-dd95a9d7565b admin admin] RBAC: Authorizing `identity:delete_user(user_id=325384444ddf435da94d9a4147e3f83d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:17.635110 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210176f-e439-40ee-a559-dd95a9d7565b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:17.927507 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7210176f-e439-40ee-a559-dd95a9d7565b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325384444ddf435da94d9a4147e3f83d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:18.012238 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7210176f-e439-40ee-a559-dd95a9d7565b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325384444ddf435da94d9a4147e3f83d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:18.028818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7210176f-e439-40ee-a559-dd95a9d7565b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325384444ddf435da94d9a4147e3f83d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:18.036182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7210176f-e439-40ee-a559-dd95a9d7565b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325384444ddf435da94d9a4147e3f83d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:18.037160 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-7210176f-e439-40ee-a559-dd95a9d7565b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325384444ddf435da94d9a4147e3f83d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:18.048921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1253/2524] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:39:17 2022] DELETE /identity/v3/users/325384444ddf435da94d9a4147e3f83d => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:39:18.049257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1e00d-9f91-4a44-9a90-264de8bafef0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:18.049736 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1e00d-9f91-4a44-9a90-264de8bafef0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:18.049970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1e00d-9f91-4a44-9a90-264de8bafef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:18.069168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-dbb1e00d-9f91-4a44-9a90-264de8bafef0 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:39:18.070507 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dbb1e00d-9f91-4a44-9a90-264de8bafef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:18.139537 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1272/2525] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:39:18.150148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210176f-e439-40ee-a559-dd95a9d7565b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:18.151592 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7210176f-e439-40ee-a559-dd95a9d7565b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:18.211676 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210176f-e439-40ee-a559-dd95a9d7565b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:18.215590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6574914-838c-4db9-a1a0-968baca01ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:18.216231 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6574914-838c-4db9-a1a0-968baca01ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:18.220621 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6574914-838c-4db9-a1a0-968baca01ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:18.220621 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6574914-838c-4db9-a1a0-968baca01ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:18.228355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6574914-838c-4db9-a1a0-968baca01ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:18.229824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6574914-838c-4db9-a1a0-968baca01ff8 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:18.240519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1254/2526] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:39:18.640965 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1e00d-9f91-4a44-9a90-264de8bafef0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:18.642522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dbb1e00d-9f91-4a44-9a90-264de8bafef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:18.658323 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1e00d-9f91-4a44-9a90-264de8bafef0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:18.663773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75de98-cf8d-46bb-9e3d-d5530ef08603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:18.664454 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75de98-cf8d-46bb-9e3d-d5530ef08603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:18.664729 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75de98-cf8d-46bb-9e3d-d5530ef08603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:18.665004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75de98-cf8d-46bb-9e3d-d5530ef08603 admin admin] PATH_INFO: `/v3/projects/f1edce3ea6f04103a8f80e0886cd23eb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:18.666228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75de98-cf8d-46bb-9e3d-d5530ef08603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1edce3ea6f04103a8f80e0886cd23eb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:18.668176 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75de98-cf8d-46bb-9e3d-d5530ef08603 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:18.804423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-af75de98-cf8d-46bb-9e3d-d5530ef08603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1edce3ea6f04103a8f80e0886cd23eb', 'request_id': 'req-af75de98-cf8d-46bb-9e3d-d5530ef08603'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:18.865819 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-af75de98-cf8d-46bb-9e3d-d5530ef08603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1edce3ea6f04103a8f80e0886cd23eb', 'request_id': 'req-af75de98-cf8d-46bb-9e3d-d5530ef08603'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:18.871875 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-af75de98-cf8d-46bb-9e3d-d5530ef08603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1edce3ea6f04103a8f80e0886cd23eb', 'request_id': 'req-af75de98-cf8d-46bb-9e3d-d5530ef08603'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:18.883834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-af75de98-cf8d-46bb-9e3d-d5530ef08603 admin admin] The token cache is being invalidate because project f1edce3ea6f04103a8f80e0886cd23eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:39:18.884127 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-af75de98-cf8d-46bb-9e3d-d5530ef08603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:18.884768 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-af75de98-cf8d-46bb-9e3d-d5530ef08603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:18.886409 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1273/2527] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:39:18 2022] DELETE /identity/v3/projects/f1edce3ea6f04103a8f80e0886cd23eb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:39:28.236276 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=66,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:28.880939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:36.209684 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270bd71-9f3d-49af-8fea-9cef079ca40c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:36.210225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270bd71-9f3d-49af-8fea-9cef079ca40c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:36.210339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270bd71-9f3d-49af-8fea-9cef079ca40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:36.228699 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7270bd71-9f3d-49af-8fea-9cef079ca40c None None] MFA Rules not processed for user `a46612adeaa0450d94c0e10eb385d083`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:39:36.229922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7270bd71-9f3d-49af-8fea-9cef079ca40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:36.295368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1255/2528] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:39:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:39:40.914943 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75de98-cf8d-46bb-9e3d-d5530ef08603 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:40.917060 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-af75de98-cf8d-46bb-9e3d-d5530ef08603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:41.001617 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75de98-cf8d-46bb-9e3d-d5530ef08603 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:41.006587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efb095-bedc-4859-b3e2-fc4c592b43c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:41.007607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efb095-bedc-4859-b3e2-fc4c592b43c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:41.008393 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efb095-bedc-4859-b3e2-fc4c592b43c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:41.008393 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efb095-bedc-4859-b3e2-fc4c592b43c9 admin admin] PATH_INFO: `/v3/users/03268115f5e74d9a8683477bed367afa` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:41.009603 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efb095-bedc-4859-b3e2-fc4c592b43c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03268115f5e74d9a8683477bed367afa)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:41.011721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efb095-bedc-4859-b3e2-fc4c592b43c9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:41.280719 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-87efb095-bedc-4859-b3e2-fc4c592b43c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03268115f5e74d9a8683477bed367afa'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:41.407629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-87efb095-bedc-4859-b3e2-fc4c592b43c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03268115f5e74d9a8683477bed367afa'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:41.408320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-87efb095-bedc-4859-b3e2-fc4c592b43c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03268115f5e74d9a8683477bed367afa'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:41.422359 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-87efb095-bedc-4859-b3e2-fc4c592b43c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03268115f5e74d9a8683477bed367afa'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:41.432218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-87efb095-bedc-4859-b3e2-fc4c592b43c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03268115f5e74d9a8683477bed367afa'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:41.441554 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1274/2529] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:39:40 2022] DELETE /identity/v3/users/03268115f5e74d9a8683477bed367afa => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:39:41.447409 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfdbd3-483d-4b5a-a949-d515d0c61121 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:41.447900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfdbd3-483d-4b5a-a949-d515d0c61121 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:41.447998 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfdbd3-483d-4b5a-a949-d515d0c61121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:41.469573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0adfdbd3-483d-4b5a-a949-d515d0c61121 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:39:41.470884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0adfdbd3-483d-4b5a-a949-d515d0c61121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:41.542429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1256/2530] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:39:41.552580 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efb095-bedc-4859-b3e2-fc4c592b43c9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:41.554466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-87efb095-bedc-4859-b3e2-fc4c592b43c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:41.619525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efb095-bedc-4859-b3e2-fc4c592b43c9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:41.623213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71673455-b72f-45e7-8b09-ba4bdf515625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:41.623886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71673455-b72f-45e7-8b09-ba4bdf515625 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:41.624173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71673455-b72f-45e7-8b09-ba4bdf515625 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:41.624519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71673455-b72f-45e7-8b09-ba4bdf515625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:41.634777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71673455-b72f-45e7-8b09-ba4bdf515625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:41.636381 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71673455-b72f-45e7-8b09-ba4bdf515625 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:41.647951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1275/2531] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:39:42.245535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfdbd3-483d-4b5a-a949-d515d0c61121 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:42.245535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0adfdbd3-483d-4b5a-a949-d515d0c61121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:42.264065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfdbd3-483d-4b5a-a949-d515d0c61121 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:42.269130 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46834f6-7220-42f7-be63-15dde4145c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:42.270001 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46834f6-7220-42f7-be63-15dde4145c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:42.270275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46834f6-7220-42f7-be63-15dde4145c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:42.270543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46834f6-7220-42f7-be63-15dde4145c5b admin admin] PATH_INFO: `/v3/projects/867aeaaf603345599b7cd26326140164` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:42.271794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46834f6-7220-42f7-be63-15dde4145c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=867aeaaf603345599b7cd26326140164)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:42.273723 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46834f6-7220-42f7-be63-15dde4145c5b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:42.404183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c46834f6-7220-42f7-be63-15dde4145c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867aeaaf603345599b7cd26326140164', 'request_id': 'req-c46834f6-7220-42f7-be63-15dde4145c5b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:42.411504 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c46834f6-7220-42f7-be63-15dde4145c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867aeaaf603345599b7cd26326140164', 'request_id': 'req-c46834f6-7220-42f7-be63-15dde4145c5b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:42.561813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c46834f6-7220-42f7-be63-15dde4145c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867aeaaf603345599b7cd26326140164', 'request_id': 'req-c46834f6-7220-42f7-be63-15dde4145c5b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:42.573979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c46834f6-7220-42f7-be63-15dde4145c5b admin admin] The token cache is being invalidate because project 867aeaaf603345599b7cd26326140164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:39:42.574355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c46834f6-7220-42f7-be63-15dde4145c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:42.575049 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c46834f6-7220-42f7-be63-15dde4145c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:39:42.576649 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1257/2532] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:39:42 2022] DELETE /identity/v3/projects/867aeaaf603345599b7cd26326140164 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:39:42.581913 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38291b2-4aed-462e-99c2-81d35fc9181c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:42.582404 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38291b2-4aed-462e-99c2-81d35fc9181c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:42.582499 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38291b2-4aed-462e-99c2-81d35fc9181c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:42.603997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b38291b2-4aed-462e-99c2-81d35fc9181c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:39:42.605670 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b38291b2-4aed-462e-99c2-81d35fc9181c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:42.628066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:42.690511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1276/2533] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:39:42.698692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8aa0f-ea2b-47e0-955c-822d26a79c81 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:42.699072 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8aa0f-ea2b-47e0-955c-822d26a79c81 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:42.699345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8aa0f-ea2b-47e0-955c-822d26a79c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:42.721026 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b4d8aa0f-ea2b-47e0-955c-822d26a79c81 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:39:42.722941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b4d8aa0f-ea2b-47e0-955c-822d26a79c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:42.732207 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1258/2534] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:39:42.736620 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38291b2-4aed-462e-99c2-81d35fc9181c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:42.748472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38291b2-4aed-462e-99c2-81d35fc9181c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:42.754803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74cea4-92f6-4638-a34d-6d8016e4143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:42.755497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74cea4-92f6-4638-a34d-6d8016e4143b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:42.755776 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74cea4-92f6-4638-a34d-6d8016e4143b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:42.756052 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74cea4-92f6-4638-a34d-6d8016e4143b admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:42.756806 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74cea4-92f6-4638-a34d-6d8016e4143b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:39:42.757199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74cea4-92f6-4638-a34d-6d8016e4143b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:42.758892 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74cea4-92f6-4638-a34d-6d8016e4143b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:42.775726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1277/2535] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:39:42.780044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8aa0f-ea2b-47e0-955c-822d26a79c81 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:42.791183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8aa0f-ea2b-47e0-955c-822d26a79c81 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:42.803354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215085a7-2d5d-4631-a55d-01449c03b55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:42.804028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215085a7-2d5d-4631-a55d-01449c03b55c admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:42.804329 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215085a7-2d5d-4631-a55d-01449c03b55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:42.805592 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215085a7-2d5d-4631-a55d-01449c03b55c admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:42.806740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215085a7-2d5d-4631-a55d-01449c03b55c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:42.809007 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215085a7-2d5d-4631-a55d-01449c03b55c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:42.901997 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:42.909678 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1259/2536] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:39:42 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:39:42.914701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74cea4-92f6-4638-a34d-6d8016e4143b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:42.926205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74cea4-92f6-4638-a34d-6d8016e4143b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:42.990693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28755b71-45b9-443a-8cee-80335048db9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:42.991403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28755b71-45b9-443a-8cee-80335048db9b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:42.991686 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28755b71-45b9-443a-8cee-80335048db9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:42.991962 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28755b71-45b9-443a-8cee-80335048db9b admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:42.992662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28755b71-45b9-443a-8cee-80335048db9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:42.994587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28755b71-45b9-443a-8cee-80335048db9b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:43.114968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1278/2537] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:39:42 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:39:43.119340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215085a7-2d5d-4631-a55d-01449c03b55c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:43.131038 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215085a7-2d5d-4631-a55d-01449c03b55c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:43.138532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882d536-60c8-43c6-83cc-f8b8112b8ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:43.139260 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882d536-60c8-43c6-83cc-f8b8112b8ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:43.139582 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882d536-60c8-43c6-83cc-f8b8112b8ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:43.139852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882d536-60c8-43c6-83cc-f8b8112b8ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:43.144174 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882d536-60c8-43c6-83cc-f8b8112b8ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:43.144174 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882d536-60c8-43c6-83cc-f8b8112b8ab7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:43.158319 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1260/2538] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:39:43.164422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28755b71-45b9-443a-8cee-80335048db9b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:43.176443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28755b71-45b9-443a-8cee-80335048db9b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:43.181718 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb982e-b18c-4db6-b21f-e999248c99b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:43.182423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb982e-b18c-4db6-b21f-e999248c99b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:43.183579 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb982e-b18c-4db6-b21f-e999248c99b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:43.184882 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb982e-b18c-4db6-b21f-e999248c99b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:43.186306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb982e-b18c-4db6-b21f-e999248c99b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:43.188278 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb982e-b18c-4db6-b21f-e999248c99b2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:43.200398 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1279/2539] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:39:43.205213 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882d536-60c8-43c6-83cc-f8b8112b8ab7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:43.217208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882d536-60c8-43c6-83cc-f8b8112b8ab7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:43.222768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d0ce0-c470-4f0b-af9a-c5a7b23fddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:43.224027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d0ce0-c470-4f0b-af9a-c5a7b23fddcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:43.224314 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d0ce0-c470-4f0b-af9a-c5a7b23fddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:43.224587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d0ce0-c470-4f0b-af9a-c5a7b23fddcf admin admin] PATH_INFO: `/v3/projects/bda22bde8a37439091aa0ac823c5df42/users/b5c144d27ffc4e20a71ef52348c90386/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:43.242970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d0ce0-c470-4f0b-af9a-c5a7b23fddcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda22bde8a37439091aa0ac823c5df42, user_id=b5c144d27ffc4e20a71ef52348c90386, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:43.245729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d0ce0-c470-4f0b-af9a-c5a7b23fddcf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:43.387774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1261/2540] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:39:43 2022] PUT /identity/v3/projects/bda22bde8a37439091aa0ac823c5df42/users/b5c144d27ffc4e20a71ef52348c90386/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:39:43.465854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f840cce-1b98-4aed-a744-b9f235948b1c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:43.466144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f840cce-1b98-4aed-a744-b9f235948b1c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:43.466453 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f840cce-1b98-4aed-a744-b9f235948b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:43.499152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0f840cce-1b98-4aed-a744-b9f235948b1c None None] MFA Rules not processed for user `b5c144d27ffc4e20a71ef52348c90386`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:39:43.500369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0f840cce-1b98-4aed-a744-b9f235948b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:43.571677 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1280/2541] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:39:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:39:43.583414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d0ce0-c470-4f0b-af9a-c5a7b23fddcf admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:43.585519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3b4d0ce0-c470-4f0b-af9a-c5a7b23fddcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:43.647773 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d0ce0-c470-4f0b-af9a-c5a7b23fddcf admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:43.652813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dab815-c294-4ce1-a6b3-a66a0eeca89f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:43.653517 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dab815-c294-4ce1-a6b3-a66a0eeca89f service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:43.654448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dab815-c294-4ce1-a6b3-a66a0eeca89f service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:43.654448 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dab815-c294-4ce1-a6b3-a66a0eeca89f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:43.664376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dab815-c294-4ce1-a6b3-a66a0eeca89f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:43.665893 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dab815-c294-4ce1-a6b3-a66a0eeca89f service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:43.676916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1262/2542] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:39:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:39:45.472840 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67d9fd-a558-405a-9898-51daeaa18d8c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:45.473706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67d9fd-a558-405a-9898-51daeaa18d8c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:45.473706 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67d9fd-a558-405a-9898-51daeaa18d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:45.498002 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2d67d9fd-a558-405a-9898-51daeaa18d8c None None] MFA Rules not processed for user `b5c144d27ffc4e20a71ef52348c90386`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:39:45.499250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2d67d9fd-a558-405a-9898-51daeaa18d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:45.507692 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1281/2543] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:39:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:39:45.921443 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dab815-c294-4ce1-a6b3-a66a0eeca89f service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:39:45.923609 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f2dab815-c294-4ce1-a6b3-a66a0eeca89f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:46.008402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dab815-c294-4ce1-a6b3-a66a0eeca89f service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:39:46.022272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c31fea-052a-447e-8955-faf40e5e0a21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc616ed904d43d2b160b8d2766f7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:39:46.022272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c31fea-052a-447e-8955-faf40e5e0a21 service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:46.022272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c31fea-052a-447e-8955-faf40e5e0a21 service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:46.022272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c31fea-052a-447e-8955-faf40e5e0a21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:46.022784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-98c31fea-052a-447e-8955-faf40e5e0a21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:46.039186 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c31fea-052a-447e-8955-faf40e5e0a21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:39:46.040937 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c31fea-052a-447e-8955-faf40e5e0a21 service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:39:46.053219 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1263/2544] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:39:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:39:53.096208 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e795-3433-425c-8e31-9384ce423cfa None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:39:53.096763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e795-3433-425c-8e31-9384ce423cfa None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:39:53.096763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e795-3433-425c-8e31-9384ce423cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:39:53.116587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2cd0e795-3433-425c-8e31-9384ce423cfa None None] MFA Rules not processed for user `27e9d71846d840c4899ab2cbcd773a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:39:53.117709 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2cd0e795-3433-425c-8e31-9384ce423cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:39:53.123668 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:53.174657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1282/2545] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:39:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:39:56.048231 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=73,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:03.229876 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=20 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:10.456356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c55282-1748-483f-8a50-ba84235dc199 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:10.457497 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c55282-1748-483f-8a50-ba84235dc199 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:10.457851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c55282-1748-483f-8a50-ba84235dc199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:10.480376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c4c55282-1748-483f-8a50-ba84235dc199 None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:40:10.481944 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c4c55282-1748-483f-8a50-ba84235dc199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:10.569043 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1264/2546] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 20 19:40:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:40:10.806269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0e795-3433-425c-8e31-9384ce423cfa None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:10.808664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2cd0e795-3433-425c-8e31-9384ce423cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:10.912372 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0e795-3433-425c-8e31-9384ce423cfa None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:10.919670 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb71b1-e6a4-4dc0-92d0-da3471822431 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:10.920458 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb71b1-e6a4-4dc0-92d0-da3471822431 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:10.920915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb71b1-e6a4-4dc0-92d0-da3471822431 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:10.921144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb71b1-e6a4-4dc0-92d0-da3471822431 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:10.931421 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb71b1-e6a4-4dc0-92d0-da3471822431 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:10.933686 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb71b1-e6a4-4dc0-92d0-da3471822431 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:10.944016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1283/2547] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:40:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:40:11.996290 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a16aa-2765-4756-9712-b5eef75fec15 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:11.996817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a16aa-2765-4756-9712-b5eef75fec15 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:11.996817 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a16aa-2765-4756-9712-b5eef75fec15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:12.015822 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d49a16aa-2765-4756-9712-b5eef75fec15 None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:40:12.017037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d49a16aa-2765-4756-9712-b5eef75fec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:12.024682 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1265/2548] 10.222.0.16 () {58 vars in 967 bytes} [Wed Jul 20 19:40:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:40:12.039759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb71b1-e6a4-4dc0-92d0-da3471822431 service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:12.049838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb71b1-e6a4-4dc0-92d0-da3471822431 service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:12.055284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ee345-57fc-48b8-9f7a-9d252fddd002 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:12.055930 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ee345-57fc-48b8-9f7a-9d252fddd002 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:12.056206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ee345-57fc-48b8-9f7a-9d252fddd002 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:12.056473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ee345-57fc-48b8-9f7a-9d252fddd002 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:12.067403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ee345-57fc-48b8-9f7a-9d252fddd002 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:12.069049 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ee345-57fc-48b8-9f7a-9d252fddd002 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:12.079388 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1284/2549] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:40:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:40:12.831775 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dad4c-eff5-47b5-897a-beaab897e710 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:12.832065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dad4c-eff5-47b5-897a-beaab897e710 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:12.832344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dad4c-eff5-47b5-897a-beaab897e710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:12.850367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-022dad4c-eff5-47b5-897a-beaab897e710 None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:40:12.851709 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-022dad4c-eff5-47b5-897a-beaab897e710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:12.859079 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1266/2550] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 20 19:40:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:40:12.871542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ee345-57fc-48b8-9f7a-9d252fddd002 service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:12.882827 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ee345-57fc-48b8-9f7a-9d252fddd002 service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:12.889779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa7deb-27a7-489b-b855-4879b4e5a5e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:12.890432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa7deb-27a7-489b-b855-4879b4e5a5e7 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:12.890735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa7deb-27a7-489b-b855-4879b4e5a5e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:12.891011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa7deb-27a7-489b-b855-4879b4e5a5e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:12.900558 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa7deb-27a7-489b-b855-4879b4e5a5e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:12.902445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa7deb-27a7-489b-b855-4879b4e5a5e7 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:12.911084 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1285/2551] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:40:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:40:13.718799 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab62f5-12bc-45b8-818a-8d38e6a93386 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:13.719290 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab62f5-12bc-45b8-818a-8d38e6a93386 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:13.719386 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab62f5-12bc-45b8-818a-8d38e6a93386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:13.737689 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e6ab62f5-12bc-45b8-818a-8d38e6a93386 None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:40:13.738922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e6ab62f5-12bc-45b8-818a-8d38e6a93386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:13.746485 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1267/2552] 10.222.0.16 () {58 vars in 967 bytes} [Wed Jul 20 19:40:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:40:13.759860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa7deb-27a7-489b-b855-4879b4e5a5e7 service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:13.770890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa7deb-27a7-489b-b855-4879b4e5a5e7 service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:13.776692 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6871722-fed5-4c71-8761-63e62c4490c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:13.777387 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6871722-fed5-4c71-8761-63e62c4490c9 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:13.777693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6871722-fed5-4c71-8761-63e62c4490c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:13.777949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6871722-fed5-4c71-8761-63e62c4490c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:13.787216 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6871722-fed5-4c71-8761-63e62c4490c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:13.788808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6871722-fed5-4c71-8761-63e62c4490c9 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:13.799036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1286/2553] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:40:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:40:16.348438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0c046-e5f4-4100-ab6b-911c189eb772 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:16.348992 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0c046-e5f4-4100-ab6b-911c189eb772 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:16.349137 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0c046-e5f4-4100-ab6b-911c189eb772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:16.368450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5ae0c046-e5f4-4100-ab6b-911c189eb772 None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:40:16.369679 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5ae0c046-e5f4-4100-ab6b-911c189eb772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:16.377893 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1268/2554] 10.222.0.16 () {58 vars in 967 bytes} [Wed Jul 20 19:40:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:40:16.391918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6871722-fed5-4c71-8761-63e62c4490c9 service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:16.404254 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6871722-fed5-4c71-8761-63e62c4490c9 service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:16.409981 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de55e8-c015-4b30-bd5d-3ec986424b76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:16.410760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de55e8-c015-4b30-bd5d-3ec986424b76 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:16.411049 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de55e8-c015-4b30-bd5d-3ec986424b76 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:16.411328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de55e8-c015-4b30-bd5d-3ec986424b76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:16.422197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de55e8-c015-4b30-bd5d-3ec986424b76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:16.423951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de55e8-c015-4b30-bd5d-3ec986424b76 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:16.433195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1287/2555] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:40:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 19:40:16.702417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0c046-e5f4-4100-ab6b-911c189eb772 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:16.767829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0c046-e5f4-4100-ab6b-911c189eb772 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:16.772608 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888731e-fef2-441b-83c7-5e119619c511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:16.773492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888731e-fef2-441b-83c7-5e119619c511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:16.773776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888731e-fef2-441b-83c7-5e119619c511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:16.774047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888731e-fef2-441b-83c7-5e119619c511 admin admin] PATH_INFO: `/v3/users/b5c144d27ffc4e20a71ef52348c90386` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:16.775311 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888731e-fef2-441b-83c7-5e119619c511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c144d27ffc4e20a71ef52348c90386)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:16.777260 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888731e-fef2-441b-83c7-5e119619c511 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:16.994463 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9888731e-fef2-441b-83c7-5e119619c511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c144d27ffc4e20a71ef52348c90386'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:17.083665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9888731e-fef2-441b-83c7-5e119619c511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c144d27ffc4e20a71ef52348c90386'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:17.092249 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9888731e-fef2-441b-83c7-5e119619c511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c144d27ffc4e20a71ef52348c90386'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:17.104306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9888731e-fef2-441b-83c7-5e119619c511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c144d27ffc4e20a71ef52348c90386'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:17.105008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9888731e-fef2-441b-83c7-5e119619c511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c144d27ffc4e20a71ef52348c90386'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:17.106538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:17.111594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1269/2556] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:40:16 2022] DELETE /identity/v3/users/b5c144d27ffc4e20a71ef52348c90386 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:40:17.116444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b8164-b5be-4a67-ae7d-fdf19d7ae383 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:17.119090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b8164-b5be-4a67-ae7d-fdf19d7ae383 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:17.119090 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b8164-b5be-4a67-ae7d-fdf19d7ae383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:17.134412 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5f2b8164-b5be-4a67-ae7d-fdf19d7ae383 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:40:17.135763 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5f2b8164-b5be-4a67-ae7d-fdf19d7ae383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:17.196528 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1288/2557] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:40:17.206909 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888731e-fef2-441b-83c7-5e119619c511 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:17.208376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9888731e-fef2-441b-83c7-5e119619c511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:17.270858 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888731e-fef2-441b-83c7-5e119619c511 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:17.274985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2771-4ee8-4abb-9c5c-e03e3e29d5ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:17.275643 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2771-4ee8-4abb-9c5c-e03e3e29d5ae service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:17.275984 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2771-4ee8-4abb-9c5c-e03e3e29d5ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:17.276294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2771-4ee8-4abb-9c5c-e03e3e29d5ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:17.289607 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa2771-4ee8-4abb-9c5c-e03e3e29d5ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:17.291338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa2771-4ee8-4abb-9c5c-e03e3e29d5ae service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:17.301924 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1270/2558] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:40:17.615332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b8164-b5be-4a67-ae7d-fdf19d7ae383 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:17.616893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5f2b8164-b5be-4a67-ae7d-fdf19d7ae383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:17.630027 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b8164-b5be-4a67-ae7d-fdf19d7ae383 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:17.635218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d333eb4-ec46-4dac-9b35-f741d59428e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:17.636363 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d333eb4-ec46-4dac-9b35-f741d59428e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:17.636649 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d333eb4-ec46-4dac-9b35-f741d59428e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:17.636926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d333eb4-ec46-4dac-9b35-f741d59428e7 admin admin] PATH_INFO: `/v3/projects/bda22bde8a37439091aa0ac823c5df42` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:17.638167 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d333eb4-ec46-4dac-9b35-f741d59428e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bda22bde8a37439091aa0ac823c5df42)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:17.641608 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d333eb4-ec46-4dac-9b35-f741d59428e7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:17.769564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:17.781970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5d333eb4-ec46-4dac-9b35-f741d59428e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bda22bde8a37439091aa0ac823c5df42', 'request_id': 'req-5d333eb4-ec46-4dac-9b35-f741d59428e7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:17.883142 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5d333eb4-ec46-4dac-9b35-f741d59428e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bda22bde8a37439091aa0ac823c5df42', 'request_id': 'req-5d333eb4-ec46-4dac-9b35-f741d59428e7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:17.889535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5d333eb4-ec46-4dac-9b35-f741d59428e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bda22bde8a37439091aa0ac823c5df42', 'request_id': 'req-5d333eb4-ec46-4dac-9b35-f741d59428e7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:17.901115 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5d333eb4-ec46-4dac-9b35-f741d59428e7 admin admin] The token cache is being invalidate because project bda22bde8a37439091aa0ac823c5df42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:40:17.901405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5d333eb4-ec46-4dac-9b35-f741d59428e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:17.902125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5d333eb4-ec46-4dac-9b35-f741d59428e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:17.903868 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1289/2559] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:40:17 2022] DELETE /identity/v3/projects/bda22bde8a37439091aa0ac823c5df42 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:40:17.908927 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a23cc-8ef0-469f-896b-f4d9ad9e96bd None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:17.909446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a23cc-8ef0-469f-896b-f4d9ad9e96bd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:17.909553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a23cc-8ef0-469f-896b-f4d9ad9e96bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:17.927978 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3e7a23cc-8ef0-469f-896b-f4d9ad9e96bd None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:40:17.929198 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3e7a23cc-8ef0-469f-896b-f4d9ad9e96bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:17.995158 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1271/2560] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:40:18.004214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a4e1f-9137-4464-9c87-4188efad050d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:18.004496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a4e1f-9137-4464-9c87-4188efad050d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:18.004771 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a4e1f-9137-4464-9c87-4188efad050d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:18.023653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7a7a4e1f-9137-4464-9c87-4188efad050d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:40:18.025085 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7a7a4e1f-9137-4464-9c87-4188efad050d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:18.035282 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1290/2561] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:40:18.039606 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a23cc-8ef0-469f-896b-f4d9ad9e96bd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:18.050194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a23cc-8ef0-469f-896b-f4d9ad9e96bd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:18.054947 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb9630-8fd4-48ca-9bd7-0d19417f90d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:18.055600 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb9630-8fd4-48ca-9bd7-0d19417f90d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:18.055883 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb9630-8fd4-48ca-9bd7-0d19417f90d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:18.056158 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb9630-8fd4-48ca-9bd7-0d19417f90d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:18.056888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb9630-8fd4-48ca-9bd7-0d19417f90d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:40:18.057196 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb9630-8fd4-48ca-9bd7-0d19417f90d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:18.058917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb9630-8fd4-48ca-9bd7-0d19417f90d6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:18.073644 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1272/2562] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:40:18.075786 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a4e1f-9137-4464-9c87-4188efad050d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:18.086907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a4e1f-9137-4464-9c87-4188efad050d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:18.093093 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdc3a3-3737-4a65-a18e-daef5564f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:18.093905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdc3a3-3737-4a65-a18e-daef5564f5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:18.094212 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdc3a3-3737-4a65-a18e-daef5564f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:18.094542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdc3a3-3737-4a65-a18e-daef5564f5a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:18.095308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdc3a3-3737-4a65-a18e-daef5564f5a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:18.097228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdc3a3-3737-4a65-a18e-daef5564f5a3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:18.209429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1291/2563] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:40:18 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:40:18.210616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb9630-8fd4-48ca-9bd7-0d19417f90d6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:18.222248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb9630-8fd4-48ca-9bd7-0d19417f90d6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:18.289434 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30a31e-ce34-46bb-9b32-432df5fee9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:18.290634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30a31e-ce34-46bb-9b32-432df5fee9c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:18.290634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30a31e-ce34-46bb-9b32-432df5fee9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:18.290992 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30a31e-ce34-46bb-9b32-432df5fee9c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:18.291696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30a31e-ce34-46bb-9b32-432df5fee9c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:18.294405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30a31e-ce34-46bb-9b32-432df5fee9c3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:18.432819 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1273/2564] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:40:18 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:40:18.437072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdc3a3-3737-4a65-a18e-daef5564f5a3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:18.447685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdc3a3-3737-4a65-a18e-daef5564f5a3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:18.453099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c7f31-5ef4-4747-90df-0a1d2496d0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:18.453794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c7f31-5ef4-4747-90df-0a1d2496d0ae admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:18.454066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c7f31-5ef4-4747-90df-0a1d2496d0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:18.454336 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c7f31-5ef4-4747-90df-0a1d2496d0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:18.455122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c7f31-5ef4-4747-90df-0a1d2496d0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:18.456761 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c7f31-5ef4-4747-90df-0a1d2496d0ae admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:18.470657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1292/2565] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:40:18.473184 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30a31e-ce34-46bb-9b32-432df5fee9c3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:18.483506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30a31e-ce34-46bb-9b32-432df5fee9c3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:18.488472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddacd14-8f0f-41a8-ac6a-850494a1a9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:18.489142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddacd14-8f0f-41a8-ac6a-850494a1a9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:18.489423 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddacd14-8f0f-41a8-ac6a-850494a1a9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:18.489697 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddacd14-8f0f-41a8-ac6a-850494a1a9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:18.490425 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddacd14-8f0f-41a8-ac6a-850494a1a9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:18.492080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddacd14-8f0f-41a8-ac6a-850494a1a9b3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:18.502813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1274/2566] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:40:18.507013 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c7f31-5ef4-4747-90df-0a1d2496d0ae admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:18.517750 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c7f31-5ef4-4747-90df-0a1d2496d0ae admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:18.522289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1de6b-4116-44d3-8af5-6611d3ad2b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:18.523405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1de6b-4116-44d3-8af5-6611d3ad2b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:18.524894 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1de6b-4116-44d3-8af5-6611d3ad2b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:18.525278 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1de6b-4116-44d3-8af5-6611d3ad2b11 admin admin] PATH_INFO: `/v3/projects/25200bb2076b42f68148ef1e1d38ac85/users/5119b339704e4c1c8852bc55c6ced730/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:18.540740 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1de6b-4116-44d3-8af5-6611d3ad2b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25200bb2076b42f68148ef1e1d38ac85, user_id=5119b339704e4c1c8852bc55c6ced730, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:18.543430 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1de6b-4116-44d3-8af5-6611d3ad2b11 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:18.647997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1293/2567] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:40:18 2022] PUT /identity/v3/projects/25200bb2076b42f68148ef1e1d38ac85/users/5119b339704e4c1c8852bc55c6ced730/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:40:18.650778 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17035432-07d1-4f5c-bee5-183a6d867348 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:18.651071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17035432-07d1-4f5c-bee5-183a6d867348 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:18.651344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17035432-07d1-4f5c-bee5-183a6d867348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:18.665338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:18.671755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-17035432-07d1-4f5c-bee5-183a6d867348 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:40:18.673035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-17035432-07d1-4f5c-bee5-183a6d867348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:18.734907 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1275/2568] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:40:18.745875 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1de6b-4116-44d3-8af5-6611d3ad2b11 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:18.748151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-aff1de6b-4116-44d3-8af5-6611d3ad2b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:18.806684 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1de6b-4116-44d3-8af5-6611d3ad2b11 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:18.811211 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab54f9-72b5-4c68-9fe0-247e42a47258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:18.811872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab54f9-72b5-4c68-9fe0-247e42a47258 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:18.812159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab54f9-72b5-4c68-9fe0-247e42a47258 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:18.812433 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab54f9-72b5-4c68-9fe0-247e42a47258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:18.822155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab54f9-72b5-4c68-9fe0-247e42a47258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:18.823781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab54f9-72b5-4c68-9fe0-247e42a47258 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:18.834563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1294/2569] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:40:20.312117 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f890dd-db3d-4f1a-a024-358aaee06fc4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:20.312598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f890dd-db3d-4f1a-a024-358aaee06fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:20.312719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f890dd-db3d-4f1a-a024-358aaee06fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:20.378640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d8f890dd-db3d-4f1a-a024-358aaee06fc4 None None] MFA Rules not processed for user `5119b339704e4c1c8852bc55c6ced730`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:40:20.380136 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d8f890dd-db3d-4f1a-a024-358aaee06fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:20.481406 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1276/2570] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:40:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:40:20.494707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab54f9-72b5-4c68-9fe0-247e42a47258 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:20.496408 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-caab54f9-72b5-4c68-9fe0-247e42a47258 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:20.574735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab54f9-72b5-4c68-9fe0-247e42a47258 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:20.579022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fde133-8c04-49a6-8fb2-927bb1e25427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:20.579674 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fde133-8c04-49a6-8fb2-927bb1e25427 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:20.579955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fde133-8c04-49a6-8fb2-927bb1e25427 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:20.580228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fde133-8c04-49a6-8fb2-927bb1e25427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:20.588741 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fde133-8c04-49a6-8fb2-927bb1e25427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:20.590250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fde133-8c04-49a6-8fb2-927bb1e25427 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:20.599876 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1295/2571] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:40:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:40:22.597644 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81972-312c-46d9-b6b4-66aef21d3492 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:22.598234 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81972-312c-46d9-b6b4-66aef21d3492 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:22.598338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81972-312c-46d9-b6b4-66aef21d3492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:22.617509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-38d81972-312c-46d9-b6b4-66aef21d3492 None None] MFA Rules not processed for user `5119b339704e4c1c8852bc55c6ced730`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:40:22.618768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-38d81972-312c-46d9-b6b4-66aef21d3492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:22.626942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1277/2572] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:40:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:40:27.903488 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fde133-8c04-49a6-8fb2-927bb1e25427 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:27.905277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-71fde133-8c04-49a6-8fb2-927bb1e25427 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:27.915205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:27.922314 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fde133-8c04-49a6-8fb2-927bb1e25427 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:27.927626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffa8a9-8a0a-4b6f-b4ec-824be42ae5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:27.928593 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffa8a9-8a0a-4b6f-b4ec-824be42ae5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:27.929004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffa8a9-8a0a-4b6f-b4ec-824be42ae5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:27.929339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffa8a9-8a0a-4b6f-b4ec-824be42ae5fd admin admin] PATH_INFO: `/v3/users/384846a5204f484a8e5bf2c8c85d08e3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:27.930577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffa8a9-8a0a-4b6f-b4ec-824be42ae5fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=384846a5204f484a8e5bf2c8c85d08e3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:27.936544 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffa8a9-8a0a-4b6f-b4ec-824be42ae5fd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:28.175851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-daffa8a9-8a0a-4b6f-b4ec-824be42ae5fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384846a5204f484a8e5bf2c8c85d08e3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:28.325720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-daffa8a9-8a0a-4b6f-b4ec-824be42ae5fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384846a5204f484a8e5bf2c8c85d08e3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:28.329373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-daffa8a9-8a0a-4b6f-b4ec-824be42ae5fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384846a5204f484a8e5bf2c8c85d08e3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:28.357017 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-daffa8a9-8a0a-4b6f-b4ec-824be42ae5fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384846a5204f484a8e5bf2c8c85d08e3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:28.368965 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-daffa8a9-8a0a-4b6f-b4ec-824be42ae5fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384846a5204f484a8e5bf2c8c85d08e3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:28.379578 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1296/2573] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:40:27 2022] DELETE /identity/v3/users/384846a5204f484a8e5bf2c8c85d08e3 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:40:28.765979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d81972-312c-46d9-b6b4-66aef21d3492 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:28.801241 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d81972-312c-46d9-b6b4-66aef21d3492 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:28.877249 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b31971-be98-442d-aadf-4edd376fb260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:28.878142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b31971-be98-442d-aadf-4edd376fb260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:28.878423 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b31971-be98-442d-aadf-4edd376fb260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:28.878975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b31971-be98-442d-aadf-4edd376fb260 admin admin] PATH_INFO: `/v3/projects/aa4f46651e8b4d4c906c4b74080e3a6d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:28.880186 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b31971-be98-442d-aadf-4edd376fb260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4f46651e8b4d4c906c4b74080e3a6d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:28.882106 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b31971-be98-442d-aadf-4edd376fb260 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:29.028410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:29.042375 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e4b31971-be98-442d-aadf-4edd376fb260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4f46651e8b4d4c906c4b74080e3a6d', 'request_id': 'req-e4b31971-be98-442d-aadf-4edd376fb260'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:29.048924 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e4b31971-be98-442d-aadf-4edd376fb260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4f46651e8b4d4c906c4b74080e3a6d', 'request_id': 'req-e4b31971-be98-442d-aadf-4edd376fb260'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:29.147768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e4b31971-be98-442d-aadf-4edd376fb260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4f46651e8b4d4c906c4b74080e3a6d', 'request_id': 'req-e4b31971-be98-442d-aadf-4edd376fb260'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:29.160052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e4b31971-be98-442d-aadf-4edd376fb260 admin admin] The token cache is being invalidate because project aa4f46651e8b4d4c906c4b74080e3a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:40:29.160340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e4b31971-be98-442d-aadf-4edd376fb260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:29.160975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e4b31971-be98-442d-aadf-4edd376fb260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:29.162538 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1278/2574] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:40:28 2022] DELETE /identity/v3/projects/aa4f46651e8b4d4c906c4b74080e3a6d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:40:29.166571 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffa8a9-8a0a-4b6f-b4ec-824be42ae5fd admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:29.168044 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-daffa8a9-8a0a-4b6f-b4ec-824be42ae5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:29.181721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffa8a9-8a0a-4b6f-b4ec-824be42ae5fd admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:29.241087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e467b21-e0fb-4adf-82fb-3e5b0460fc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:29.241879 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e467b21-e0fb-4adf-82fb-3e5b0460fc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:29.242155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e467b21-e0fb-4adf-82fb-3e5b0460fc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:29.242426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e467b21-e0fb-4adf-82fb-3e5b0460fc85 admin admin] PATH_INFO: `/v3/users/8df89007f46249e0845bc6acb292058e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:29.243723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e467b21-e0fb-4adf-82fb-3e5b0460fc85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df89007f46249e0845bc6acb292058e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:29.248922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e467b21-e0fb-4adf-82fb-3e5b0460fc85 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:29.596037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8e467b21-e0fb-4adf-82fb-3e5b0460fc85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df89007f46249e0845bc6acb292058e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:29.665358 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8e467b21-e0fb-4adf-82fb-3e5b0460fc85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df89007f46249e0845bc6acb292058e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:29.666000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8e467b21-e0fb-4adf-82fb-3e5b0460fc85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df89007f46249e0845bc6acb292058e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:29.683243 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8e467b21-e0fb-4adf-82fb-3e5b0460fc85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df89007f46249e0845bc6acb292058e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:29.692540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:29.697505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8e467b21-e0fb-4adf-82fb-3e5b0460fc85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df89007f46249e0845bc6acb292058e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:29.711450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1297/2575] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:40:29 2022] DELETE /identity/v3/users/8df89007f46249e0845bc6acb292058e => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:40:30.087277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b31971-be98-442d-aadf-4edd376fb260 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:30.089021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e4b31971-be98-442d-aadf-4edd376fb260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:30.103638 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b31971-be98-442d-aadf-4edd376fb260 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:30.184306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:30.185367 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:30.185699 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:30.186218 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891 admin admin] PATH_INFO: `/v3/projects/cb579c200ed346df87014e77b99370e5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:30.187362 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb579c200ed346df87014e77b99370e5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:30.189374 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:30.337913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb579c200ed346df87014e77b99370e5', 'request_id': 'req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:30.347362 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb579c200ed346df87014e77b99370e5', 'request_id': 'req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:30.433795 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb579c200ed346df87014e77b99370e5', 'request_id': 'req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:30.448374 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891 admin admin] The token cache is being invalidate because project cb579c200ed346df87014e77b99370e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:40:30.448663 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:30.449340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:30.458767 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1279/2576] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:40:30 2022] DELETE /identity/v3/projects/cb579c200ed346df87014e77b99370e5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:40:40.445418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=63,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:40.976373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:47.912367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e467b21-e0fb-4adf-82fb-3e5b0460fc85 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:47.914169 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8e467b21-e0fb-4adf-82fb-3e5b0460fc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:47.983478 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e467b21-e0fb-4adf-82fb-3e5b0460fc85 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:48.049222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081e029-dcdc-4646-8a5f-7d50362d33de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:48.050135 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081e029-dcdc-4646-8a5f-7d50362d33de service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:48.050446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081e029-dcdc-4646-8a5f-7d50362d33de service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:48.050747 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081e029-dcdc-4646-8a5f-7d50362d33de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:48.052589 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3081e029-dcdc-4646-8a5f-7d50362d33de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:48.128768 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081e029-dcdc-4646-8a5f-7d50362d33de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:48.130083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081e029-dcdc-4646-8a5f-7d50362d33de service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:48.140429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1298/2577] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:40:49.289157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:49.291988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:49.308831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b900e5f-7ded-4b22-8f6a-f10c7cffd891 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:49.313940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2894a-b8c7-4592-9a7c-9bc359f4fcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:49.315594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2894a-b8c7-4592-9a7c-9bc359f4fcab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:49.324100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2894a-b8c7-4592-9a7c-9bc359f4fcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:49.324100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2894a-b8c7-4592-9a7c-9bc359f4fcab admin admin] PATH_INFO: `/v3/users/a46612adeaa0450d94c0e10eb385d083` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:49.324100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2894a-b8c7-4592-9a7c-9bc359f4fcab admin admin] RBAC: Authorizing `identity:delete_user(user_id=a46612adeaa0450d94c0e10eb385d083)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:49.324100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2894a-b8c7-4592-9a7c-9bc359f4fcab admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:49.531375 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-47c2894a-b8c7-4592-9a7c-9bc359f4fcab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a46612adeaa0450d94c0e10eb385d083'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:49.614246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-47c2894a-b8c7-4592-9a7c-9bc359f4fcab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a46612adeaa0450d94c0e10eb385d083'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:49.622205 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-47c2894a-b8c7-4592-9a7c-9bc359f4fcab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a46612adeaa0450d94c0e10eb385d083'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:49.636188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-47c2894a-b8c7-4592-9a7c-9bc359f4fcab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a46612adeaa0450d94c0e10eb385d083'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:49.636922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-47c2894a-b8c7-4592-9a7c-9bc359f4fcab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a46612adeaa0450d94c0e10eb385d083'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:49.644011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1280/2578] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:40:49 2022] DELETE /identity/v3/users/a46612adeaa0450d94c0e10eb385d083 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:40:49.923334 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081e029-dcdc-4646-8a5f-7d50362d33de service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:49.934277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081e029-dcdc-4646-8a5f-7d50362d33de service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:49.998192 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e55df-6277-4964-854c-14050a30d9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:49.999091 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e55df-6277-4964-854c-14050a30d9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:49.999371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e55df-6277-4964-854c-14050a30d9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:49.999642 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e55df-6277-4964-854c-14050a30d9ec admin admin] PATH_INFO: `/v3/projects/46ce4c173abc49a6b92c2aece8e5c520` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:50.000831 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e55df-6277-4964-854c-14050a30d9ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ce4c173abc49a6b92c2aece8e5c520)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:50.002965 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e55df-6277-4964-854c-14050a30d9ec admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:50.011333 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:50.204758 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b16e55df-6277-4964-854c-14050a30d9ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ce4c173abc49a6b92c2aece8e5c520', 'request_id': 'req-b16e55df-6277-4964-854c-14050a30d9ec'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:50.300393 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b16e55df-6277-4964-854c-14050a30d9ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ce4c173abc49a6b92c2aece8e5c520', 'request_id': 'req-b16e55df-6277-4964-854c-14050a30d9ec'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:50.307626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b16e55df-6277-4964-854c-14050a30d9ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ce4c173abc49a6b92c2aece8e5c520', 'request_id': 'req-b16e55df-6277-4964-854c-14050a30d9ec'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:50.321631 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b16e55df-6277-4964-854c-14050a30d9ec admin admin] The token cache is being invalidate because project 46ce4c173abc49a6b92c2aece8e5c520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:40:50.321929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b16e55df-6277-4964-854c-14050a30d9ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:50.322601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b16e55df-6277-4964-854c-14050a30d9ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:40:50.325609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1299/2579] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:40:49 2022] DELETE /identity/v3/projects/46ce4c173abc49a6b92c2aece8e5c520 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:40:50.332609 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89544d-f9a5-40b3-ae0b-8568d56d073c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:50.333157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89544d-f9a5-40b3-ae0b-8568d56d073c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:50.333541 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89544d-f9a5-40b3-ae0b-8568d56d073c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:50.354582 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5b89544d-f9a5-40b3-ae0b-8568d56d073c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:40:50.356133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5b89544d-f9a5-40b3-ae0b-8568d56d073c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:50.425461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1281/2580] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:40:50.433400 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8a0ac-9824-444e-a256-79b64b16a1df None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:50.433685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8a0ac-9824-444e-a256-79b64b16a1df None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:50.433960 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8a0ac-9824-444e-a256-79b64b16a1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:50.454139 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-81c8a0ac-9824-444e-a256-79b64b16a1df None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:40:50.456308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-81c8a0ac-9824-444e-a256-79b64b16a1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:50.465580 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1300/2581] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:40:50.473150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89544d-f9a5-40b3-ae0b-8568d56d073c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:50.486694 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89544d-f9a5-40b3-ae0b-8568d56d073c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:50.492297 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e25c72-1d47-4b3d-b8b2-49ecc0ca2f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:50.492979 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e25c72-1d47-4b3d-b8b2-49ecc0ca2f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:50.493292 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e25c72-1d47-4b3d-b8b2-49ecc0ca2f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:50.493658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e25c72-1d47-4b3d-b8b2-49ecc0ca2f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:50.494450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e25c72-1d47-4b3d-b8b2-49ecc0ca2f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:40:50.494794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e25c72-1d47-4b3d-b8b2-49ecc0ca2f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:50.500553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e25c72-1d47-4b3d-b8b2-49ecc0ca2f11 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:50.511864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1282/2582] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:40:50.518541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8a0ac-9824-444e-a256-79b64b16a1df None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:50.531606 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8a0ac-9824-444e-a256-79b64b16a1df None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:50.537976 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705787a-ba3f-4b11-ab7f-2e029619c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:50.538496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705787a-ba3f-4b11-ab7f-2e029619c1ad admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:50.538905 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705787a-ba3f-4b11-ab7f-2e029619c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:50.539290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705787a-ba3f-4b11-ab7f-2e029619c1ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:50.540092 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705787a-ba3f-4b11-ab7f-2e029619c1ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:50.541998 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705787a-ba3f-4b11-ab7f-2e029619c1ad admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:50.684089 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1301/2583] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:40:50 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:40:50.693465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e25c72-1d47-4b3d-b8b2-49ecc0ca2f11 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:50.699789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e25c72-1d47-4b3d-b8b2-49ecc0ca2f11 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:50.778014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021672e-dd81-4f9a-be0b-f0d66243dff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:50.778731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021672e-dd81-4f9a-be0b-f0d66243dff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:50.779048 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021672e-dd81-4f9a-be0b-f0d66243dff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:50.779325 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021672e-dd81-4f9a-be0b-f0d66243dff3 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:50.780027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021672e-dd81-4f9a-be0b-f0d66243dff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:50.781997 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021672e-dd81-4f9a-be0b-f0d66243dff3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:50.789611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:50.973683 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1283/2584] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:40:50 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:40:50.977749 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705787a-ba3f-4b11-ab7f-2e029619c1ad admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:50.989005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705787a-ba3f-4b11-ab7f-2e029619c1ad admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:50.993999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e7495-cf1f-4ebb-887a-ac02bd04b6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:50.995587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e7495-cf1f-4ebb-887a-ac02bd04b6dd admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:50.995587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e7495-cf1f-4ebb-887a-ac02bd04b6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:50.995587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e7495-cf1f-4ebb-887a-ac02bd04b6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:50.996199 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e7495-cf1f-4ebb-887a-ac02bd04b6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:50.997920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e7495-cf1f-4ebb-887a-ac02bd04b6dd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:51.009993 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1302/2585] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:40:51.014379 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021672e-dd81-4f9a-be0b-f0d66243dff3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:51.025453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021672e-dd81-4f9a-be0b-f0d66243dff3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:51.031246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b4156-56ff-4e15-96b5-9dcccdf3bd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:51.035725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b4156-56ff-4e15-96b5-9dcccdf3bd0c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:51.035725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b4156-56ff-4e15-96b5-9dcccdf3bd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:51.035725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b4156-56ff-4e15-96b5-9dcccdf3bd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:51.035725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b4156-56ff-4e15-96b5-9dcccdf3bd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:51.035725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b4156-56ff-4e15-96b5-9dcccdf3bd0c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:51.046486 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1284/2586] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:40:51.052401 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e7495-cf1f-4ebb-887a-ac02bd04b6dd admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:51.063091 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e7495-cf1f-4ebb-887a-ac02bd04b6dd admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:51.068955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38fcd0-b82c-4860-aa57-eefeed5467bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:51.069920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38fcd0-b82c-4860-aa57-eefeed5467bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:51.070107 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38fcd0-b82c-4860-aa57-eefeed5467bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:51.070375 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38fcd0-b82c-4860-aa57-eefeed5467bb admin admin] PATH_INFO: `/v3/projects/de892f126d9b4cb9984cbecdd84f6681/users/666264f8aacb43589d17a158048c4a43/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:51.086692 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38fcd0-b82c-4860-aa57-eefeed5467bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=de892f126d9b4cb9984cbecdd84f6681, user_id=666264f8aacb43589d17a158048c4a43, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:51.089417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38fcd0-b82c-4860-aa57-eefeed5467bb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:51.171852 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1303/2587] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:40:51 2022] PUT /identity/v3/projects/de892f126d9b4cb9984cbecdd84f6681/users/666264f8aacb43589d17a158048c4a43/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:40:51.177727 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8269c-4b3c-4dad-8314-1f1f4e7c66ce None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:51.178014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8269c-4b3c-4dad-8314-1f1f4e7c66ce None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:51.178293 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8269c-4b3c-4dad-8314-1f1f4e7c66ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:51.196904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cff8269c-4b3c-4dad-8314-1f1f4e7c66ce None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:40:51.198163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cff8269c-4b3c-4dad-8314-1f1f4e7c66ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:51.262606 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1285/2588] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:40:51.274630 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38fcd0-b82c-4860-aa57-eefeed5467bb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:51.276448 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2d38fcd0-b82c-4860-aa57-eefeed5467bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:51.340929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38fcd0-b82c-4860-aa57-eefeed5467bb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:51.344560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cee09-97ef-4e86-95df-f63e212f20cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:51.345209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cee09-97ef-4e86-95df-f63e212f20cd service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:51.345485 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cee09-97ef-4e86-95df-f63e212f20cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:51.345752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cee09-97ef-4e86-95df-f63e212f20cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:51.355812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cee09-97ef-4e86-95df-f63e212f20cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:51.357263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cee09-97ef-4e86-95df-f63e212f20cd service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:51.370028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1304/2589] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:40:52.774881 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8269c-4b3c-4dad-8314-1f1f4e7c66ce None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:52.776455 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cff8269c-4b3c-4dad-8314-1f1f4e7c66ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:52.792027 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8269c-4b3c-4dad-8314-1f1f4e7c66ce None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:52.796988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb3f83-53cc-437d-9ce0-0b9876140fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:52.797759 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb3f83-53cc-437d-9ce0-0b9876140fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:52.798106 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb3f83-53cc-437d-9ce0-0b9876140fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:52.798533 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb3f83-53cc-437d-9ce0-0b9876140fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:52.802357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a0bb3f83-53cc-437d-9ce0-0b9876140fd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:52.923604 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb3f83-53cc-437d-9ce0-0b9876140fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:52.925776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb3f83-53cc-437d-9ce0-0b9876140fd8 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:52.937370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1286/2590] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:40:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:40:56.146003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cee09-97ef-4e86-95df-f63e212f20cd service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:56.148205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-312cee09-97ef-4e86-95df-f63e212f20cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:56.203591 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:56.226933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cee09-97ef-4e86-95df-f63e212f20cd service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:56.231161 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2bd27-ba7b-4b19-a33f-166196c9bfdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:56.232041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2bd27-ba7b-4b19-a33f-166196c9bfdc service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:56.232512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2bd27-ba7b-4b19-a33f-166196c9bfdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:56.233122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2bd27-ba7b-4b19-a33f-166196c9bfdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:56.235230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6fe2bd27-ba7b-4b19-a33f-166196c9bfdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:56.253527 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2bd27-ba7b-4b19-a33f-166196c9bfdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:56.255088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2bd27-ba7b-4b19-a33f-166196c9bfdc service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:56.267854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1305/2591] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:40:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:40:57.988427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121899dd-2f6c-46ff-8abc-065f46647135 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:57.989718 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121899dd-2f6c-46ff-8abc-065f46647135 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:57.990159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121899dd-2f6c-46ff-8abc-065f46647135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:58.023457 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-121899dd-2f6c-46ff-8abc-065f46647135 None None] MFA Rules not processed for user `666264f8aacb43589d17a158048c4a43`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:40:58.025173 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-121899dd-2f6c-46ff-8abc-065f46647135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:58.093312 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:58.107211 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1287/2592] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:40:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:40:58.123087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2bd27-ba7b-4b19-a33f-166196c9bfdc service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:40:58.124540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6fe2bd27-ba7b-4b19-a33f-166196c9bfdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:40:58.139849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2bd27-ba7b-4b19-a33f-166196c9bfdc service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:40:58.145879 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132ded7-53ed-4e35-9412-5c0e5783e225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:40:58.146534 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132ded7-53ed-4e35-9412-5c0e5783e225 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:40:58.146895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132ded7-53ed-4e35-9412-5c0e5783e225 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:40:58.147283 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132ded7-53ed-4e35-9412-5c0e5783e225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:40:58.155805 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132ded7-53ed-4e35-9412-5c0e5783e225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:40:58.157609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132ded7-53ed-4e35-9412-5c0e5783e225 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:40:58.169038 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1306/2593] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:40:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:41:00.812528 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5e024-bdff-4df2-93ae-fff8286ada91 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:00.813086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5e024-bdff-4df2-93ae-fff8286ada91 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:00.813513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5e024-bdff-4df2-93ae-fff8286ada91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:00.846340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b3f5e024-bdff-4df2-93ae-fff8286ada91 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:41:00.849318 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b3f5e024-bdff-4df2-93ae-fff8286ada91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:00.878629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1288/2594] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Jul 20 19:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:41:00.905242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132ded7-53ed-4e35-9412-5c0e5783e225 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:00.907066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8132ded7-53ed-4e35-9412-5c0e5783e225 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:00.923965 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132ded7-53ed-4e35-9412-5c0e5783e225 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:00.939796 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50482e4-6189-439e-955a-3b0fe416270b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:00.940253 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e207660-05ee-4d7c-bdf2-8a50ed3ce73e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:00.941651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50482e4-6189-439e-955a-3b0fe416270b service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:00.942105 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50482e4-6189-439e-955a-3b0fe416270b service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:00.942317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e207660-05ee-4d7c-bdf2-8a50ed3ce73e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:00.942692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e207660-05ee-4d7c-bdf2-8a50ed3ce73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:00.942878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50482e4-6189-439e-955a-3b0fe416270b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:00.954609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50482e4-6189-439e-955a-3b0fe416270b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:00.957213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50482e4-6189-439e-955a-3b0fe416270b service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:00.963526 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2e207660-05ee-4d7c-bdf2-8a50ed3ce73e None None] MFA Rules not processed for user `666264f8aacb43589d17a158048c4a43`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:41:00.964755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2e207660-05ee-4d7c-bdf2-8a50ed3ce73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:00.975003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1307/2595] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:41:00.982241 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1289/2596] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:41:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:41:01.376317 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50482e4-6189-439e-955a-3b0fe416270b service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:01.387774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50482e4-6189-439e-955a-3b0fe416270b service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:01.391462 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaeaff-8c26-4515-9979-49cd1939a6f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:01.392321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaeaff-8c26-4515-9979-49cd1939a6f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:01.392775 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaeaff-8c26-4515-9979-49cd1939a6f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:01.399870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaeaff-8c26-4515-9979-49cd1939a6f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:01.399870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4ffaeaff-8c26-4515-9979-49cd1939a6f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:01.405842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaeaff-8c26-4515-9979-49cd1939a6f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:01.407354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaeaff-8c26-4515-9979-49cd1939a6f1 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:01.418452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1308/2597] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:41:01.911398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e207660-05ee-4d7c-bdf2-8a50ed3ce73e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:01.912797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2e207660-05ee-4d7c-bdf2-8a50ed3ce73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:01.988824 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e207660-05ee-4d7c-bdf2-8a50ed3ce73e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:01.994208 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87b774-4291-4aac-8823-f8dfb07f46f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc616ed904d43d2b160b8d2766f7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:01.994893 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87b774-4291-4aac-8823-f8dfb07f46f3 service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:01.995175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87b774-4291-4aac-8823-f8dfb07f46f3 service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:01.995449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87b774-4291-4aac-8823-f8dfb07f46f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:01.997227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fd87b774-4291-4aac-8823-f8dfb07f46f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:02.009258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87b774-4291-4aac-8823-f8dfb07f46f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:02.010827 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87b774-4291-4aac-8823-f8dfb07f46f3 service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:02.021547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1290/2598] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:41:05.082711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464068a-b096-499e-a64f-46d0da812df3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:05.083316 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464068a-b096-499e-a64f-46d0da812df3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:05.083316 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464068a-b096-499e-a64f-46d0da812df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:05.103206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2464068a-b096-499e-a64f-46d0da812df3 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:41:05.104441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2464068a-b096-499e-a64f-46d0da812df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:05.113450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1309/2599] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Jul 20 19:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:41:05.133876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87b774-4291-4aac-8823-f8dfb07f46f3 service placement] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:05.147105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87b774-4291-4aac-8823-f8dfb07f46f3 service placement] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:05.153604 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a1430-9f98-4be9-b621-e3b6f3d3ef62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:05.159516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a1430-9f98-4be9-b621-e3b6f3d3ef62 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:05.159516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a1430-9f98-4be9-b621-e3b6f3d3ef62 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:05.159516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a1430-9f98-4be9-b621-e3b6f3d3ef62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:05.164399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a1430-9f98-4be9-b621-e3b6f3d3ef62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:05.166007 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a1430-9f98-4be9-b621-e3b6f3d3ef62 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:05.176840 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1291/2600] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:41:07.969551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464068a-b096-499e-a64f-46d0da812df3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:07.986833 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464068a-b096-499e-a64f-46d0da812df3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:07.995505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b79c2-4d0d-48a6-8aa1-44811a17cd3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:07.996954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b79c2-4d0d-48a6-8aa1-44811a17cd3b service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:07.997275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b79c2-4d0d-48a6-8aa1-44811a17cd3b service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:07.997564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b79c2-4d0d-48a6-8aa1-44811a17cd3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:07.999660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2e9b79c2-4d0d-48a6-8aa1-44811a17cd3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:08.072483 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b79c2-4d0d-48a6-8aa1-44811a17cd3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:08.074224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b79c2-4d0d-48a6-8aa1-44811a17cd3b service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:08.085480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1310/2601] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:41:09.571404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a271ff-9dd6-4bb7-9d14-8307559791ed None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:09.571962 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a271ff-9dd6-4bb7-9d14-8307559791ed None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:09.572090 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a271ff-9dd6-4bb7-9d14-8307559791ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:09.592436 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-40a271ff-9dd6-4bb7-9d14-8307559791ed None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:41:09.593642 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-40a271ff-9dd6-4bb7-9d14-8307559791ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:09.602218 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1292/2602] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Jul 20 19:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:41:09.630245 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b79c2-4d0d-48a6-8aa1-44811a17cd3b service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:09.647295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b79c2-4d0d-48a6-8aa1-44811a17cd3b service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:09.656777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9763a8-bc08-4389-9872-312768a76a97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:09.657914 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9763a8-bc08-4389-9872-312768a76a97 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:09.658462 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9763a8-bc08-4389-9872-312768a76a97 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:09.659021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9763a8-bc08-4389-9872-312768a76a97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:09.676307 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9763a8-bc08-4389-9872-312768a76a97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:09.679414 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9763a8-bc08-4389-9872-312768a76a97 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:09.695915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1311/2603] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:41:11.729797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a11ab5-cab2-4a70-945a-c85aaf4e2bde None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:11.730277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a11ab5-cab2-4a70-945a-c85aaf4e2bde None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:11.730373 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a11ab5-cab2-4a70-945a-c85aaf4e2bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:11.751081 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-06a11ab5-cab2-4a70-945a-c85aaf4e2bde None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:41:11.752493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-06a11ab5-cab2-4a70-945a-c85aaf4e2bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:11.823289 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1293/2604] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 20 19:41:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:41:11.849125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9763a8-bc08-4389-9872-312768a76a97 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:11.850553 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7b9763a8-bc08-4389-9872-312768a76a97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:11.924853 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9763a8-bc08-4389-9872-312768a76a97 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:11.930565 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d29b6-175e-41ed-8d3e-87400a004c19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:11.931253 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d29b6-175e-41ed-8d3e-87400a004c19 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:11.931535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d29b6-175e-41ed-8d3e-87400a004c19 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:11.931808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d29b6-175e-41ed-8d3e-87400a004c19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:11.941124 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d29b6-175e-41ed-8d3e-87400a004c19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:11.943209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d29b6-175e-41ed-8d3e-87400a004c19 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:11.953885 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1312/2605] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:41:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 19:41:12.427746 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335a1f1-9dca-450e-bef3-2feca6f8b0f4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:12.428275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335a1f1-9dca-450e-bef3-2feca6f8b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:12.428731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335a1f1-9dca-450e-bef3-2feca6f8b0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:12.459469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f335a1f1-9dca-450e-bef3-2feca6f8b0f4 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:41:12.459469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f335a1f1-9dca-450e-bef3-2feca6f8b0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:12.462382 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1294/2606] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Jul 20 19:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:41:12.508130 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d29b6-175e-41ed-8d3e-87400a004c19 service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:12.526018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d29b6-175e-41ed-8d3e-87400a004c19 service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:12.531769 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48e7f7-48ac-4d0e-8fb3-96c6e885d5b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:12.532494 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48e7f7-48ac-4d0e-8fb3-96c6e885d5b9 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:12.532853 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48e7f7-48ac-4d0e-8fb3-96c6e885d5b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:12.533252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48e7f7-48ac-4d0e-8fb3-96c6e885d5b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:12.540869 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:41:12.545097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48e7f7-48ac-4d0e-8fb3-96c6e885d5b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:12.547003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48e7f7-48ac-4d0e-8fb3-96c6e885d5b9 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:12.558713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1313/2607] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:41:14.340380 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335a1f1-9dca-450e-bef3-2feca6f8b0f4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:14.354068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335a1f1-9dca-450e-bef3-2feca6f8b0f4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:14.362140 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f2e98-f483-4d93-84bb-a7bb0fd07199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:14.362931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f2e98-f483-4d93-84bb-a7bb0fd07199 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:14.363281 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f2e98-f483-4d93-84bb-a7bb0fd07199 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:14.363843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f2e98-f483-4d93-84bb-a7bb0fd07199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:14.365929 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ab5f2e98-f483-4d93-84bb-a7bb0fd07199 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:14.381995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f2e98-f483-4d93-84bb-a7bb0fd07199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:14.382934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f2e98-f483-4d93-84bb-a7bb0fd07199 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:14.394596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1295/2608] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:41:16.760072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e92ed-2aa2-402f-9fc6-5d7c54b5ee0c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:16.760587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e92ed-2aa2-402f-9fc6-5d7c54b5ee0c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:16.760587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e92ed-2aa2-402f-9fc6-5d7c54b5ee0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:16.784224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ab5e92ed-2aa2-402f-9fc6-5d7c54b5ee0c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:41:16.785685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ab5e92ed-2aa2-402f-9fc6-5d7c54b5ee0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:16.794851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1314/2609] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Jul 20 19:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:41:16.821041 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f2e98-f483-4d93-84bb-a7bb0fd07199 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:16.836506 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f2e98-f483-4d93-84bb-a7bb0fd07199 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:16.843178 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bdb5a-3485-43b3-be21-b0a3e0d800a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:16.844110 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bdb5a-3485-43b3-be21-b0a3e0d800a2 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:16.844623 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bdb5a-3485-43b3-be21-b0a3e0d800a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:16.845001 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bdb5a-3485-43b3-be21-b0a3e0d800a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:16.856259 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bdb5a-3485-43b3-be21-b0a3e0d800a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:16.858494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bdb5a-3485-43b3-be21-b0a3e0d800a2 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:16.870211 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1296/2610] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:41:19.098923 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e92ed-2aa2-402f-9fc6-5d7c54b5ee0c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:19.113891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e92ed-2aa2-402f-9fc6-5d7c54b5ee0c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:19.120479 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997d38d-c239-44d3-92a7-21bf28fcdcde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:19.121574 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997d38d-c239-44d3-92a7-21bf28fcdcde service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:19.122019 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997d38d-c239-44d3-92a7-21bf28fcdcde service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:19.122451 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997d38d-c239-44d3-92a7-21bf28fcdcde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:19.124756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6997d38d-c239-44d3-92a7-21bf28fcdcde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:19.162494 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997d38d-c239-44d3-92a7-21bf28fcdcde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:19.165184 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997d38d-c239-44d3-92a7-21bf28fcdcde service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:19.192737 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1315/2611] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:41:20.131753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0a8be-151b-4020-960c-376a48969eff None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:20.132666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0a8be-151b-4020-960c-376a48969eff None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:20.132944 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0a8be-151b-4020-960c-376a48969eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:20.165127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-30b0a8be-151b-4020-960c-376a48969eff None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:41:20.167021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-30b0a8be-151b-4020-960c-376a48969eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:20.185822 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1297/2612] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Jul 20 19:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:41:20.205700 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997d38d-c239-44d3-92a7-21bf28fcdcde service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:20.219000 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997d38d-c239-44d3-92a7-21bf28fcdcde service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:20.229074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c765b-926c-448c-a113-a06b8a0434ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:20.230215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c765b-926c-448c-a113-a06b8a0434ac service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:20.230732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c765b-926c-448c-a113-a06b8a0434ac service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:20.231228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c765b-926c-448c-a113-a06b8a0434ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:20.243039 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c765b-926c-448c-a113-a06b8a0434ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:20.244981 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c765b-926c-448c-a113-a06b8a0434ac service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:20.259133 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1316/2613] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:41:30.156341 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:41:30.253083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=18 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:41:34.365496 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0a8be-151b-4020-960c-376a48969eff None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:34.377618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0a8be-151b-4020-960c-376a48969eff None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:34.381610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b6cf6-f1b5-4029-943b-44167972cce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:34.382264 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b6cf6-f1b5-4029-943b-44167972cce4 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:34.382543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b6cf6-f1b5-4029-943b-44167972cce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:34.382859 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b6cf6-f1b5-4029-943b-44167972cce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:34.403371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a46b6cf6-f1b5-4029-943b-44167972cce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:34.403371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b6cf6-f1b5-4029-943b-44167972cce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:34.403371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b6cf6-f1b5-4029-943b-44167972cce4 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:34.408147 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1298/2614] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:41:34.886306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0326d-fdbb-4a8c-9113-38f44402b911 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:34.886822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0326d-fdbb-4a8c-9113-38f44402b911 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:34.887029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0326d-fdbb-4a8c-9113-38f44402b911 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:34.888418 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1317/2615] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 20 19:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:41:34.894931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7425d-7146-4ec5-b85d-65677af6dcfb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:34.895254 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7425d-7146-4ec5-b85d-65677af6dcfb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:34.895531 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7425d-7146-4ec5-b85d-65677af6dcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:34.915051 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8aa7425d-7146-4ec5-b85d-65677af6dcfb None None] MFA Rules not processed for user `e3fd38ebb5514af686204d0b02a91edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:41:34.916236 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8aa7425d-7146-4ec5-b85d-65677af6dcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:34.926045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1299/2616] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 20 19:41:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:41:34.938249 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0326d-fdbb-4a8c-9113-38f44402b911 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:34.940087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-07e0326d-fdbb-4a8c-9113-38f44402b911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:34.999921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0326d-fdbb-4a8c-9113-38f44402b911 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:35.004226 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680a481-2a40-4f7d-b92d-41c11e0b285d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc7e1bc2eb943eba57a0009635de70d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:35.004879 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680a481-2a40-4f7d-b92d-41c11e0b285d service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:35.005162 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680a481-2a40-4f7d-b92d-41c11e0b285d service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:35.005444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680a481-2a40-4f7d-b92d-41c11e0b285d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:35.016203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680a481-2a40-4f7d-b92d-41c11e0b285d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:35.017645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680a481-2a40-4f7d-b92d-41c11e0b285d service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:35.028577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1318/2617] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:41:35.320418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3f970-d1fd-4c2d-bf28-91184ea3411a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:35.320418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3f970-d1fd-4c2d-bf28-91184ea3411a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:35.320418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3f970-d1fd-4c2d-bf28-91184ea3411a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:35.322858 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1300/2618] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 20 19:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:41:35.327432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae562a-4a3c-4a71-af60-b635fe4c486b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:35.327721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae562a-4a3c-4a71-af60-b635fe4c486b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:35.328066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae562a-4a3c-4a71-af60-b635fe4c486b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:35.349028 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-caae562a-4a3c-4a71-af60-b635fe4c486b None None] MFA Rules not processed for user `454b9259519c4332a8a36131c8273786`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:41:35.350254 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-caae562a-4a3c-4a71-af60-b635fe4c486b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:35.357515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1319/2619] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 20 19:41:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:41:35.370461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3f970-d1fd-4c2d-bf28-91184ea3411a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:35.382555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3f970-d1fd-4c2d-bf28-91184ea3411a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:35.386181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fb5f8-ddd5-4d13-b35d-be336d54ff90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:35.386843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fb5f8-ddd5-4d13-b35d-be336d54ff90 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:35.387119 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fb5f8-ddd5-4d13-b35d-be336d54ff90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:35.387393 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fb5f8-ddd5-4d13-b35d-be336d54ff90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:35.396528 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fb5f8-ddd5-4d13-b35d-be336d54ff90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:35.397972 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fb5f8-ddd5-4d13-b35d-be336d54ff90 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:35.407634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1301/2620] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:41:35.492757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e353bd2-564c-47b4-acbd-796ede21b94b None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:35.492991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e353bd2-564c-47b4-acbd-796ede21b94b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:35.493247 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e353bd2-564c-47b4-acbd-796ede21b94b None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:35.494758 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1320/2621] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jul 20 19:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:41:35.501427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7055514-0085-42ac-ae4e-646887954941 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:35.501722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7055514-0085-42ac-ae4e-646887954941 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:35.502036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7055514-0085-42ac-ae4e-646887954941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:35.521159 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f7055514-0085-42ac-ae4e-646887954941 None None] MFA Rules not processed for user `e3fd38ebb5514af686204d0b02a91edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:41:35.522377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f7055514-0085-42ac-ae4e-646887954941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:35.533661 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1302/2622] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jul 20 19:41:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:41:35.544609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e353bd2-564c-47b4-acbd-796ede21b94b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:35.556417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e353bd2-564c-47b4-acbd-796ede21b94b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:35.560097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ba280-98d8-43a9-9200-c25c98905574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:35.560737 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ba280-98d8-43a9-9200-c25c98905574 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:35.561016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ba280-98d8-43a9-9200-c25c98905574 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:35.561291 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ba280-98d8-43a9-9200-c25c98905574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:35.572514 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ba280-98d8-43a9-9200-c25c98905574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:35.573951 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ba280-98d8-43a9-9200-c25c98905574 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:35.585351 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1321/2623] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:41:38.313114 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a609a11-b572-4e7b-a482-b544fe50ea4e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:38.313886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a609a11-b572-4e7b-a482-b544fe50ea4e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:38.313886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a609a11-b572-4e7b-a482-b544fe50ea4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:38.333637 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7a609a11-b572-4e7b-a482-b544fe50ea4e None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:41:38.335041 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7a609a11-b572-4e7b-a482-b544fe50ea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:38.343165 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1303/2624] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jul 20 19:41:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:41:38.358880 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ba280-98d8-43a9-9200-c25c98905574 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:38.373113 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ba280-98d8-43a9-9200-c25c98905574 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:38.379664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b9843-9315-45c0-a61f-9c2695bb24dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:38.380315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b9843-9315-45c0-a61f-9c2695bb24dd service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:38.380595 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b9843-9315-45c0-a61f-9c2695bb24dd service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:38.380925 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b9843-9315-45c0-a61f-9c2695bb24dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:38.390610 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b9843-9315-45c0-a61f-9c2695bb24dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:38.394005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b9843-9315-45c0-a61f-9c2695bb24dd service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:38.403204 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1322/2625] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:41:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 19:41:38.623390 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be43f2-51fb-487b-b5cb-56db36692286 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:38.624061 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be43f2-51fb-487b-b5cb-56db36692286 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:38.624570 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be43f2-51fb-487b-b5cb-56db36692286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:38.650882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-09be43f2-51fb-487b-b5cb-56db36692286 None None] MFA Rules not processed for user `5119b339704e4c1c8852bc55c6ced730`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:41:38.652829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-09be43f2-51fb-487b-b5cb-56db36692286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:38.735821 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1304/2626] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:41:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:41:48.399549 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=41 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:41:48.726896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=46 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:41:53.556540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b9843-9315-45c0-a61f-9c2695bb24dd service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:53.569904 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b9843-9315-45c0-a61f-9c2695bb24dd service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:53.575873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749de5b7-4a01-4591-bfa6-522b81a52c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:53.576529 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749de5b7-4a01-4591-bfa6-522b81a52c98 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:53.576807 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749de5b7-4a01-4591-bfa6-522b81a52c98 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:53.577081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749de5b7-4a01-4591-bfa6-522b81a52c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:53.578900 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-749de5b7-4a01-4591-bfa6-522b81a52c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:53.592590 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749de5b7-4a01-4591-bfa6-522b81a52c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:53.594021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749de5b7-4a01-4591-bfa6-522b81a52c98 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:53.606611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1323/2627] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:41:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:41:55.594504 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd871bc7-ce2b-4196-a278-b7d4101969ef None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:55.595052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd871bc7-ce2b-4196-a278-b7d4101969ef None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:55.595140 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd871bc7-ce2b-4196-a278-b7d4101969ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:55.634470 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cd871bc7-ce2b-4196-a278-b7d4101969ef None None] MFA Rules not processed for user `391d83697b944e42b169e54535b7752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:41:55.635715 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cd871bc7-ce2b-4196-a278-b7d4101969ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:41:55.665295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1305/2628] 10.222.0.16 () {58 vars in 967 bytes} [Wed Jul 20 19:41:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:41:55.678080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749de5b7-4a01-4591-bfa6-522b81a52c98 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:41:55.728205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749de5b7-4a01-4591-bfa6-522b81a52c98 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:41:55.733953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe24682-cd98-486a-81bb-b32c86915742 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde62f4ce7af42eca1fe5a7b6807d1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:41:55.734653 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe24682-cd98-486a-81bb-b32c86915742 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:41:55.734942 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe24682-cd98-486a-81bb-b32c86915742 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:41:55.735218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe24682-cd98-486a-81bb-b32c86915742 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:41:55.744155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe24682-cd98-486a-81bb-b32c86915742 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:41:55.745837 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe24682-cd98-486a-81bb-b32c86915742 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:41:55.754434 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1324/2629] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jul 20 19:41:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:42:04.251798 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdeed4-19ee-4114-9b1e-050d5424694e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:04.252416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdeed4-19ee-4114-9b1e-050d5424694e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:04.252416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdeed4-19ee-4114-9b1e-050d5424694e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:04.274014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8bbdeed4-19ee-4114-9b1e-050d5424694e None None] MFA Rules not processed for user `666264f8aacb43589d17a158048c4a43`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:42:04.275278 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8bbdeed4-19ee-4114-9b1e-050d5424694e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:04.282690 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1306/2630] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:42:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:42:04.927688 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742f15a-5431-49ca-836e-288ce53fd989 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:04.929088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742f15a-5431-49ca-836e-288ce53fd989 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:04.929088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742f15a-5431-49ca-836e-288ce53fd989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:05.003489 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7742f15a-5431-49ca-836e-288ce53fd989 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:42:05.004845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7742f15a-5431-49ca-836e-288ce53fd989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:05.039916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1325/2631] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Jul 20 19:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:42:05.060010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdeed4-19ee-4114-9b1e-050d5424694e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:05.075542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdeed4-19ee-4114-9b1e-050d5424694e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:05.082308 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9845241-0811-4477-89e4-7db2f366574f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:05.086894 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9845241-0811-4477-89e4-7db2f366574f service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:05.086894 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9845241-0811-4477-89e4-7db2f366574f service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:05.086894 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9845241-0811-4477-89e4-7db2f366574f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:05.093596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9845241-0811-4477-89e4-7db2f366574f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:05.095084 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9845241-0811-4477-89e4-7db2f366574f service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:05.112394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1307/2632] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:42:08.405315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eac72d-b3ec-4d55-b7ce-8346270814b9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:08.406291 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eac72d-b3ec-4d55-b7ce-8346270814b9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:08.406797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eac72d-b3ec-4d55-b7ce-8346270814b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:08.429247 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-19eac72d-b3ec-4d55-b7ce-8346270814b9 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:42:08.430315 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-19eac72d-b3ec-4d55-b7ce-8346270814b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:08.439196 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1326/2633] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Jul 20 19:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:42:08.460468 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9845241-0811-4477-89e4-7db2f366574f service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:08.471925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9845241-0811-4477-89e4-7db2f366574f service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:08.477618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec699cf0-2521-4678-ac15-a23204d12252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:08.478338 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec699cf0-2521-4678-ac15-a23204d12252 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:08.478707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec699cf0-2521-4678-ac15-a23204d12252 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:08.479205 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec699cf0-2521-4678-ac15-a23204d12252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:08.488101 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec699cf0-2521-4678-ac15-a23204d12252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:08.489761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec699cf0-2521-4678-ac15-a23204d12252 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:08.501125 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1308/2634] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:42:11.183048 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35576d7d-4632-44df-a4b6-dbaa66061ca2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:11.183633 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35576d7d-4632-44df-a4b6-dbaa66061ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:11.183633 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35576d7d-4632-44df-a4b6-dbaa66061ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:11.207646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-35576d7d-4632-44df-a4b6-dbaa66061ca2 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:42:11.208860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-35576d7d-4632-44df-a4b6-dbaa66061ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:11.217866 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1327/2635] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Jul 20 19:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:42:11.240775 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec699cf0-2521-4678-ac15-a23204d12252 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:11.252743 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec699cf0-2521-4678-ac15-a23204d12252 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:11.259252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e1d03-bac3-4b7f-ac75-121103a9efb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:11.259926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e1d03-bac3-4b7f-ac75-121103a9efb9 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:11.260214 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e1d03-bac3-4b7f-ac75-121103a9efb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:11.260494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e1d03-bac3-4b7f-ac75-121103a9efb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:11.269258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e1d03-bac3-4b7f-ac75-121103a9efb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:11.270918 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e1d03-bac3-4b7f-ac75-121103a9efb9 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:11.281930 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1309/2636] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:42:15.460796 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e665d-728c-46ab-9d83-cb4ddcb011ce None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:15.461395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e665d-728c-46ab-9d83-cb4ddcb011ce None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:15.461395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e665d-728c-46ab-9d83-cb4ddcb011ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:15.480946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-375e665d-728c-46ab-9d83-cb4ddcb011ce None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:42:15.482157 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-375e665d-728c-46ab-9d83-cb4ddcb011ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:15.492464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1328/2637] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Jul 20 19:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:42:15.515390 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e1d03-bac3-4b7f-ac75-121103a9efb9 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:15.529566 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e1d03-bac3-4b7f-ac75-121103a9efb9 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:15.536326 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dce9aa-5749-4400-9557-0c6f8b5ad104 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:15.537083 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce9aa-5749-4400-9557-0c6f8b5ad104 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:15.537364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce9aa-5749-4400-9557-0c6f8b5ad104 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:15.537676 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce9aa-5749-4400-9557-0c6f8b5ad104 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:15.551008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dce9aa-5749-4400-9557-0c6f8b5ad104 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:15.552784 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dce9aa-5749-4400-9557-0c6f8b5ad104 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:15.566315 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1310/2638] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:42:18.693371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc71eb4-8fa2-435c-bcf3-afda16641f32 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:18.693924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc71eb4-8fa2-435c-bcf3-afda16641f32 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:18.693924 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc71eb4-8fa2-435c-bcf3-afda16641f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:18.701295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=66 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:18.713668 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0fc71eb4-8fa2-435c-bcf3-afda16641f32 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:42:18.714898 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0fc71eb4-8fa2-435c-bcf3-afda16641f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:18.722959 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1329/2639] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Jul 20 19:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:42:18.747450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dce9aa-5749-4400-9557-0c6f8b5ad104 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:18.759502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dce9aa-5749-4400-9557-0c6f8b5ad104 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:18.765221 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f66be-02f1-4893-b173-467eb82b66b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:18.765861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f66be-02f1-4893-b173-467eb82b66b4 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:18.766143 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f66be-02f1-4893-b173-467eb82b66b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:18.766416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f66be-02f1-4893-b173-467eb82b66b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:18.775761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f66be-02f1-4893-b173-467eb82b66b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:18.777357 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f66be-02f1-4893-b173-467eb82b66b4 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:18.781310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=52 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:18.787398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1311/2640] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:42:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:42:28.731046 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:28.812329 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:44.214735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc71eb4-8fa2-435c-bcf3-afda16641f32 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:44.234996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc71eb4-8fa2-435c-bcf3-afda16641f32 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:44.238621 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48583da0-1b8f-4c20-b348-78b73a1da616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:44.239288 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48583da0-1b8f-4c20-b348-78b73a1da616 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:44.239566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48583da0-1b8f-4c20-b348-78b73a1da616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:44.239835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48583da0-1b8f-4c20-b348-78b73a1da616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:44.241636 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-48583da0-1b8f-4c20-b348-78b73a1da616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:44.256116 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48583da0-1b8f-4c20-b348-78b73a1da616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:44.257552 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48583da0-1b8f-4c20-b348-78b73a1da616 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:44.271531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1330/2641] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:42:47.927569 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f66be-02f1-4893-b173-467eb82b66b4 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:47.929266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3b2f66be-02f1-4893-b173-467eb82b66b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:47.946269 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f66be-02f1-4893-b173-467eb82b66b4 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:47.952671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f115cc-b8f6-468a-a0c6-a3182c54a690 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc616ed904d43d2b160b8d2766f7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:47.953335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f115cc-b8f6-468a-a0c6-a3182c54a690 service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:47.953617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f115cc-b8f6-468a-a0c6-a3182c54a690 service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:47.953887 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f115cc-b8f6-468a-a0c6-a3182c54a690 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:47.956234 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-15f115cc-b8f6-468a-a0c6-a3182c54a690 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:47.975883 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f115cc-b8f6-468a-a0c6-a3182c54a690 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:47.977547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f115cc-b8f6-468a-a0c6-a3182c54a690 service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:47.988238 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1312/2642] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:42:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:42:48.049254 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48583da0-1b8f-4c20-b348-78b73a1da616 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:48.050903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-48583da0-1b8f-4c20-b348-78b73a1da616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:48.064181 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48583da0-1b8f-4c20-b348-78b73a1da616 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:48.069037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b6648-56d3-4ff3-b574-d7502d0f7546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:48.069902 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b6648-56d3-4ff3-b574-d7502d0f7546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:48.070180 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b6648-56d3-4ff3-b574-d7502d0f7546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:48.070449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b6648-56d3-4ff3-b574-d7502d0f7546 admin admin] PATH_INFO: `/v3/users/27e9d71846d840c4899ab2cbcd773a97` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:48.071754 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b6648-56d3-4ff3-b574-d7502d0f7546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e9d71846d840c4899ab2cbcd773a97)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:48.073895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b6648-56d3-4ff3-b574-d7502d0f7546 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:48.360268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-eb1b6648-56d3-4ff3-b574-d7502d0f7546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e9d71846d840c4899ab2cbcd773a97'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:48.449628 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-eb1b6648-56d3-4ff3-b574-d7502d0f7546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e9d71846d840c4899ab2cbcd773a97'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:48.450206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-eb1b6648-56d3-4ff3-b574-d7502d0f7546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e9d71846d840c4899ab2cbcd773a97'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:48.465332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-eb1b6648-56d3-4ff3-b574-d7502d0f7546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e9d71846d840c4899ab2cbcd773a97'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:48.473121 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-eb1b6648-56d3-4ff3-b574-d7502d0f7546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e9d71846d840c4899ab2cbcd773a97'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:48.481237 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1331/2643] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:42:48 2022] DELETE /identity/v3/users/27e9d71846d840c4899ab2cbcd773a97 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:42:48.730356 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f115cc-b8f6-468a-a0c6-a3182c54a690 service placement] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:48.741071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f115cc-b8f6-468a-a0c6-a3182c54a690 service placement] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:48.810428 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a163738-3d9a-44c1-9cf5-d2a1afc970b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:48.811401 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a163738-3d9a-44c1-9cf5-d2a1afc970b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:48.811677 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a163738-3d9a-44c1-9cf5-d2a1afc970b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:48.811983 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a163738-3d9a-44c1-9cf5-d2a1afc970b3 admin admin] PATH_INFO: `/v3/projects/082a80b84f274a458cbb823a6f87b131` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:48.813149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a163738-3d9a-44c1-9cf5-d2a1afc970b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=082a80b84f274a458cbb823a6f87b131)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:48.815116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a163738-3d9a-44c1-9cf5-d2a1afc970b3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:48.928629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a163738-3d9a-44c1-9cf5-d2a1afc970b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082a80b84f274a458cbb823a6f87b131', 'request_id': 'req-5a163738-3d9a-44c1-9cf5-d2a1afc970b3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:48.935505 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a163738-3d9a-44c1-9cf5-d2a1afc970b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082a80b84f274a458cbb823a6f87b131', 'request_id': 'req-5a163738-3d9a-44c1-9cf5-d2a1afc970b3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:48.985822 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a163738-3d9a-44c1-9cf5-d2a1afc970b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082a80b84f274a458cbb823a6f87b131', 'request_id': 'req-5a163738-3d9a-44c1-9cf5-d2a1afc970b3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:48.997197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a163738-3d9a-44c1-9cf5-d2a1afc970b3 admin admin] The token cache is being invalidate because project 082a80b84f274a458cbb823a6f87b131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:42:48.998107 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a163738-3d9a-44c1-9cf5-d2a1afc970b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:48.998231 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5a163738-3d9a-44c1-9cf5-d2a1afc970b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:48.999960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1313/2644] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:42:48 2022] DELETE /identity/v3/projects/082a80b84f274a458cbb823a6f87b131 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:42:49.005238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174198f1-3a2c-44ee-b62e-845c482a2a6a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:49.005526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174198f1-3a2c-44ee-b62e-845c482a2a6a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:49.005892 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174198f1-3a2c-44ee-b62e-845c482a2a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:49.025986 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-174198f1-3a2c-44ee-b62e-845c482a2a6a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:42:49.027350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-174198f1-3a2c-44ee-b62e-845c482a2a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:49.092061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1332/2645] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:42:49.099931 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f300e4-bda5-4109-b4cf-c75c992ecd3a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:49.100215 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f300e4-bda5-4109-b4cf-c75c992ecd3a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:49.100489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f300e4-bda5-4109-b4cf-c75c992ecd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:49.120194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-45f300e4-bda5-4109-b4cf-c75c992ecd3a None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:42:49.121425 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-45f300e4-bda5-4109-b4cf-c75c992ecd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:49.129652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1314/2646] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:42:49.134065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174198f1-3a2c-44ee-b62e-845c482a2a6a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:49.145256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174198f1-3a2c-44ee-b62e-845c482a2a6a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:49.149883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252042c-c97f-46a1-9d91-a476bc292bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:49.150789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252042c-c97f-46a1-9d91-a476bc292bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:49.151076 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252042c-c97f-46a1-9d91-a476bc292bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:49.151350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252042c-c97f-46a1-9d91-a476bc292bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:49.152080 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252042c-c97f-46a1-9d91-a476bc292bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:42:49.152439 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252042c-c97f-46a1-9d91-a476bc292bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:49.154097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252042c-c97f-46a1-9d91-a476bc292bf5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:49.170005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1333/2647] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:42:49.171094 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f300e4-bda5-4109-b4cf-c75c992ecd3a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:49.180497 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f300e4-bda5-4109-b4cf-c75c992ecd3a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:49.186071 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0e096-562a-4962-bbd4-781f505ab17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:49.186761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0e096-562a-4962-bbd4-781f505ab17e admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:49.187050 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0e096-562a-4962-bbd4-781f505ab17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:49.187347 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0e096-562a-4962-bbd4-781f505ab17e admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:49.188082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0e096-562a-4962-bbd4-781f505ab17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:49.190117 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0e096-562a-4962-bbd4-781f505ab17e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:49.297134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1315/2648] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:42:49 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:42:49.301473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252042c-c97f-46a1-9d91-a476bc292bf5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:49.313236 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252042c-c97f-46a1-9d91-a476bc292bf5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:49.353053 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:49.385600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b56424-e85e-4ad1-9bf6-89d405422e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:49.386560 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b56424-e85e-4ad1-9bf6-89d405422e78 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:49.387166 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b56424-e85e-4ad1-9bf6-89d405422e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:49.387503 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b56424-e85e-4ad1-9bf6-89d405422e78 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:49.387926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b56424-e85e-4ad1-9bf6-89d405422e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:49.389961 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b56424-e85e-4ad1-9bf6-89d405422e78 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:49.502308 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1334/2649] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:42:49 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:42:49.506514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0e096-562a-4962-bbd4-781f505ab17e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:49.518713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0e096-562a-4962-bbd4-781f505ab17e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:49.524080 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a97a8-defc-4586-8704-c4ba25d1c730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:49.524772 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a97a8-defc-4586-8704-c4ba25d1c730 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:49.525050 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a97a8-defc-4586-8704-c4ba25d1c730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:49.525323 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a97a8-defc-4586-8704-c4ba25d1c730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:49.526197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a97a8-defc-4586-8704-c4ba25d1c730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:49.527982 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a97a8-defc-4586-8704-c4ba25d1c730 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:49.540019 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1316/2650] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:42:49.544444 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b56424-e85e-4ad1-9bf6-89d405422e78 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:49.554897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b56424-e85e-4ad1-9bf6-89d405422e78 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:49.560209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5c0cf-42e3-418b-a7ac-0fd7e0d6b429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:49.560895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5c0cf-42e3-418b-a7ac-0fd7e0d6b429 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:49.561341 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5c0cf-42e3-418b-a7ac-0fd7e0d6b429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:49.561619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5c0cf-42e3-418b-a7ac-0fd7e0d6b429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:49.562353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5c0cf-42e3-418b-a7ac-0fd7e0d6b429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:49.564007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5c0cf-42e3-418b-a7ac-0fd7e0d6b429 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:49.575613 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1335/2651] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:42:49.580037 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a97a8-defc-4586-8704-c4ba25d1c730 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:49.590509 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a97a8-defc-4586-8704-c4ba25d1c730 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:49.595254 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bff31f-0124-445c-89c3-4477ab9d0c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:49.599402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bff31f-0124-445c-89c3-4477ab9d0c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:49.599402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bff31f-0124-445c-89c3-4477ab9d0c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:49.599402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bff31f-0124-445c-89c3-4477ab9d0c48 admin admin] PATH_INFO: `/v3/projects/9211b1008bf44eadbeb1dafeaf423784/users/aa8989cc123649c9ae39499036eadd31/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:49.612091 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bff31f-0124-445c-89c3-4477ab9d0c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9211b1008bf44eadbeb1dafeaf423784, user_id=aa8989cc123649c9ae39499036eadd31, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:49.614799 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bff31f-0124-445c-89c3-4477ab9d0c48 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:49.723564 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1317/2652] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:42:49 2022] PUT /identity/v3/projects/9211b1008bf44eadbeb1dafeaf423784/users/aa8989cc123649c9ae39499036eadd31/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:42:49.729203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21150f-897b-44a5-8c3b-834e1977226d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:49.729910 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21150f-897b-44a5-8c3b-834e1977226d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:49.730443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21150f-897b-44a5-8c3b-834e1977226d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:49.749867 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8c21150f-897b-44a5-8c3b-834e1977226d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:42:49.751454 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8c21150f-897b-44a5-8c3b-834e1977226d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:49.815600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1336/2653] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:42:49.825880 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bff31f-0124-445c-89c3-4477ab9d0c48 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:49.830924 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d0bff31f-0124-445c-89c3-4477ab9d0c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:49.833265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:49.897608 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bff31f-0124-445c-89c3-4477ab9d0c48 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:49.901414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd945af-bd66-46f8-b410-27b3ca7cfec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:49.902058 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd945af-bd66-46f8-b410-27b3ca7cfec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:49.902345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd945af-bd66-46f8-b410-27b3ca7cfec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:49.902620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd945af-bd66-46f8-b410-27b3ca7cfec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:49.911843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd945af-bd66-46f8-b410-27b3ca7cfec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:49.913283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd945af-bd66-46f8-b410-27b3ca7cfec0 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:49.923345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1318/2654] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:42:53.032243 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21150f-897b-44a5-8c3b-834e1977226d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:53.034068 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8c21150f-897b-44a5-8c3b-834e1977226d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:53.050499 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21150f-897b-44a5-8c3b-834e1977226d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:53.057498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c449ad-b6cc-488e-8d2c-b036695995a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:53.058399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c449ad-b6cc-488e-8d2c-b036695995a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:53.058756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c449ad-b6cc-488e-8d2c-b036695995a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:53.059026 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c449ad-b6cc-488e-8d2c-b036695995a8 admin admin] PATH_INFO: `/v3/users/5119b339704e4c1c8852bc55c6ced730` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:53.060250 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c449ad-b6cc-488e-8d2c-b036695995a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5119b339704e4c1c8852bc55c6ced730)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:53.062834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c449ad-b6cc-488e-8d2c-b036695995a8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:53.245005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b6c449ad-b6cc-488e-8d2c-b036695995a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5119b339704e4c1c8852bc55c6ced730'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:53.311834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b6c449ad-b6cc-488e-8d2c-b036695995a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5119b339704e4c1c8852bc55c6ced730'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:53.312486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b6c449ad-b6cc-488e-8d2c-b036695995a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5119b339704e4c1c8852bc55c6ced730'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:53.333123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b6c449ad-b6cc-488e-8d2c-b036695995a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5119b339704e4c1c8852bc55c6ced730'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:53.341874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b6c449ad-b6cc-488e-8d2c-b036695995a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5119b339704e4c1c8852bc55c6ced730'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:53.348538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1337/2655] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:42:53 2022] DELETE /identity/v3/users/5119b339704e4c1c8852bc55c6ced730 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:42:53.663738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd945af-bd66-46f8-b410-27b3ca7cfec0 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:53.680981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd945af-bd66-46f8-b410-27b3ca7cfec0 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:53.809348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:53.810243 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:53.810555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:53.810830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5 admin admin] PATH_INFO: `/v3/projects/25200bb2076b42f68148ef1e1d38ac85` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:53.812240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25200bb2076b42f68148ef1e1d38ac85)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:53.814274 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:53.988005 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25200bb2076b42f68148ef1e1d38ac85', 'request_id': 'req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:54.000584 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25200bb2076b42f68148ef1e1d38ac85', 'request_id': 'req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:54.130031 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25200bb2076b42f68148ef1e1d38ac85', 'request_id': 'req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:54.149916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5 admin admin] The token cache is being invalidate because project 25200bb2076b42f68148ef1e1d38ac85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:42:54.150313 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:54.151892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:42:54.153933 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1319/2656] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:42:53 2022] DELETE /identity/v3/projects/25200bb2076b42f68148ef1e1d38ac85 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:42:56.320659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331be6c-bbfe-4993-9b89-4bb4e66604e8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:56.321112 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331be6c-bbfe-4993-9b89-4bb4e66604e8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:56.321245 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331be6c-bbfe-4993-9b89-4bb4e66604e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:56.349892 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8331be6c-bbfe-4993-9b89-4bb4e66604e8 None None] MFA Rules not processed for user `aa8989cc123649c9ae39499036eadd31`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:42:56.351328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8331be6c-bbfe-4993-9b89-4bb4e66604e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:56.371252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:56.423627 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1338/2657] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:42:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:42:56.440520 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:42:56.442252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:56.481275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:56.535070 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cea491-b7e9-4b0f-aebc-34e15c30e0e5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:42:56.540871 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f7866-914a-48ac-980b-bfe15e2c77c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:42:56.542111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f7866-914a-48ac-980b-bfe15e2c77c2 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:56.542389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f7866-914a-48ac-980b-bfe15e2c77c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:56.542797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f7866-914a-48ac-980b-bfe15e2c77c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:56.551663 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f7866-914a-48ac-980b-bfe15e2c77c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:42:56.553489 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f7866-914a-48ac-980b-bfe15e2c77c2 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:42:56.564522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1320/2658] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:42:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:42:59.266720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432370ac-fc00-4da3-8627-f4751acc5933 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:42:59.267256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432370ac-fc00-4da3-8627-f4751acc5933 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:42:59.267738 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432370ac-fc00-4da3-8627-f4751acc5933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:42:59.290082 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-432370ac-fc00-4da3-8627-f4751acc5933 None None] MFA Rules not processed for user `aa8989cc123649c9ae39499036eadd31`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:42:59.292697 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-432370ac-fc00-4da3-8627-f4751acc5933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:42:59.301325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1339/2659] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:42:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:43:06.705630 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=22 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:43:09.282542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=22 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:43:13.713480 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e82b62-a20c-420c-aba0-f3e3774d240c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:43:13.713978 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e82b62-a20c-420c-aba0-f3e3774d240c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:43:13.718838 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e82b62-a20c-420c-aba0-f3e3774d240c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:43:13.732128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-07e82b62-a20c-420c-aba0-f3e3774d240c None None] MFA Rules not processed for user `666264f8aacb43589d17a158048c4a43`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:43:13.733321 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-07e82b62-a20c-420c-aba0-f3e3774d240c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:43:13.790587 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1321/2660] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:43:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:43:23.784092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=25 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:44:22.826415 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b09a5-d031-4b92-86ca-87b18cfb61de None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:44:22.827015 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b09a5-d031-4b92-86ca-87b18cfb61de None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:44:22.827251 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b09a5-d031-4b92-86ca-87b18cfb61de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:44:22.847999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-564b09a5-d031-4b92-86ca-87b18cfb61de None None] MFA Rules not processed for user `666264f8aacb43589d17a158048c4a43`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:44:22.850086 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-564b09a5-d031-4b92-86ca-87b18cfb61de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:44:22.858554 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1340/2661] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:44:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:44:32.841493 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:44:56.533941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e82b62-a20c-420c-aba0-f3e3774d240c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:44:56.535377 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-07e82b62-a20c-420c-aba0-f3e3774d240c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:44:56.632959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e82b62-a20c-420c-aba0-f3e3774d240c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:44:56.638309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dc261-552f-43cd-a067-2cc6caaa1fab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc616ed904d43d2b160b8d2766f7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:44:56.638988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dc261-552f-43cd-a067-2cc6caaa1fab service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:44:56.639273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dc261-552f-43cd-a067-2cc6caaa1fab service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:44:56.639548 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dc261-552f-43cd-a067-2cc6caaa1fab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:44:56.641451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7d4dc261-552f-43cd-a067-2cc6caaa1fab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:44:56.657981 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dc261-552f-43cd-a067-2cc6caaa1fab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:44:56.659771 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dc261-552f-43cd-a067-2cc6caaa1fab service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:44:56.671132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1322/2662] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:44:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:45:06.666861 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=41 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:34.405919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b09a5-d031-4b92-86ca-87b18cfb61de None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:34.421592 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b09a5-d031-4b92-86ca-87b18cfb61de None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:34.428405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1573c-4b8a-42c1-a535-04c4364b5636 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc616ed904d43d2b160b8d2766f7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:34.429261 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1573c-4b8a-42c1-a535-04c4364b5636 service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:34.429710 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1573c-4b8a-42c1-a535-04c4364b5636 service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:34.430147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1573c-4b8a-42c1-a535-04c4364b5636 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:34.432180 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-deb1573c-4b8a-42c1-a535-04c4364b5636 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:34.450407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1573c-4b8a-42c1-a535-04c4364b5636 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:34.452184 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1573c-4b8a-42c1-a535-04c4364b5636 service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:34.466180 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1341/2663] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:45:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:45:34.553425 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dc261-552f-43cd-a067-2cc6caaa1fab service placement] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:34.555725 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7d4dc261-552f-43cd-a067-2cc6caaa1fab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:34.631514 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dc261-552f-43cd-a067-2cc6caaa1fab service placement] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:34.636064 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9053c-9fac-4dea-990f-1dce5564045b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:34.637116 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9053c-9fac-4dea-990f-1dce5564045b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:34.637388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9053c-9fac-4dea-990f-1dce5564045b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:34.639407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9053c-9fac-4dea-990f-1dce5564045b admin admin] PATH_INFO: `/v3/users/666264f8aacb43589d17a158048c4a43` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:34.639407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9053c-9fac-4dea-990f-1dce5564045b admin admin] RBAC: Authorizing `identity:delete_user(user_id=666264f8aacb43589d17a158048c4a43)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:34.641109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9053c-9fac-4dea-990f-1dce5564045b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:34.841534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03b9053c-9fac-4dea-990f-1dce5564045b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666264f8aacb43589d17a158048c4a43'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:34.923462 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03b9053c-9fac-4dea-990f-1dce5564045b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666264f8aacb43589d17a158048c4a43'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:34.933003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03b9053c-9fac-4dea-990f-1dce5564045b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666264f8aacb43589d17a158048c4a43'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:34.947055 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03b9053c-9fac-4dea-990f-1dce5564045b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666264f8aacb43589d17a158048c4a43'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:34.947813 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03b9053c-9fac-4dea-990f-1dce5564045b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666264f8aacb43589d17a158048c4a43'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:34.954158 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1323/2664] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:45:34 2022] DELETE /identity/v3/users/666264f8aacb43589d17a158048c4a43 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:35.227512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1573c-4b8a-42c1-a535-04c4364b5636 service placement] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:35.245252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1573c-4b8a-42c1-a535-04c4364b5636 service placement] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:35.320611 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698164b0-6d55-41b5-9059-9e5608985319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:35.321512 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698164b0-6d55-41b5-9059-9e5608985319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:35.321870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698164b0-6d55-41b5-9059-9e5608985319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:35.322051 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698164b0-6d55-41b5-9059-9e5608985319 admin admin] PATH_INFO: `/v3/projects/de892f126d9b4cb9984cbecdd84f6681` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:35.323275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698164b0-6d55-41b5-9059-9e5608985319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de892f126d9b4cb9984cbecdd84f6681)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:35.325337 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698164b0-6d55-41b5-9059-9e5608985319 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:35.444827 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-698164b0-6d55-41b5-9059-9e5608985319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de892f126d9b4cb9984cbecdd84f6681', 'request_id': 'req-698164b0-6d55-41b5-9059-9e5608985319'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:35.531743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-698164b0-6d55-41b5-9059-9e5608985319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de892f126d9b4cb9984cbecdd84f6681', 'request_id': 'req-698164b0-6d55-41b5-9059-9e5608985319'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:35.540072 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-698164b0-6d55-41b5-9059-9e5608985319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de892f126d9b4cb9984cbecdd84f6681', 'request_id': 'req-698164b0-6d55-41b5-9059-9e5608985319'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:35.553417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-698164b0-6d55-41b5-9059-9e5608985319 admin admin] The token cache is being invalidate because project de892f126d9b4cb9984cbecdd84f6681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:45:35.553921 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-698164b0-6d55-41b5-9059-9e5608985319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:35.554899 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-698164b0-6d55-41b5-9059-9e5608985319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:35.556476 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1342/2665] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:45:35 2022] DELETE /identity/v3/projects/de892f126d9b4cb9984cbecdd84f6681 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:35.561645 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548095c4-5edb-4418-8037-4bdfdbe9c7f9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:35.562197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548095c4-5edb-4418-8037-4bdfdbe9c7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:35.562197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548095c4-5edb-4418-8037-4bdfdbe9c7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:35.589826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-548095c4-5edb-4418-8037-4bdfdbe9c7f9 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:35.591739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-548095c4-5edb-4418-8037-4bdfdbe9c7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:35.658114 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1324/2666] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:35.666911 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abd395-bb8d-4f72-a327-9ef8bd7d8bb6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:35.667195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abd395-bb8d-4f72-a327-9ef8bd7d8bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:35.667470 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abd395-bb8d-4f72-a327-9ef8bd7d8bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:35.687926 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-38abd395-bb8d-4f72-a327-9ef8bd7d8bb6 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:35.689144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-38abd395-bb8d-4f72-a327-9ef8bd7d8bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:35.698131 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1343/2667] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:35.702649 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548095c4-5edb-4418-8037-4bdfdbe9c7f9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:35.713655 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548095c4-5edb-4418-8037-4bdfdbe9c7f9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:35.718762 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e283116-fce8-4f8b-b616-e2bbebba4d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:35.719427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e283116-fce8-4f8b-b616-e2bbebba4d4a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:35.719705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e283116-fce8-4f8b-b616-e2bbebba4d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:35.719971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e283116-fce8-4f8b-b616-e2bbebba4d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:35.720706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e283116-fce8-4f8b-b616-e2bbebba4d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:45:35.721006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e283116-fce8-4f8b-b616-e2bbebba4d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:35.723386 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e283116-fce8-4f8b-b616-e2bbebba4d4a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:35.736097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1325/2668] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:45:35.741734 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abd395-bb8d-4f72-a327-9ef8bd7d8bb6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:35.751382 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abd395-bb8d-4f72-a327-9ef8bd7d8bb6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:35.757109 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48de613-8e90-4d3c-a849-b90883a81083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:35.757842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48de613-8e90-4d3c-a849-b90883a81083 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:35.758125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48de613-8e90-4d3c-a849-b90883a81083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:35.758400 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48de613-8e90-4d3c-a849-b90883a81083 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:35.759138 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48de613-8e90-4d3c-a849-b90883a81083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:35.761089 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48de613-8e90-4d3c-a849-b90883a81083 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:35.851035 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1344/2669] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:45:35 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:45:35.855696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e283116-fce8-4f8b-b616-e2bbebba4d4a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:35.867018 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e283116-fce8-4f8b-b616-e2bbebba4d4a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:35.870829 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:35.930529 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798e7ab-7cc9-4aa3-9bb2-8d912a66af90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:35.931325 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798e7ab-7cc9-4aa3-9bb2-8d912a66af90 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:35.931603 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798e7ab-7cc9-4aa3-9bb2-8d912a66af90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:35.931874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798e7ab-7cc9-4aa3-9bb2-8d912a66af90 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:35.932579 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798e7ab-7cc9-4aa3-9bb2-8d912a66af90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:35.934492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798e7ab-7cc9-4aa3-9bb2-8d912a66af90 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:36.040915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1326/2670] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:45:35 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:45:36.045669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48de613-8e90-4d3c-a849-b90883a81083 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:36.058492 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48de613-8e90-4d3c-a849-b90883a81083 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:36.063261 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc4ab-ca1d-4bc4-8761-a5e98c990ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:36.063939 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc4ab-ca1d-4bc4-8761-a5e98c990ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:36.064218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc4ab-ca1d-4bc4-8761-a5e98c990ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:36.065322 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc4ab-ca1d-4bc4-8761-a5e98c990ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:36.065938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533dc4ab-ca1d-4bc4-8761-a5e98c990ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:36.067708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533dc4ab-ca1d-4bc4-8761-a5e98c990ea5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:36.079603 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1345/2671] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:45:36.089075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798e7ab-7cc9-4aa3-9bb2-8d912a66af90 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:36.100359 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798e7ab-7cc9-4aa3-9bb2-8d912a66af90 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:36.105923 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79564b-5c54-4451-8148-05606038249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:36.106590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79564b-5c54-4451-8148-05606038249c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:36.106994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79564b-5c54-4451-8148-05606038249c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:36.107310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79564b-5c54-4451-8148-05606038249c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:36.108100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79564b-5c54-4451-8148-05606038249c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:36.109815 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79564b-5c54-4451-8148-05606038249c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:36.121461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1327/2672] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:45:36.125772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc4ab-ca1d-4bc4-8761-a5e98c990ea5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:36.137245 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc4ab-ca1d-4bc4-8761-a5e98c990ea5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:36.142496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5e143-718e-4e75-80d7-57d91e3cc5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:36.143468 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5e143-718e-4e75-80d7-57d91e3cc5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:36.143893 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5e143-718e-4e75-80d7-57d91e3cc5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:36.144172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5e143-718e-4e75-80d7-57d91e3cc5b5 admin admin] PATH_INFO: `/v3/projects/a748a74ea30048ab947f9d2ccbc07682/users/0768c17af07a414c96d1c47a121f4e3b/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:36.160630 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5e143-718e-4e75-80d7-57d91e3cc5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a748a74ea30048ab947f9d2ccbc07682, user_id=0768c17af07a414c96d1c47a121f4e3b, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:36.163350 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5e143-718e-4e75-80d7-57d91e3cc5b5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:36.246781 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1346/2673] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:45:36 2022] PUT /identity/v3/projects/a748a74ea30048ab947f9d2ccbc07682/users/0768c17af07a414c96d1c47a121f4e3b/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:36.257610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95520f-8f01-421f-83bf-8bde3773669f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:36.257955 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95520f-8f01-421f-83bf-8bde3773669f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:36.258258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95520f-8f01-421f-83bf-8bde3773669f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:36.289024 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ad95520f-8f01-421f-83bf-8bde3773669f None None] MFA Rules not processed for user `0768c17af07a414c96d1c47a121f4e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:36.290332 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ad95520f-8f01-421f-83bf-8bde3773669f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:36.358643 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1328/2674] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:36.363435 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5e143-718e-4e75-80d7-57d91e3cc5b5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:36.378177 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:36.449529 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5e143-718e-4e75-80d7-57d91e3cc5b5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:36.457174 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434fbe3-dd81-4b88-b824-256d9959b834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:36.458159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434fbe3-dd81-4b88-b824-256d9959b834 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:36.458577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434fbe3-dd81-4b88-b824-256d9959b834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:36.459021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434fbe3-dd81-4b88-b824-256d9959b834 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:36.460130 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434fbe3-dd81-4b88-b824-256d9959b834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:36.463266 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434fbe3-dd81-4b88-b824-256d9959b834 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:36.541244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1347/2675] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:45:36 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:45:36.545195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95520f-8f01-421f-83bf-8bde3773669f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:36.556428 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95520f-8f01-421f-83bf-8bde3773669f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:36.617085 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869be2f5-180d-4836-bcfd-f2bcb3343099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:36.617941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869be2f5-180d-4836-bcfd-f2bcb3343099 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:36.618075 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869be2f5-180d-4836-bcfd-f2bcb3343099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:36.618316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869be2f5-180d-4836-bcfd-f2bcb3343099 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:36.619035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869be2f5-180d-4836-bcfd-f2bcb3343099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:36.620978 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869be2f5-180d-4836-bcfd-f2bcb3343099 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:36.717126 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1329/2676] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:45:36 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:45:36.721773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434fbe3-dd81-4b88-b824-256d9959b834 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:36.732728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434fbe3-dd81-4b88-b824-256d9959b834 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:36.738392 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fe04b-edd4-49b5-816e-ac72ca54544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:36.739111 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fe04b-edd4-49b5-816e-ac72ca54544e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:36.739391 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fe04b-edd4-49b5-816e-ac72ca54544e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:36.739669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fe04b-edd4-49b5-816e-ac72ca54544e admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:36.740407 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fe04b-edd4-49b5-816e-ac72ca54544e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:36.742040 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fe04b-edd4-49b5-816e-ac72ca54544e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:36.754149 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1348/2677] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:45:36.758884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869be2f5-180d-4836-bcfd-f2bcb3343099 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:36.765451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:36.770348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869be2f5-180d-4836-bcfd-f2bcb3343099 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:36.775380 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81a206-3f05-440b-9565-66911591b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:36.776763 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81a206-3f05-440b-9565-66911591b7fe admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:36.776763 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81a206-3f05-440b-9565-66911591b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:36.776763 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81a206-3f05-440b-9565-66911591b7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:36.777447 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81a206-3f05-440b-9565-66911591b7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:36.779107 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81a206-3f05-440b-9565-66911591b7fe admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:36.791182 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1330/2678] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:45:36.795406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fe04b-edd4-49b5-816e-ac72ca54544e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:36.806052 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fe04b-edd4-49b5-816e-ac72ca54544e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:36.811159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccccea-d528-4f6a-856b-65bd27df3427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:36.812056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccccea-d528-4f6a-856b-65bd27df3427 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:36.812332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccccea-d528-4f6a-856b-65bd27df3427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:36.812603 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccccea-d528-4f6a-856b-65bd27df3427 admin admin] PATH_INFO: `/v3/projects/4787ab4b9a3443f48a1539a50da912fd/users/2f1566c8e61843a18aa9172d3c90f6f0/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:36.829338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccccea-d528-4f6a-856b-65bd27df3427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4787ab4b9a3443f48a1539a50da912fd, user_id=2f1566c8e61843a18aa9172d3c90f6f0, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:36.832765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccccea-d528-4f6a-856b-65bd27df3427 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:36.901668 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1349/2679] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:45:36 2022] PUT /identity/v3/projects/4787ab4b9a3443f48a1539a50da912fd/users/2f1566c8e61843a18aa9172d3c90f6f0/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:36.913987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a24d6b-aa0f-45a5-9eef-050bccec9098 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:36.914268 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a24d6b-aa0f-45a5-9eef-050bccec9098 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:36.915776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a24d6b-aa0f-45a5-9eef-050bccec9098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:36.956688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e4a24d6b-aa0f-45a5-9eef-050bccec9098 None None] MFA Rules not processed for user `2f1566c8e61843a18aa9172d3c90f6f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:36.961348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e4a24d6b-aa0f-45a5-9eef-050bccec9098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:37.028950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1331/2680] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:37.034954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccccea-d528-4f6a-856b-65bd27df3427 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:37.100088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccccea-d528-4f6a-856b-65bd27df3427 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:37.105224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8ffc-0a2f-48bf-8474-5a54fa05b0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:37.105918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8ffc-0a2f-48bf-8474-5a54fa05b0db admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:37.106196 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8ffc-0a2f-48bf-8474-5a54fa05b0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:37.106495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8ffc-0a2f-48bf-8474-5a54fa05b0db admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:37.107213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c8ffc-0a2f-48bf-8474-5a54fa05b0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:37.109130 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c8ffc-0a2f-48bf-8474-5a54fa05b0db admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:37.195950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1350/2681] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:45:37 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:45:37.200286 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a24d6b-aa0f-45a5-9eef-050bccec9098 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:37.212540 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a24d6b-aa0f-45a5-9eef-050bccec9098 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:37.274414 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d15c80-eef9-468a-95ce-751e99ebb637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:37.275128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d15c80-eef9-468a-95ce-751e99ebb637 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:37.275407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d15c80-eef9-468a-95ce-751e99ebb637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:37.275680 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d15c80-eef9-468a-95ce-751e99ebb637 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:37.276398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d15c80-eef9-468a-95ce-751e99ebb637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:37.278926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d15c80-eef9-468a-95ce-751e99ebb637 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:37.395929 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1332/2682] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:45:37 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:45:37.400661 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8ffc-0a2f-48bf-8474-5a54fa05b0db admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:37.412884 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8ffc-0a2f-48bf-8474-5a54fa05b0db admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:37.418172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e2c70-43be-4db6-b736-99de018d53f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:37.418871 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e2c70-43be-4db6-b736-99de018d53f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:37.419156 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e2c70-43be-4db6-b736-99de018d53f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:37.419434 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e2c70-43be-4db6-b736-99de018d53f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:37.420172 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e2c70-43be-4db6-b736-99de018d53f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:37.421811 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e2c70-43be-4db6-b736-99de018d53f2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:37.433848 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1351/2683] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:45:37.438284 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d15c80-eef9-468a-95ce-751e99ebb637 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:37.449265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d15c80-eef9-468a-95ce-751e99ebb637 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:37.454288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30883790-bcb7-4ee5-a384-a373c47d2168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:37.455764 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30883790-bcb7-4ee5-a384-a373c47d2168 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:37.456044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30883790-bcb7-4ee5-a384-a373c47d2168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:37.456318 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30883790-bcb7-4ee5-a384-a373c47d2168 admin admin] PATH_INFO: `/v3/projects/9ee28fc4726b4f82a5b9ea8192cfb1e3/users/1f404d78ab214f0dbe7c762408a008d7/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:37.474000 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30883790-bcb7-4ee5-a384-a373c47d2168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee28fc4726b4f82a5b9ea8192cfb1e3, user_id=1f404d78ab214f0dbe7c762408a008d7, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:37.476709 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30883790-bcb7-4ee5-a384-a373c47d2168 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:37.569959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1333/2684] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:45:37 2022] PUT /identity/v3/projects/9ee28fc4726b4f82a5b9ea8192cfb1e3/users/1f404d78ab214f0dbe7c762408a008d7/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:37.574201 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e2c70-43be-4db6-b736-99de018d53f2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:37.585288 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e2c70-43be-4db6-b736-99de018d53f2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:37.630466 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:37.666065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d169e44-489e-400e-9af3-2ec2e7b6ce06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:37.666780 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d169e44-489e-400e-9af3-2ec2e7b6ce06 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:37.667074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d169e44-489e-400e-9af3-2ec2e7b6ce06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:37.667364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d169e44-489e-400e-9af3-2ec2e7b6ce06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:37.668083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d169e44-489e-400e-9af3-2ec2e7b6ce06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:37.669692 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d169e44-489e-400e-9af3-2ec2e7b6ce06 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:37.688062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1352/2685] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:45:37.693112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30883790-bcb7-4ee5-a384-a373c47d2168 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:37.704493 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30883790-bcb7-4ee5-a384-a373c47d2168 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:37.709227 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad51140-5ba4-4618-a508-42716bdb8a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:37.710127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad51140-5ba4-4618-a508-42716bdb8a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:37.710402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad51140-5ba4-4618-a508-42716bdb8a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:37.710696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad51140-5ba4-4618-a508-42716bdb8a39 admin admin] PATH_INFO: `/v3/projects/9ee28fc4726b4f82a5b9ea8192cfb1e3/users/1f404d78ab214f0dbe7c762408a008d7/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:37.712740 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad51140-5ba4-4618-a508-42716bdb8a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee28fc4726b4f82a5b9ea8192cfb1e3, user_id=1f404d78ab214f0dbe7c762408a008d7, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:37.715415 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad51140-5ba4-4618-a508-42716bdb8a39 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:37.726291 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1334/2686] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:45:37 2022] PUT /identity/v3/projects/9ee28fc4726b4f82a5b9ea8192cfb1e3/users/1f404d78ab214f0dbe7c762408a008d7/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:37.737123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f050a-d239-448f-9e25-0b85cee2c379 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:37.737682 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f050a-d239-448f-9e25-0b85cee2c379 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:37.738113 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f050a-d239-448f-9e25-0b85cee2c379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:37.765879 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-565f050a-d239-448f-9e25-0b85cee2c379 None None] MFA Rules not processed for user `1f404d78ab214f0dbe7c762408a008d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:37.767123 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-565f050a-d239-448f-9e25-0b85cee2c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:37.842033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1353/2687] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:37.854025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad51140-5ba4-4618-a508-42716bdb8a39 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:37.855777 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0ad51140-5ba4-4618-a508-42716bdb8a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:37.902308 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:37.948459 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad51140-5ba4-4618-a508-42716bdb8a39 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:37.952610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54072ff3-1240-450b-83e6-cc4cb4e64f64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:37.953273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54072ff3-1240-450b-83e6-cc4cb4e64f64 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:37.953552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54072ff3-1240-450b-83e6-cc4cb4e64f64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:37.953884 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54072ff3-1240-450b-83e6-cc4cb4e64f64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:37.964856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54072ff3-1240-450b-83e6-cc4cb4e64f64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:37.966206 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54072ff3-1240-450b-83e6-cc4cb4e64f64 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:37.977940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1335/2688] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:45:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:45:38.063376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f050a-d239-448f-9e25-0b85cee2c379 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:38.065403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-565f050a-d239-448f-9e25-0b85cee2c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:38.081349 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f050a-d239-448f-9e25-0b85cee2c379 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:38.085056 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d3264-6aa5-45a9-9f3e-4ab18defa065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:38.085867 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d3264-6aa5-45a9-9f3e-4ab18defa065 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:38.086149 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d3264-6aa5-45a9-9f3e-4ab18defa065 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:38.086429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d3264-6aa5-45a9-9f3e-4ab18defa065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:38.146999 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d3264-6aa5-45a9-9f3e-4ab18defa065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:38.148450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d3264-6aa5-45a9-9f3e-4ab18defa065 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:38.157700 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1354/2689] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:45:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:45:42.226974 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54072ff3-1240-450b-83e6-cc4cb4e64f64 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:42.304483 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54072ff3-1240-450b-83e6-cc4cb4e64f64 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:42.309014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30238d1-d682-46a7-b1f3-d784ec3b52ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:42.309885 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30238d1-d682-46a7-b1f3-d784ec3b52ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:42.310165 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30238d1-d682-46a7-b1f3-d784ec3b52ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:42.310435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30238d1-d682-46a7-b1f3-d784ec3b52ef admin admin] PATH_INFO: `/v3/users/0768c17af07a414c96d1c47a121f4e3b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:42.311663 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30238d1-d682-46a7-b1f3-d784ec3b52ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=0768c17af07a414c96d1c47a121f4e3b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:42.313608 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30238d1-d682-46a7-b1f3-d784ec3b52ef admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:42.530986 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c30238d1-d682-46a7-b1f3-d784ec3b52ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0768c17af07a414c96d1c47a121f4e3b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:42.608188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c30238d1-d682-46a7-b1f3-d784ec3b52ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0768c17af07a414c96d1c47a121f4e3b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:42.617202 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c30238d1-d682-46a7-b1f3-d784ec3b52ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0768c17af07a414c96d1c47a121f4e3b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:42.630505 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c30238d1-d682-46a7-b1f3-d784ec3b52ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0768c17af07a414c96d1c47a121f4e3b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:42.631277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c30238d1-d682-46a7-b1f3-d784ec3b52ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0768c17af07a414c96d1c47a121f4e3b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:42.637581 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1336/2690] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:45:42 2022] DELETE /identity/v3/users/0768c17af07a414c96d1c47a121f4e3b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:42.642148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c446c50-060f-47d8-a1c3-2f748bb8d329 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:42.642622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c446c50-060f-47d8-a1c3-2f748bb8d329 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:42.646918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c446c50-060f-47d8-a1c3-2f748bb8d329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:42.660782 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7c446c50-060f-47d8-a1c3-2f748bb8d329 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:42.661967 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7c446c50-060f-47d8-a1c3-2f748bb8d329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:42.713516 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:42.723723 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1355/2691] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:45:42.734069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30238d1-d682-46a7-b1f3-d784ec3b52ef admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:42.735569 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c30238d1-d682-46a7-b1f3-d784ec3b52ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:42.778868 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:42.795044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30238d1-d682-46a7-b1f3-d784ec3b52ef admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:42.798787 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db31bcb-bf2a-49ae-8b15-9966080224b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:42.799731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db31bcb-bf2a-49ae-8b15-9966080224b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:42.800017 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db31bcb-bf2a-49ae-8b15-9966080224b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:42.800283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db31bcb-bf2a-49ae-8b15-9966080224b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:42.810660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db31bcb-bf2a-49ae-8b15-9966080224b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:42.812134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db31bcb-bf2a-49ae-8b15-9966080224b9 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:42.822213 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1337/2692] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:45:43.250484 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c446c50-060f-47d8-a1c3-2f748bb8d329 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:43.251203 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7c446c50-060f-47d8-a1c3-2f748bb8d329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:43.267154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c446c50-060f-47d8-a1c3-2f748bb8d329 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:43.272853 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8eab2-f41a-4b38-ae59-2d7005b17418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:43.276472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8eab2-f41a-4b38-ae59-2d7005b17418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:43.276472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8eab2-f41a-4b38-ae59-2d7005b17418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:43.276472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8eab2-f41a-4b38-ae59-2d7005b17418 admin admin] PATH_INFO: `/v3/projects/a748a74ea30048ab947f9d2ccbc07682` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:43.276472 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8eab2-f41a-4b38-ae59-2d7005b17418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a748a74ea30048ab947f9d2ccbc07682)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:43.279136 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8eab2-f41a-4b38-ae59-2d7005b17418 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:43.384519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8ac8eab2-f41a-4b38-ae59-2d7005b17418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a748a74ea30048ab947f9d2ccbc07682', 'request_id': 'req-8ac8eab2-f41a-4b38-ae59-2d7005b17418'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:43.451261 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8ac8eab2-f41a-4b38-ae59-2d7005b17418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a748a74ea30048ab947f9d2ccbc07682', 'request_id': 'req-8ac8eab2-f41a-4b38-ae59-2d7005b17418'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:43.459097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8ac8eab2-f41a-4b38-ae59-2d7005b17418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a748a74ea30048ab947f9d2ccbc07682', 'request_id': 'req-8ac8eab2-f41a-4b38-ae59-2d7005b17418'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:43.470913 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8ac8eab2-f41a-4b38-ae59-2d7005b17418 admin admin] The token cache is being invalidate because project a748a74ea30048ab947f9d2ccbc07682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:45:43.471207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8ac8eab2-f41a-4b38-ae59-2d7005b17418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:43.471923 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8ac8eab2-f41a-4b38-ae59-2d7005b17418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:43.473703 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1356/2693] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:45:43 2022] DELETE /identity/v3/projects/a748a74ea30048ab947f9d2ccbc07682 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:43.477706 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db31bcb-bf2a-49ae-8b15-9966080224b9 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:43.489240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db31bcb-bf2a-49ae-8b15-9966080224b9 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:43.552957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0e27e-02f6-4ff3-b20d-f3902147182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:43.553850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0e27e-02f6-4ff3-b20d-f3902147182c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:43.554123 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0e27e-02f6-4ff3-b20d-f3902147182c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:43.554392 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0e27e-02f6-4ff3-b20d-f3902147182c admin admin] PATH_INFO: `/v3/users/2f1566c8e61843a18aa9172d3c90f6f0` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:43.555681 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0e27e-02f6-4ff3-b20d-f3902147182c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f1566c8e61843a18aa9172d3c90f6f0)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:43.557622 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0e27e-02f6-4ff3-b20d-f3902147182c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:43.756638 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ccb0e27e-02f6-4ff3-b20d-f3902147182c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f1566c8e61843a18aa9172d3c90f6f0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:43.851217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ccb0e27e-02f6-4ff3-b20d-f3902147182c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f1566c8e61843a18aa9172d3c90f6f0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:43.859063 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ccb0e27e-02f6-4ff3-b20d-f3902147182c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f1566c8e61843a18aa9172d3c90f6f0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:43.873156 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ccb0e27e-02f6-4ff3-b20d-f3902147182c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f1566c8e61843a18aa9172d3c90f6f0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:43.873903 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ccb0e27e-02f6-4ff3-b20d-f3902147182c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f1566c8e61843a18aa9172d3c90f6f0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:43.880482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1338/2694] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:45:43 2022] DELETE /identity/v3/users/2f1566c8e61843a18aa9172d3c90f6f0 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:44.520225 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8eab2-f41a-4b38-ae59-2d7005b17418 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:44.525264 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8ac8eab2-f41a-4b38-ae59-2d7005b17418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:44.546708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8eab2-f41a-4b38-ae59-2d7005b17418 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:44.629102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4ab83-06a2-4a15-b6e4-ba1122aee370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:44.630641 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4ab83-06a2-4a15-b6e4-ba1122aee370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:44.630977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4ab83-06a2-4a15-b6e4-ba1122aee370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:44.631254 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4ab83-06a2-4a15-b6e4-ba1122aee370 admin admin] PATH_INFO: `/v3/projects/4787ab4b9a3443f48a1539a50da912fd` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:44.632838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4ab83-06a2-4a15-b6e4-ba1122aee370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4787ab4b9a3443f48a1539a50da912fd)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:44.634870 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4ab83-06a2-4a15-b6e4-ba1122aee370 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:44.761702 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-62d4ab83-06a2-4a15-b6e4-ba1122aee370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4787ab4b9a3443f48a1539a50da912fd', 'request_id': 'req-62d4ab83-06a2-4a15-b6e4-ba1122aee370'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:44.834798 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-62d4ab83-06a2-4a15-b6e4-ba1122aee370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4787ab4b9a3443f48a1539a50da912fd', 'request_id': 'req-62d4ab83-06a2-4a15-b6e4-ba1122aee370'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:44.840495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-62d4ab83-06a2-4a15-b6e4-ba1122aee370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4787ab4b9a3443f48a1539a50da912fd', 'request_id': 'req-62d4ab83-06a2-4a15-b6e4-ba1122aee370'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:44.853732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-62d4ab83-06a2-4a15-b6e4-ba1122aee370 admin admin] The token cache is being invalidate because project 4787ab4b9a3443f48a1539a50da912fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:45:44.854161 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-62d4ab83-06a2-4a15-b6e4-ba1122aee370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:44.854909 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-62d4ab83-06a2-4a15-b6e4-ba1122aee370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:44.856918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1357/2695] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:45:44 2022] DELETE /identity/v3/projects/4787ab4b9a3443f48a1539a50da912fd => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:44.860794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0e27e-02f6-4ff3-b20d-f3902147182c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:44.869573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ccb0e27e-02f6-4ff3-b20d-f3902147182c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:44.877659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0e27e-02f6-4ff3-b20d-f3902147182c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:44.947975 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f4127-20e2-4e5c-81b2-fa6d0ae542de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:44.948873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f4127-20e2-4e5c-81b2-fa6d0ae542de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:44.949157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f4127-20e2-4e5c-81b2-fa6d0ae542de admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:44.949487 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f4127-20e2-4e5c-81b2-fa6d0ae542de admin admin] PATH_INFO: `/v3/users/1f404d78ab214f0dbe7c762408a008d7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:44.950764 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f4127-20e2-4e5c-81b2-fa6d0ae542de admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f404d78ab214f0dbe7c762408a008d7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:44.952720 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f4127-20e2-4e5c-81b2-fa6d0ae542de admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:44.954498 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:45.131754 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-820f4127-20e2-4e5c-81b2-fa6d0ae542de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f404d78ab214f0dbe7c762408a008d7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:45.213572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-820f4127-20e2-4e5c-81b2-fa6d0ae542de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f404d78ab214f0dbe7c762408a008d7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:45.224175 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-820f4127-20e2-4e5c-81b2-fa6d0ae542de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f404d78ab214f0dbe7c762408a008d7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:45.237438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-820f4127-20e2-4e5c-81b2-fa6d0ae542de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f404d78ab214f0dbe7c762408a008d7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:45.238776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-820f4127-20e2-4e5c-81b2-fa6d0ae542de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f404d78ab214f0dbe7c762408a008d7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:45.246585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1339/2696] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:45:44 2022] DELETE /identity/v3/users/1f404d78ab214f0dbe7c762408a008d7 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:45:45.722077 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4ab83-06a2-4a15-b6e4-ba1122aee370 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:45.723639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-62d4ab83-06a2-4a15-b6e4-ba1122aee370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:45.737604 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4ab83-06a2-4a15-b6e4-ba1122aee370 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:45.746021 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:45.801608 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96df08-9333-4e6f-81dd-a0cd2f9ea5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:45.802475 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96df08-9333-4e6f-81dd-a0cd2f9ea5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:45.802796 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96df08-9333-4e6f-81dd-a0cd2f9ea5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:45.803075 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96df08-9333-4e6f-81dd-a0cd2f9ea5dc admin admin] PATH_INFO: `/v3/projects/9ee28fc4726b4f82a5b9ea8192cfb1e3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:45.804270 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96df08-9333-4e6f-81dd-a0cd2f9ea5dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee28fc4726b4f82a5b9ea8192cfb1e3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:45.806181 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96df08-9333-4e6f-81dd-a0cd2f9ea5dc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:45.909518 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ee96df08-9333-4e6f-81dd-a0cd2f9ea5dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee28fc4726b4f82a5b9ea8192cfb1e3', 'request_id': 'req-ee96df08-9333-4e6f-81dd-a0cd2f9ea5dc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:45.989223 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ee96df08-9333-4e6f-81dd-a0cd2f9ea5dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee28fc4726b4f82a5b9ea8192cfb1e3', 'request_id': 'req-ee96df08-9333-4e6f-81dd-a0cd2f9ea5dc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:45.996491 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ee96df08-9333-4e6f-81dd-a0cd2f9ea5dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee28fc4726b4f82a5b9ea8192cfb1e3', 'request_id': 'req-ee96df08-9333-4e6f-81dd-a0cd2f9ea5dc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:46.012840 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ee96df08-9333-4e6f-81dd-a0cd2f9ea5dc admin admin] The token cache is being invalidate because project 9ee28fc4726b4f82a5b9ea8192cfb1e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:45:46.013126 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ee96df08-9333-4e6f-81dd-a0cd2f9ea5dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:46.013794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ee96df08-9333-4e6f-81dd-a0cd2f9ea5dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:46.015399 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1358/2697] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:45:45 2022] DELETE /identity/v3/projects/9ee28fc4726b4f82a5b9ea8192cfb1e3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:46.022384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d24f8a-377a-460d-a2b4-ed909861b08b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:46.022976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d24f8a-377a-460d-a2b4-ed909861b08b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:46.022976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d24f8a-377a-460d-a2b4-ed909861b08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:46.041642 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-55d24f8a-377a-460d-a2b4-ed909861b08b None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:46.043326 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-55d24f8a-377a-460d-a2b4-ed909861b08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:46.120959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1340/2698] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:46.131129 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b3c31-ebee-44f9-9010-89eae4167a11 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:46.141874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b3c31-ebee-44f9-9010-89eae4167a11 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:46.141874 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b3c31-ebee-44f9-9010-89eae4167a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:46.150323 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6e8b3c31-ebee-44f9-9010-89eae4167a11 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:46.151553 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6e8b3c31-ebee-44f9-9010-89eae4167a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:46.160266 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1359/2699] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:46.164521 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d24f8a-377a-460d-a2b4-ed909861b08b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:46.177135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d24f8a-377a-460d-a2b4-ed909861b08b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:46.183631 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92593a-e0a9-4547-9e40-1de1a110b2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:46.184304 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92593a-e0a9-4547-9e40-1de1a110b2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:46.184590 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92593a-e0a9-4547-9e40-1de1a110b2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:46.184864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92593a-e0a9-4547-9e40-1de1a110b2e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:46.185601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92593a-e0a9-4547-9e40-1de1a110b2e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:45:46.185901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92593a-e0a9-4547-9e40-1de1a110b2e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:46.187664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92593a-e0a9-4547-9e40-1de1a110b2e9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:46.200970 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1341/2700] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:45:46.209720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b3c31-ebee-44f9-9010-89eae4167a11 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:46.219095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b3c31-ebee-44f9-9010-89eae4167a11 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:46.224426 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc74487-0e08-469f-955c-c9a6cb44d949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:46.225098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc74487-0e08-469f-955c-c9a6cb44d949 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:46.225379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc74487-0e08-469f-955c-c9a6cb44d949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:46.225652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc74487-0e08-469f-955c-c9a6cb44d949 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:46.226362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc74487-0e08-469f-955c-c9a6cb44d949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:46.228331 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc74487-0e08-469f-955c-c9a6cb44d949 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:46.320964 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1360/2701] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:45:46 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:45:46.325925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92593a-e0a9-4547-9e40-1de1a110b2e9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:46.336583 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92593a-e0a9-4547-9e40-1de1a110b2e9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:46.403446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305eafe-75ba-4df9-973f-77ad693677ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:46.404115 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305eafe-75ba-4df9-973f-77ad693677ac admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:46.404389 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305eafe-75ba-4df9-973f-77ad693677ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:46.404658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305eafe-75ba-4df9-973f-77ad693677ac admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:46.405344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305eafe-75ba-4df9-973f-77ad693677ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:46.407298 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305eafe-75ba-4df9-973f-77ad693677ac admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:46.417317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:46.511545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1342/2702] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:45:46 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:45:46.515648 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc74487-0e08-469f-955c-c9a6cb44d949 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:46.526618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc74487-0e08-469f-955c-c9a6cb44d949 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:46.531339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119322dc-cc4a-4690-99df-f92c8a999b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:46.532012 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119322dc-cc4a-4690-99df-f92c8a999b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:46.532297 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119322dc-cc4a-4690-99df-f92c8a999b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:46.532564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119322dc-cc4a-4690-99df-f92c8a999b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:46.533459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119322dc-cc4a-4690-99df-f92c8a999b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:46.535120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119322dc-cc4a-4690-99df-f92c8a999b42 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:46.545993 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1361/2703] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:45:46.550865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305eafe-75ba-4df9-973f-77ad693677ac admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:46.561482 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305eafe-75ba-4df9-973f-77ad693677ac admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:46.568335 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eb391-f45e-4670-8b43-7a750e4e3bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:46.569164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eb391-f45e-4670-8b43-7a750e4e3bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:46.571087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eb391-f45e-4670-8b43-7a750e4e3bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:46.571087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eb391-f45e-4670-8b43-7a750e4e3bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:46.571087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1eb391-f45e-4670-8b43-7a750e4e3bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:46.572264 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1eb391-f45e-4670-8b43-7a750e4e3bf1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:46.583527 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1343/2704] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:45:46.587822 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119322dc-cc4a-4690-99df-f92c8a999b42 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:46.597923 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119322dc-cc4a-4690-99df-f92c8a999b42 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:46.602666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89a874-49eb-4a7b-8e60-a19452ff2067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:46.603587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89a874-49eb-4a7b-8e60-a19452ff2067 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:46.603860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89a874-49eb-4a7b-8e60-a19452ff2067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:46.604186 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89a874-49eb-4a7b-8e60-a19452ff2067 admin admin] PATH_INFO: `/v3/projects/02fef1140e93429eaceb1df5c2df28d1/users/e6e6d62023c74bf8a2fdffaa6d95dfa0/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:46.620354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89a874-49eb-4a7b-8e60-a19452ff2067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02fef1140e93429eaceb1df5c2df28d1, user_id=e6e6d62023c74bf8a2fdffaa6d95dfa0, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:46.623022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89a874-49eb-4a7b-8e60-a19452ff2067 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:46.729154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1362/2705] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:45:46 2022] PUT /identity/v3/projects/02fef1140e93429eaceb1df5c2df28d1/users/e6e6d62023c74bf8a2fdffaa6d95dfa0/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:46.747192 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5472b-0d5d-4b33-82a7-851133f915d4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:46.747472 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5472b-0d5d-4b33-82a7-851133f915d4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:46.747748 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5472b-0d5d-4b33-82a7-851133f915d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:46.775429 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-35b5472b-0d5d-4b33-82a7-851133f915d4 None None] MFA Rules not processed for user `e6e6d62023c74bf8a2fdffaa6d95dfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:46.777528 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-35b5472b-0d5d-4b33-82a7-851133f915d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:46.843774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1344/2706] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:46.849004 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89a874-49eb-4a7b-8e60-a19452ff2067 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:46.895338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:46.917147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89a874-49eb-4a7b-8e60-a19452ff2067 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:46.921949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225af3d-a2ad-40cf-b74c-52df8a37382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:46.922727 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225af3d-a2ad-40cf-b74c-52df8a37382f admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:46.922955 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225af3d-a2ad-40cf-b74c-52df8a37382f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:46.923230 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225af3d-a2ad-40cf-b74c-52df8a37382f admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:46.924601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225af3d-a2ad-40cf-b74c-52df8a37382f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:46.926630 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225af3d-a2ad-40cf-b74c-52df8a37382f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:47.047413 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1363/2707] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:45:46 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:45:47.051309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5472b-0d5d-4b33-82a7-851133f915d4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:47.062246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5472b-0d5d-4b33-82a7-851133f915d4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:47.123555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079da74d-1daf-464e-8fe7-3de20efb6de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:47.124229 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079da74d-1daf-464e-8fe7-3de20efb6de2 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:47.124513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079da74d-1daf-464e-8fe7-3de20efb6de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:47.124786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079da74d-1daf-464e-8fe7-3de20efb6de2 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:47.125503 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079da74d-1daf-464e-8fe7-3de20efb6de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:47.127507 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079da74d-1daf-464e-8fe7-3de20efb6de2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:47.215404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1345/2708] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:45:47 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:45:47.216737 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225af3d-a2ad-40cf-b74c-52df8a37382f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:47.228259 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225af3d-a2ad-40cf-b74c-52df8a37382f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:47.233823 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88932b20-022a-47c4-a0db-2417cfd83a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:47.241842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88932b20-022a-47c4-a0db-2417cfd83a77 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:47.241842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88932b20-022a-47c4-a0db-2417cfd83a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:47.241842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88932b20-022a-47c4-a0db-2417cfd83a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:47.241842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88932b20-022a-47c4-a0db-2417cfd83a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:47.241842 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88932b20-022a-47c4-a0db-2417cfd83a77 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:47.251548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1364/2709] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:45:47.252815 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079da74d-1daf-464e-8fe7-3de20efb6de2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:47.263267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079da74d-1daf-464e-8fe7-3de20efb6de2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:47.268522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4785d-9ce5-4bfa-9360-73796e5624b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:47.270541 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4785d-9ce5-4bfa-9360-73796e5624b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:47.270541 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4785d-9ce5-4bfa-9360-73796e5624b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:47.270541 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4785d-9ce5-4bfa-9360-73796e5624b6 admin admin] PATH_INFO: `/v3/projects/67b2d276e6174ca789bdaa62adb8d2ee/users/302888655a8a4d24bb5e10a137e6d842/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:47.286956 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4785d-9ce5-4bfa-9360-73796e5624b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b2d276e6174ca789bdaa62adb8d2ee, user_id=302888655a8a4d24bb5e10a137e6d842, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:47.289683 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4785d-9ce5-4bfa-9360-73796e5624b6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:47.380713 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1346/2710] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:45:47 2022] PUT /identity/v3/projects/67b2d276e6174ca789bdaa62adb8d2ee/users/302888655a8a4d24bb5e10a137e6d842/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:47.384806 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88932b20-022a-47c4-a0db-2417cfd83a77 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:47.395897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88932b20-022a-47c4-a0db-2417cfd83a77 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:47.457616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0268f-c508-4176-ae1f-4a6dff477c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:47.458286 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0268f-c508-4176-ae1f-4a6dff477c5f admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:47.458575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0268f-c508-4176-ae1f-4a6dff477c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:47.458887 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0268f-c508-4176-ae1f-4a6dff477c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:47.459618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0268f-c508-4176-ae1f-4a6dff477c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:47.461213 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0268f-c508-4176-ae1f-4a6dff477c5f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:47.472481 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1365/2711] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:45:47.478187 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4785d-9ce5-4bfa-9360-73796e5624b6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:47.489802 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4785d-9ce5-4bfa-9360-73796e5624b6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:47.495055 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111c34e-dc0d-4c26-bc19-43ea0ac3bee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:47.495968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111c34e-dc0d-4c26-bc19-43ea0ac3bee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:47.496233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111c34e-dc0d-4c26-bc19-43ea0ac3bee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:47.500068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111c34e-dc0d-4c26-bc19-43ea0ac3bee0 admin admin] PATH_INFO: `/v3/projects/67b2d276e6174ca789bdaa62adb8d2ee/users/302888655a8a4d24bb5e10a137e6d842/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:47.500068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111c34e-dc0d-4c26-bc19-43ea0ac3bee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b2d276e6174ca789bdaa62adb8d2ee, user_id=302888655a8a4d24bb5e10a137e6d842, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:47.501181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111c34e-dc0d-4c26-bc19-43ea0ac3bee0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:47.512988 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1347/2712] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:45:47 2022] PUT /identity/v3/projects/67b2d276e6174ca789bdaa62adb8d2ee/users/302888655a8a4d24bb5e10a137e6d842/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:47.524234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603dab1-3072-46df-ae16-896bdae06042 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:47.524518 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603dab1-3072-46df-ae16-896bdae06042 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:47.524789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603dab1-3072-46df-ae16-896bdae06042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:47.553255 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3603dab1-3072-46df-ae16-896bdae06042 None None] MFA Rules not processed for user `302888655a8a4d24bb5e10a137e6d842`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:47.554530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3603dab1-3072-46df-ae16-896bdae06042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:47.751522 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1366/2713] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:47.764710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111c34e-dc0d-4c26-bc19-43ea0ac3bee0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:47.766467 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3111c34e-dc0d-4c26-bc19-43ea0ac3bee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:47.801348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:47.831707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111c34e-dc0d-4c26-bc19-43ea0ac3bee0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:47.835519 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda39c7-efc2-4583-a100-bb3b10e9d3e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:47.836199 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda39c7-efc2-4583-a100-bb3b10e9d3e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:47.836441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda39c7-efc2-4583-a100-bb3b10e9d3e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:47.836719 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda39c7-efc2-4583-a100-bb3b10e9d3e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:47.846732 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda39c7-efc2-4583-a100-bb3b10e9d3e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:47.848193 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda39c7-efc2-4583-a100-bb3b10e9d3e5 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:47.857895 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1348/2714] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:45:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:45:48.435335 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603dab1-3072-46df-ae16-896bdae06042 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:48.471850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:48.499326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603dab1-3072-46df-ae16-896bdae06042 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:48.504303 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfd280-2cd1-4d2b-816b-319c160f12ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:48.508344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfd280-2cd1-4d2b-816b-319c160f12ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:48.508344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfd280-2cd1-4d2b-816b-319c160f12ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:48.508344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfd280-2cd1-4d2b-816b-319c160f12ac admin admin] PATH_INFO: `/v3/users/e6e6d62023c74bf8a2fdffaa6d95dfa0` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:48.508344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfd280-2cd1-4d2b-816b-319c160f12ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e6d62023c74bf8a2fdffaa6d95dfa0)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:48.509144 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfd280-2cd1-4d2b-816b-319c160f12ac admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:48.753785 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-07cfd280-2cd1-4d2b-816b-319c160f12ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e6d62023c74bf8a2fdffaa6d95dfa0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:48.825593 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-07cfd280-2cd1-4d2b-816b-319c160f12ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e6d62023c74bf8a2fdffaa6d95dfa0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:48.826785 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-07cfd280-2cd1-4d2b-816b-319c160f12ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e6d62023c74bf8a2fdffaa6d95dfa0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:48.839854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-07cfd280-2cd1-4d2b-816b-319c160f12ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e6d62023c74bf8a2fdffaa6d95dfa0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:48.847224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-07cfd280-2cd1-4d2b-816b-319c160f12ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e6d62023c74bf8a2fdffaa6d95dfa0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:48.855370 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1367/2715] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:45:48 2022] DELETE /identity/v3/users/e6e6d62023c74bf8a2fdffaa6d95dfa0 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:48.860440 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261cdb3-d4c5-4ad6-9282-03e4a928bca6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:48.860950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261cdb3-d4c5-4ad6-9282-03e4a928bca6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:48.861806 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261cdb3-d4c5-4ad6-9282-03e4a928bca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:48.886194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2261cdb3-d4c5-4ad6-9282-03e4a928bca6 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:48.887355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2261cdb3-d4c5-4ad6-9282-03e4a928bca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:48.951823 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1349/2716] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:48.962500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfd280-2cd1-4d2b-816b-319c160f12ac admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:48.964092 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-07cfd280-2cd1-4d2b-816b-319c160f12ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:49.027993 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfd280-2cd1-4d2b-816b-319c160f12ac admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:49.031809 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a1a3d-8ecc-4cfe-bcb2-56ebd113fe93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:49.032457 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a1a3d-8ecc-4cfe-bcb2-56ebd113fe93 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:49.032748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a1a3d-8ecc-4cfe-bcb2-56ebd113fe93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:49.033008 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a1a3d-8ecc-4cfe-bcb2-56ebd113fe93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:49.043111 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a1a3d-8ecc-4cfe-bcb2-56ebd113fe93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:49.044557 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a1a3d-8ecc-4cfe-bcb2-56ebd113fe93 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:49.054890 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1368/2717] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:45:49.600303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f14c94-2cf2-495a-93e8-0969a631ccf4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:49.600586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f14c94-2cf2-495a-93e8-0969a631ccf4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:49.600852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f14c94-2cf2-495a-93e8-0969a631ccf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:49.622365 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a1a3d-8ecc-4cfe-bcb2-56ebd113fe93 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:49.623949 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-163a1a3d-8ecc-4cfe-bcb2-56ebd113fe93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:49.624181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e0f14c94-2cf2-495a-93e8-0969a631ccf4 None None] MFA Rules not processed for user `aa8989cc123649c9ae39499036eadd31`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:49.625418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e0f14c94-2cf2-495a-93e8-0969a631ccf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:49.645174 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a1a3d-8ecc-4cfe-bcb2-56ebd113fe93 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:49.650061 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f2133-f6d0-45ef-8086-c82fc4c4a2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:49.653724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f2133-f6d0-45ef-8086-c82fc4c4a2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:49.653724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f2133-f6d0-45ef-8086-c82fc4c4a2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:49.653724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f2133-f6d0-45ef-8086-c82fc4c4a2be admin admin] PATH_INFO: `/v3/projects/02fef1140e93429eaceb1df5c2df28d1` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:49.653724 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f2133-f6d0-45ef-8086-c82fc4c4a2be admin admin] RBAC: Authorizing `identity:delete_project(project_id=02fef1140e93429eaceb1df5c2df28d1)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:49.654633 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f2133-f6d0-45ef-8086-c82fc4c4a2be admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:49.697164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1350/2718] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:49.776915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-320f2133-f6d0-45ef-8086-c82fc4c4a2be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02fef1140e93429eaceb1df5c2df28d1', 'request_id': 'req-320f2133-f6d0-45ef-8086-c82fc4c4a2be'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:49.780139 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:49.853850 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-320f2133-f6d0-45ef-8086-c82fc4c4a2be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02fef1140e93429eaceb1df5c2df28d1', 'request_id': 'req-320f2133-f6d0-45ef-8086-c82fc4c4a2be'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:49.862652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-320f2133-f6d0-45ef-8086-c82fc4c4a2be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02fef1140e93429eaceb1df5c2df28d1', 'request_id': 'req-320f2133-f6d0-45ef-8086-c82fc4c4a2be'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:49.872756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-320f2133-f6d0-45ef-8086-c82fc4c4a2be admin admin] The token cache is being invalidate because project 02fef1140e93429eaceb1df5c2df28d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:45:49.873042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-320f2133-f6d0-45ef-8086-c82fc4c4a2be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:49.873707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-320f2133-f6d0-45ef-8086-c82fc4c4a2be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:49.875283 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1369/2719] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:45:49 2022] DELETE /identity/v3/projects/02fef1140e93429eaceb1df5c2df28d1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:45:49.879602 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f14c94-2cf2-495a-93e8-0969a631ccf4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:49.891234 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f14c94-2cf2-495a-93e8-0969a631ccf4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:49.956124 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b58cda-6260-4a75-8730-ceab4af6234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:49.961394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b58cda-6260-4a75-8730-ceab4af6234d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:49.961394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b58cda-6260-4a75-8730-ceab4af6234d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:49.961394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b58cda-6260-4a75-8730-ceab4af6234d admin admin] PATH_INFO: `/v3/users/302888655a8a4d24bb5e10a137e6d842` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:49.961394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b58cda-6260-4a75-8730-ceab4af6234d admin admin] RBAC: Authorizing `identity:delete_user(user_id=302888655a8a4d24bb5e10a137e6d842)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:49.961394 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b58cda-6260-4a75-8730-ceab4af6234d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:49.980668 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:50.251831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e0b58cda-6260-4a75-8730-ceab4af6234d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302888655a8a4d24bb5e10a137e6d842'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:50.371545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e0b58cda-6260-4a75-8730-ceab4af6234d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302888655a8a4d24bb5e10a137e6d842'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:50.380268 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e0b58cda-6260-4a75-8730-ceab4af6234d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302888655a8a4d24bb5e10a137e6d842'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:50.396541 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e0b58cda-6260-4a75-8730-ceab4af6234d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302888655a8a4d24bb5e10a137e6d842'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:50.397317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e0b58cda-6260-4a75-8730-ceab4af6234d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302888655a8a4d24bb5e10a137e6d842'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:50.406760 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1351/2720] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:45:49 2022] DELETE /identity/v3/users/302888655a8a4d24bb5e10a137e6d842 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:50.859218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f2133-f6d0-45ef-8086-c82fc4c4a2be admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:50.860685 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-320f2133-f6d0-45ef-8086-c82fc4c4a2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:50.874767 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f2133-f6d0-45ef-8086-c82fc4c4a2be admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:50.937828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbf3a8-dce0-4eb6-bc4e-20e22defd4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:50.938732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbf3a8-dce0-4eb6-bc4e-20e22defd4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:50.939093 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbf3a8-dce0-4eb6-bc4e-20e22defd4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:50.939292 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbf3a8-dce0-4eb6-bc4e-20e22defd4d0 admin admin] PATH_INFO: `/v3/projects/67b2d276e6174ca789bdaa62adb8d2ee` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:50.940825 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbf3a8-dce0-4eb6-bc4e-20e22defd4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b2d276e6174ca789bdaa62adb8d2ee)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:50.942802 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbf3a8-dce0-4eb6-bc4e-20e22defd4d0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:51.054794 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a4dbf3a8-dce0-4eb6-bc4e-20e22defd4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b2d276e6174ca789bdaa62adb8d2ee', 'request_id': 'req-a4dbf3a8-dce0-4eb6-bc4e-20e22defd4d0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:51.122496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a4dbf3a8-dce0-4eb6-bc4e-20e22defd4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b2d276e6174ca789bdaa62adb8d2ee', 'request_id': 'req-a4dbf3a8-dce0-4eb6-bc4e-20e22defd4d0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:51.129091 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a4dbf3a8-dce0-4eb6-bc4e-20e22defd4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b2d276e6174ca789bdaa62adb8d2ee', 'request_id': 'req-a4dbf3a8-dce0-4eb6-bc4e-20e22defd4d0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:51.140845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a4dbf3a8-dce0-4eb6-bc4e-20e22defd4d0 admin admin] The token cache is being invalidate because project 67b2d276e6174ca789bdaa62adb8d2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:45:51.141130 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a4dbf3a8-dce0-4eb6-bc4e-20e22defd4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:51.141768 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a4dbf3a8-dce0-4eb6-bc4e-20e22defd4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:51.143340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1370/2721] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:45:50 2022] DELETE /identity/v3/projects/67b2d276e6174ca789bdaa62adb8d2ee => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:51.148277 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d067f-a202-4056-9a18-d2cdda398d15 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:51.156421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d067f-a202-4056-9a18-d2cdda398d15 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:51.156421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d067f-a202-4056-9a18-d2cdda398d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:51.166792 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6b2d067f-a202-4056-9a18-d2cdda398d15 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:51.168045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6b2d067f-a202-4056-9a18-d2cdda398d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:51.232674 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1352/2722] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:51.293753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06545a7-2fd6-40df-9ad3-645695ee1d70 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:51.294036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06545a7-2fd6-40df-9ad3-645695ee1d70 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:51.294309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06545a7-2fd6-40df-9ad3-645695ee1d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:51.313008 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f06545a7-2fd6-40df-9ad3-645695ee1d70 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:51.314215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f06545a7-2fd6-40df-9ad3-645695ee1d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:51.322840 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1371/2723] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:51.327174 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d067f-a202-4056-9a18-d2cdda398d15 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:51.337844 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d067f-a202-4056-9a18-d2cdda398d15 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:51.342476 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c1ff1-2aed-4570-9ceb-fe4b63adb4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:51.343189 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c1ff1-2aed-4570-9ceb-fe4b63adb4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:51.343531 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c1ff1-2aed-4570-9ceb-fe4b63adb4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:51.343925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c1ff1-2aed-4570-9ceb-fe4b63adb4e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:51.344659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c1ff1-2aed-4570-9ceb-fe4b63adb4e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:45:51.344962 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c1ff1-2aed-4570-9ceb-fe4b63adb4e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:51.346776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c1ff1-2aed-4570-9ceb-fe4b63adb4e4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:51.362162 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1353/2724] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:45:51.363389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06545a7-2fd6-40df-9ad3-645695ee1d70 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:51.373275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06545a7-2fd6-40df-9ad3-645695ee1d70 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:51.380248 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0273d8-490e-4327-a7d3-6e7bbe275d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:51.380919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0273d8-490e-4327-a7d3-6e7bbe275d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:51.381197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0273d8-490e-4327-a7d3-6e7bbe275d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:51.381474 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0273d8-490e-4327-a7d3-6e7bbe275d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:51.382171 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0273d8-490e-4327-a7d3-6e7bbe275d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:51.384275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0273d8-490e-4327-a7d3-6e7bbe275d52 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:51.478497 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1372/2725] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:45:51 2022] POST /identity/v3/projects => generated 359 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:45:51.483008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c1ff1-2aed-4570-9ceb-fe4b63adb4e4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:51.493278 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c1ff1-2aed-4570-9ceb-fe4b63adb4e4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:51.552653 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a67af4-f72d-4865-a23d-a1b939725697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:51.553283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a67af4-f72d-4865-a23d-a1b939725697 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:51.553558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a67af4-f72d-4865-a23d-a1b939725697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:51.553839 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a67af4-f72d-4865-a23d-a1b939725697 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:51.554606 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a67af4-f72d-4865-a23d-a1b939725697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:51.556575 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a67af4-f72d-4865-a23d-a1b939725697 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:51.652110 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1354/2726] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:45:51 2022] POST /identity/v3/users => generated 280 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:45:51.656379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0273d8-490e-4327-a7d3-6e7bbe275d52 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:51.666873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0273d8-490e-4327-a7d3-6e7bbe275d52 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:51.675876 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d9d74-e149-46ee-8924-ce44e0f5e1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:51.676545 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d9d74-e149-46ee-8924-ce44e0f5e1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:51.676827 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d9d74-e149-46ee-8924-ce44e0f5e1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:51.677103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d9d74-e149-46ee-8924-ce44e0f5e1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:51.677839 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d9d74-e149-46ee-8924-ce44e0f5e1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:51.679482 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d9d74-e149-46ee-8924-ce44e0f5e1a6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:51.690773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1373/2727] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:45:51.694828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a67af4-f72d-4865-a23d-a1b939725697 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:51.705960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a67af4-f72d-4865-a23d-a1b939725697 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:51.710769 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe1032-6d65-4d4c-b811-eee331c915ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:51.711427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe1032-6d65-4d4c-b811-eee331c915ff admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:51.711710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe1032-6d65-4d4c-b811-eee331c915ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:51.711984 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe1032-6d65-4d4c-b811-eee331c915ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:51.712739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe1032-6d65-4d4c-b811-eee331c915ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:51.714337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe1032-6d65-4d4c-b811-eee331c915ff admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:51.720141 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:51.725865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1355/2728] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:45:51.730073 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d9d74-e149-46ee-8924-ce44e0f5e1a6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:51.740625 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d9d74-e149-46ee-8924-ce44e0f5e1a6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:51.745543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5ddfd-0fbb-4875-99db-e045964225f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:51.746427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5ddfd-0fbb-4875-99db-e045964225f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:51.746739 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5ddfd-0fbb-4875-99db-e045964225f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:51.747041 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5ddfd-0fbb-4875-99db-e045964225f3 admin admin] PATH_INFO: `/v3/projects/c826ef0d208e48898de2163c2486db9b/users/2e148f8aa00f432cb224dd9f640d1924/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:51.762873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5ddfd-0fbb-4875-99db-e045964225f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c826ef0d208e48898de2163c2486db9b, user_id=2e148f8aa00f432cb224dd9f640d1924, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:51.766236 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5ddfd-0fbb-4875-99db-e045964225f3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:51.878197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1374/2729] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:45:51 2022] PUT /identity/v3/projects/c826ef0d208e48898de2163c2486db9b/users/2e148f8aa00f432cb224dd9f640d1924/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:51.888648 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc8090-e144-4e4c-a131-5732f8dc5469 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:51.888934 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc8090-e144-4e4c-a131-5732f8dc5469 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:51.889206 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc8090-e144-4e4c-a131-5732f8dc5469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:51.916441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-aacc8090-e144-4e4c-a131-5732f8dc5469 None None] MFA Rules not processed for user `2e148f8aa00f432cb224dd9f640d1924`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:51.917641 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-aacc8090-e144-4e4c-a131-5732f8dc5469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:51.983395 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1356/2730] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:51 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:52.015542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5ddfd-0fbb-4875-99db-e045964225f3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:52.017242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-41d5ddfd-0fbb-4875-99db-e045964225f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:52.024828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:52.075371 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5ddfd-0fbb-4875-99db-e045964225f3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:52.078966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2472f-f787-4d6d-9d17-a4f70f9c750f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:52.081770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2472f-f787-4d6d-9d17-a4f70f9c750f service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:52.081770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2472f-f787-4d6d-9d17-a4f70f9c750f service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:52.081770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2472f-f787-4d6d-9d17-a4f70f9c750f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:52.089016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2472f-f787-4d6d-9d17-a4f70f9c750f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:52.090441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2472f-f787-4d6d-9d17-a4f70f9c750f service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:52.099165 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1375/2731] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:45:52 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:45:52.113722 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc8090-e144-4e4c-a131-5732f8dc5469 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:52.177932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc8090-e144-4e4c-a131-5732f8dc5469 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:52.188110 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce57f8-9910-406c-95a4-7811f85c67f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:52.188351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce57f8-9910-406c-95a4-7811f85c67f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:52.188545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce57f8-9910-406c-95a4-7811f85c67f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:52.188886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce57f8-9910-406c-95a4-7811f85c67f2 admin admin] PATH_INFO: `/v3/users/2e148f8aa00f432cb224dd9f640d1924` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:52.190738 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce57f8-9910-406c-95a4-7811f85c67f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e148f8aa00f432cb224dd9f640d1924)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:52.192667 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce57f8-9910-406c-95a4-7811f85c67f2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:52.435303 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3ce57f8-9910-406c-95a4-7811f85c67f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e148f8aa00f432cb224dd9f640d1924'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:52.535225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3ce57f8-9910-406c-95a4-7811f85c67f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e148f8aa00f432cb224dd9f640d1924'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:52.542976 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3ce57f8-9910-406c-95a4-7811f85c67f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e148f8aa00f432cb224dd9f640d1924'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:52.559020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3ce57f8-9910-406c-95a4-7811f85c67f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e148f8aa00f432cb224dd9f640d1924'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:52.559778 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3ce57f8-9910-406c-95a4-7811f85c67f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e148f8aa00f432cb224dd9f640d1924'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:52.566561 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1357/2732] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:45:52 2022] DELETE /identity/v3/users/2e148f8aa00f432cb224dd9f640d1924 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:52.571103 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591d909-25eb-4f63-b07e-7d49dc416844 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:52.571386 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591d909-25eb-4f63-b07e-7d49dc416844 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:52.571655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591d909-25eb-4f63-b07e-7d49dc416844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:52.589178 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3591d909-25eb-4f63-b07e-7d49dc416844 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:52.590405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3591d909-25eb-4f63-b07e-7d49dc416844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:52.662335 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1376/2733] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:52.672594 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce57f8-9910-406c-95a4-7811f85c67f2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:52.674705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c3ce57f8-9910-406c-95a4-7811f85c67f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:52.687625 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:52.746985 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce57f8-9910-406c-95a4-7811f85c67f2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:52.750968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c1639-706a-4846-a453-a82676c7fa9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:52.751629 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c1639-706a-4846-a453-a82676c7fa9a service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:52.759989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c1639-706a-4846-a453-a82676c7fa9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:52.759989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c1639-706a-4846-a453-a82676c7fa9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:52.764249 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c1639-706a-4846-a453-a82676c7fa9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:52.765781 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c1639-706a-4846-a453-a82676c7fa9a service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:52.776345 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1358/2734] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:45:53.287830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591d909-25eb-4f63-b07e-7d49dc416844 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:53.291274 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3591d909-25eb-4f63-b07e-7d49dc416844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:53.304066 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591d909-25eb-4f63-b07e-7d49dc416844 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:53.309301 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edf9dc-15d0-4afa-8492-94249ab47e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:53.310175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edf9dc-15d0-4afa-8492-94249ab47e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:53.310450 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edf9dc-15d0-4afa-8492-94249ab47e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:53.310744 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edf9dc-15d0-4afa-8492-94249ab47e8c admin admin] PATH_INFO: `/v3/projects/c826ef0d208e48898de2163c2486db9b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:53.311940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edf9dc-15d0-4afa-8492-94249ab47e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c826ef0d208e48898de2163c2486db9b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:53.314011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edf9dc-15d0-4afa-8492-94249ab47e8c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:53.424582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-50edf9dc-15d0-4afa-8492-94249ab47e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c826ef0d208e48898de2163c2486db9b', 'request_id': 'req-50edf9dc-15d0-4afa-8492-94249ab47e8c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:53.522200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-50edf9dc-15d0-4afa-8492-94249ab47e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c826ef0d208e48898de2163c2486db9b', 'request_id': 'req-50edf9dc-15d0-4afa-8492-94249ab47e8c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:53.528538 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-50edf9dc-15d0-4afa-8492-94249ab47e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c826ef0d208e48898de2163c2486db9b', 'request_id': 'req-50edf9dc-15d0-4afa-8492-94249ab47e8c'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:53.540529 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-50edf9dc-15d0-4afa-8492-94249ab47e8c admin admin] The token cache is being invalidate because project c826ef0d208e48898de2163c2486db9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:45:53.540940 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-50edf9dc-15d0-4afa-8492-94249ab47e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:53.541576 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-50edf9dc-15d0-4afa-8492-94249ab47e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:45:53.543182 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1377/2735] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:45:53 2022] DELETE /identity/v3/projects/c826ef0d208e48898de2163c2486db9b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:53.548407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f99aa0-a160-456e-a47c-05ebf1c49fa0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:53.549553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f99aa0-a160-456e-a47c-05ebf1c49fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:53.549553 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f99aa0-a160-456e-a47c-05ebf1c49fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:53.570355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a1f99aa0-a160-456e-a47c-05ebf1c49fa0 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:53.571421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a1f99aa0-a160-456e-a47c-05ebf1c49fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:53.640512 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1359/2736] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:53.653627 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77f6b7-438c-4174-a46f-fe5ef7f7f1a3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:53.653920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77f6b7-438c-4174-a46f-fe5ef7f7f1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:53.654195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77f6b7-438c-4174-a46f-fe5ef7f7f1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:53.678189 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6b77f6b7-438c-4174-a46f-fe5ef7f7f1a3 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:53.679694 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6b77f6b7-438c-4174-a46f-fe5ef7f7f1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:53.688891 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1378/2737] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:53.693371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f99aa0-a160-456e-a47c-05ebf1c49fa0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:53.703494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f99aa0-a160-456e-a47c-05ebf1c49fa0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:53.708834 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee257d6-2b7d-4ee8-8a82-f526d91cf220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:53.709487 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee257d6-2b7d-4ee8-8a82-f526d91cf220 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:53.709916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee257d6-2b7d-4ee8-8a82-f526d91cf220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:53.710201 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee257d6-2b7d-4ee8-8a82-f526d91cf220 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:53.711021 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee257d6-2b7d-4ee8-8a82-f526d91cf220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:45:53.711324 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee257d6-2b7d-4ee8-8a82-f526d91cf220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:53.712972 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee257d6-2b7d-4ee8-8a82-f526d91cf220 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:53.726619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1360/2738] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:45:53.730771 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77f6b7-438c-4174-a46f-fe5ef7f7f1a3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:53.741589 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77f6b7-438c-4174-a46f-fe5ef7f7f1a3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:53.747057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b0e9a-7ac7-4b9b-be90-d70f9c536ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:53.747737 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b0e9a-7ac7-4b9b-be90-d70f9c536ebc admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:53.748018 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b0e9a-7ac7-4b9b-be90-d70f9c536ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:53.748289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b0e9a-7ac7-4b9b-be90-d70f9c536ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:53.748991 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b0e9a-7ac7-4b9b-be90-d70f9c536ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:53.750968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b0e9a-7ac7-4b9b-be90-d70f9c536ebc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:53.786090 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee257d6-2b7d-4ee8-8a82-f526d91cf220 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:53.788010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5ee257d6-2b7d-4ee8-8a82-f526d91cf220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:53.854465 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee257d6-2b7d-4ee8-8a82-f526d91cf220 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:53.858305 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9b23-173c-4da0-b633-06e1294f9563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:53.867893 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9b23-173c-4da0-b633-06e1294f9563 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:53.867893 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9b23-173c-4da0-b633-06e1294f9563 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:53.867893 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9b23-173c-4da0-b633-06e1294f9563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:53.867893 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-661b9b23-173c-4da0-b633-06e1294f9563 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:53.869327 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1379/2739] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:45:53 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:45:53.873379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b0e9a-7ac7-4b9b-be90-d70f9c536ebc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:53.878329 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:53.945238 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:53.947585 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b0e9a-7ac7-4b9b-be90-d70f9c536ebc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:53.952748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698c17b-aad8-472e-bd9b-cd35eac88a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:53.953642 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698c17b-aad8-472e-bd9b-cd35eac88a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:53.954175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698c17b-aad8-472e-bd9b-cd35eac88a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:53.954540 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698c17b-aad8-472e-bd9b-cd35eac88a60 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:53.956498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698c17b-aad8-472e-bd9b-cd35eac88a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:53.958570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698c17b-aad8-472e-bd9b-cd35eac88a60 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:53.991237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b9b23-173c-4da0-b633-06e1294f9563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:53.992702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b9b23-173c-4da0-b633-06e1294f9563 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:54.013993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1361/2740] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:45:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:45:54.087089 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1380/2741] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:45:53 2022] POST /identity/v3/users => generated 284 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:45:54.091100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9b23-173c-4da0-b633-06e1294f9563 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:54.102908 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9b23-173c-4da0-b633-06e1294f9563 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:54.107707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb215d-0977-4b5f-8952-39800d9f5cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:54.108455 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb215d-0977-4b5f-8952-39800d9f5cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:54.108944 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb215d-0977-4b5f-8952-39800d9f5cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:54.109289 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb215d-0977-4b5f-8952-39800d9f5cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:54.110098 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb215d-0977-4b5f-8952-39800d9f5cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:54.112413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb215d-0977-4b5f-8952-39800d9f5cfd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:54.123897 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1362/2742] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:45:54.133477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698c17b-aad8-472e-bd9b-cd35eac88a60 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:54.143754 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698c17b-aad8-472e-bd9b-cd35eac88a60 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:54.148479 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e8072-7854-4f32-9fe2-a674fe50fc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:54.149130 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8072-7854-4f32-9fe2-a674fe50fc71 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:54.149405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8072-7854-4f32-9fe2-a674fe50fc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:54.149667 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8072-7854-4f32-9fe2-a674fe50fc71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:54.150427 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e8072-7854-4f32-9fe2-a674fe50fc71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:54.152063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e8072-7854-4f32-9fe2-a674fe50fc71 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:54.162704 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1381/2743] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:45:54.166877 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb215d-0977-4b5f-8952-39800d9f5cfd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:54.178708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb215d-0977-4b5f-8952-39800d9f5cfd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:54.183765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7040758-de54-43fd-9a9a-4e2f714618a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:54.184688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7040758-de54-43fd-9a9a-4e2f714618a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:54.184960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7040758-de54-43fd-9a9a-4e2f714618a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:54.185225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7040758-de54-43fd-9a9a-4e2f714618a0 admin admin] PATH_INFO: `/v3/projects/20799a8f8a7843bfb91323bacce7c2be/users/b07ba8126db844f7b50c8580aa6a5a70/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:54.327822 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7040758-de54-43fd-9a9a-4e2f714618a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20799a8f8a7843bfb91323bacce7c2be, user_id=b07ba8126db844f7b50c8580aa6a5a70, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:54.330667 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7040758-de54-43fd-9a9a-4e2f714618a0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:54.474232 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1363/2744] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:45:54 2022] PUT /identity/v3/projects/20799a8f8a7843bfb91323bacce7c2be/users/b07ba8126db844f7b50c8580aa6a5a70/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:45:54.486231 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0afee-294c-4d27-ba13-02052964572b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:54.487532 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0afee-294c-4d27-ba13-02052964572b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:54.487699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0afee-294c-4d27-ba13-02052964572b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:54.522367 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3ab0afee-294c-4d27-ba13-02052964572b None None] MFA Rules not processed for user `b07ba8126db844f7b50c8580aa6a5a70`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:45:54.523797 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3ab0afee-294c-4d27-ba13-02052964572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:54.605248 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1382/2745] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:45:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:45:54.619069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7040758-de54-43fd-9a9a-4e2f714618a0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:54.620926 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c7040758-de54-43fd-9a9a-4e2f714618a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:54.683225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7040758-de54-43fd-9a9a-4e2f714618a0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:54.686791 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4087a-b1c6-40a7-8f43-adea91a44609 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc7e1bc2eb943eba57a0009635de70d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:54.687432 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4087a-b1c6-40a7-8f43-adea91a44609 service glance] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:54.687710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4087a-b1c6-40a7-8f43-adea91a44609 service glance] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:54.687982 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4087a-b1c6-40a7-8f43-adea91a44609 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:54.697066 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4087a-b1c6-40a7-8f43-adea91a44609 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:54.698495 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4087a-b1c6-40a7-8f43-adea91a44609 service glance] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:54.708261 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1364/2746] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:45:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:45:56.538475 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0afee-294c-4d27-ba13-02052964572b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:45:56.592854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0afee-294c-4d27-ba13-02052964572b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:45:56.597483 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655498c4-9174-480e-b72c-3b04277ff5e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:45:56.598152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655498c4-9174-480e-b72c-3b04277ff5e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:45:56.598420 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655498c4-9174-480e-b72c-3b04277ff5e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:45:56.598758 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655498c4-9174-480e-b72c-3b04277ff5e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:45:56.600569 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-655498c4-9174-480e-b72c-3b04277ff5e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:45:56.630783 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:45:56.680582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655498c4-9174-480e-b72c-3b04277ff5e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:45:56.682048 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655498c4-9174-480e-b72c-3b04277ff5e0 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:45:56.694752 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1383/2747] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:45:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:46:04.703419 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=62,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:46:06.760052 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=22 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:46:20.793082 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4087a-b1c6-40a7-8f43-adea91a44609 service glance] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:20.859312 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4087a-b1c6-40a7-8f43-adea91a44609 service glance] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:20.863955 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaa848-8f90-41ab-8b63-67a7d3c86c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:20.864845 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaa848-8f90-41ab-8b63-67a7d3c86c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:20.865125 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaa848-8f90-41ab-8b63-67a7d3c86c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:20.865398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaa848-8f90-41ab-8b63-67a7d3c86c6b admin admin] PATH_INFO: `/v3/users/b07ba8126db844f7b50c8580aa6a5a70` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:20.866634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaa848-8f90-41ab-8b63-67a7d3c86c6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07ba8126db844f7b50c8580aa6a5a70)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:20.868588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaa848-8f90-41ab-8b63-67a7d3c86c6b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:21.047240 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1aaaa848-8f90-41ab-8b63-67a7d3c86c6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07ba8126db844f7b50c8580aa6a5a70'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:21.102454 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1aaaa848-8f90-41ab-8b63-67a7d3c86c6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07ba8126db844f7b50c8580aa6a5a70'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:21.109905 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1aaaa848-8f90-41ab-8b63-67a7d3c86c6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07ba8126db844f7b50c8580aa6a5a70'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:21.121830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1aaaa848-8f90-41ab-8b63-67a7d3c86c6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07ba8126db844f7b50c8580aa6a5a70'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:21.122488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1aaaa848-8f90-41ab-8b63-67a7d3c86c6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07ba8126db844f7b50c8580aa6a5a70'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:21.128586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1365/2748] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:46:20 2022] DELETE /identity/v3/users/b07ba8126db844f7b50c8580aa6a5a70 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:46:21.133369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf840c12-9451-4898-b031-16b7ecfec1e2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:21.133913 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf840c12-9451-4898-b031-16b7ecfec1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:21.133913 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf840c12-9451-4898-b031-16b7ecfec1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:21.152813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bf840c12-9451-4898-b031-16b7ecfec1e2 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:46:21.154022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bf840c12-9451-4898-b031-16b7ecfec1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:21.211995 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1384/2749] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:46:21.222223 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaa848-8f90-41ab-8b63-67a7d3c86c6b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:21.223656 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1aaaa848-8f90-41ab-8b63-67a7d3c86c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:21.281461 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaa848-8f90-41ab-8b63-67a7d3c86c6b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:21.285211 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a549f6-b31a-4cc4-9106-c82f1e61d17f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:21.285866 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a549f6-b31a-4cc4-9106-c82f1e61d17f service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:21.286149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a549f6-b31a-4cc4-9106-c82f1e61d17f service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:21.286417 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a549f6-b31a-4cc4-9106-c82f1e61d17f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:21.297105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a549f6-b31a-4cc4-9106-c82f1e61d17f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:21.298541 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a549f6-b31a-4cc4-9106-c82f1e61d17f service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:21.308236 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1366/2750] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:46:21.715626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf840c12-9451-4898-b031-16b7ecfec1e2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:21.719708 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bf840c12-9451-4898-b031-16b7ecfec1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:21.730531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf840c12-9451-4898-b031-16b7ecfec1e2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:21.735486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39530cf-c71a-4ae0-be22-5bb80de47d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:21.736320 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39530cf-c71a-4ae0-be22-5bb80de47d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:21.736624 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39530cf-c71a-4ae0-be22-5bb80de47d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:21.736973 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39530cf-c71a-4ae0-be22-5bb80de47d92 admin admin] PATH_INFO: `/v3/projects/20799a8f8a7843bfb91323bacce7c2be` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:21.738248 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39530cf-c71a-4ae0-be22-5bb80de47d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20799a8f8a7843bfb91323bacce7c2be)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:21.740251 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39530cf-c71a-4ae0-be22-5bb80de47d92 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:21.858773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d39530cf-c71a-4ae0-be22-5bb80de47d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20799a8f8a7843bfb91323bacce7c2be', 'request_id': 'req-d39530cf-c71a-4ae0-be22-5bb80de47d92'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:21.914447 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d39530cf-c71a-4ae0-be22-5bb80de47d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20799a8f8a7843bfb91323bacce7c2be', 'request_id': 'req-d39530cf-c71a-4ae0-be22-5bb80de47d92'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:21.921459 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d39530cf-c71a-4ae0-be22-5bb80de47d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20799a8f8a7843bfb91323bacce7c2be', 'request_id': 'req-d39530cf-c71a-4ae0-be22-5bb80de47d92'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:21.933629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d39530cf-c71a-4ae0-be22-5bb80de47d92 admin admin] The token cache is being invalidate because project 20799a8f8a7843bfb91323bacce7c2be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:46:21.933912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d39530cf-c71a-4ae0-be22-5bb80de47d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:21.934565 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d39530cf-c71a-4ae0-be22-5bb80de47d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:21.936150 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1385/2751] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:46:21 2022] DELETE /identity/v3/projects/20799a8f8a7843bfb91323bacce7c2be => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:46:21.941210 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb6a9d-222c-4c47-9949-765ea2e3d44d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:21.941686 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb6a9d-222c-4c47-9949-765ea2e3d44d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:21.941790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb6a9d-222c-4c47-9949-765ea2e3d44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:21.959699 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-eeeb6a9d-222c-4c47-9949-765ea2e3d44d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:46:21.960826 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eeeb6a9d-222c-4c47-9949-765ea2e3d44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:21.978047 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:46:22.021020 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1367/2752] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:46:22.029446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69f8f2-8668-4650-9205-183503f5c053 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:22.029733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69f8f2-8668-4650-9205-183503f5c053 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:22.030007 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69f8f2-8668-4650-9205-183503f5c053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:22.048988 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8d69f8f2-8668-4650-9205-183503f5c053 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:46:22.051369 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8d69f8f2-8668-4650-9205-183503f5c053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:22.058279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1386/2753] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:46:22.063522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb6a9d-222c-4c47-9949-765ea2e3d44d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:22.073245 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb6a9d-222c-4c47-9949-765ea2e3d44d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:22.079355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e682c-1493-42fd-ad31-a9f71a00aca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:22.080018 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e682c-1493-42fd-ad31-a9f71a00aca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:22.080299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e682c-1493-42fd-ad31-a9f71a00aca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:22.080574 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e682c-1493-42fd-ad31-a9f71a00aca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:22.081334 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e682c-1493-42fd-ad31-a9f71a00aca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:46:22.081689 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e682c-1493-42fd-ad31-a9f71a00aca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:22.083370 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e682c-1493-42fd-ad31-a9f71a00aca9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:22.096109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1368/2754] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:46:22.100448 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69f8f2-8668-4650-9205-183503f5c053 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:22.110385 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69f8f2-8668-4650-9205-183503f5c053 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:22.115164 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bffbaa-0b79-497f-a7d7-a28be60af04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:22.115813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bffbaa-0b79-497f-a7d7-a28be60af04f admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:22.116097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bffbaa-0b79-497f-a7d7-a28be60af04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:22.116389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bffbaa-0b79-497f-a7d7-a28be60af04f admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:22.117060 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bffbaa-0b79-497f-a7d7-a28be60af04f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:22.119022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bffbaa-0b79-497f-a7d7-a28be60af04f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:22.210102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1387/2755] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:46:22 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:46:22.215076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e682c-1493-42fd-ad31-a9f71a00aca9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:22.225322 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e682c-1493-42fd-ad31-a9f71a00aca9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:22.284929 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc84dbb-1140-4050-bbc7-61ebfbeef1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:22.285739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc84dbb-1140-4050-bbc7-61ebfbeef1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:22.286050 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc84dbb-1140-4050-bbc7-61ebfbeef1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:22.286333 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc84dbb-1140-4050-bbc7-61ebfbeef1c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:22.287189 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc84dbb-1140-4050-bbc7-61ebfbeef1c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:22.289936 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc84dbb-1140-4050-bbc7-61ebfbeef1c4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:22.363025 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1369/2756] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:46:22 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:46:22.371321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bffbaa-0b79-497f-a7d7-a28be60af04f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:22.383917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bffbaa-0b79-497f-a7d7-a28be60af04f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:22.383917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c091b2d-f0c7-40f4-a1a1-fbfeef670f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:22.383917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c091b2d-f0c7-40f4-a1a1-fbfeef670f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:22.383917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c091b2d-f0c7-40f4-a1a1-fbfeef670f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:22.384343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c091b2d-f0c7-40f4-a1a1-fbfeef670f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:22.384772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c091b2d-f0c7-40f4-a1a1-fbfeef670f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:22.387065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c091b2d-f0c7-40f4-a1a1-fbfeef670f60 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:22.397657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1388/2757] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:46:22.402876 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc84dbb-1140-4050-bbc7-61ebfbeef1c4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:22.413365 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc84dbb-1140-4050-bbc7-61ebfbeef1c4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:22.424087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee92fa-3238-474d-bd46-a0f0bd4c75de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:22.424087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee92fa-3238-474d-bd46-a0f0bd4c75de admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:22.424087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee92fa-3238-474d-bd46-a0f0bd4c75de admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:22.424087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee92fa-3238-474d-bd46-a0f0bd4c75de admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:22.424518 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee92fa-3238-474d-bd46-a0f0bd4c75de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:22.424518 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee92fa-3238-474d-bd46-a0f0bd4c75de admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:22.433601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1370/2758] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:46:22.437746 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c091b2d-f0c7-40f4-a1a1-fbfeef670f60 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:22.448803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c091b2d-f0c7-40f4-a1a1-fbfeef670f60 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:22.453498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb372a56-4c03-46e1-b9f5-daff9c9ba1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:22.454465 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb372a56-4c03-46e1-b9f5-daff9c9ba1cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:22.454838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb372a56-4c03-46e1-b9f5-daff9c9ba1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:22.455155 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb372a56-4c03-46e1-b9f5-daff9c9ba1cb admin admin] PATH_INFO: `/v3/projects/550cf4856bb64705b84b76969e60811a/users/9870490e013245eea1a80a304b5c016d/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:22.472292 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb372a56-4c03-46e1-b9f5-daff9c9ba1cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=550cf4856bb64705b84b76969e60811a, user_id=9870490e013245eea1a80a304b5c016d, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:22.475258 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb372a56-4c03-46e1-b9f5-daff9c9ba1cb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:22.542817 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1389/2759] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:46:22 2022] PUT /identity/v3/projects/550cf4856bb64705b84b76969e60811a/users/9870490e013245eea1a80a304b5c016d/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:46:22.554183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ade33-1308-4fbe-994d-9516f1e9ef0a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:22.555903 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ade33-1308-4fbe-994d-9516f1e9ef0a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:22.555903 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ade33-1308-4fbe-994d-9516f1e9ef0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:22.582375 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0a8ade33-1308-4fbe-994d-9516f1e9ef0a None None] MFA Rules not processed for user `9870490e013245eea1a80a304b5c016d`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:46:22.583615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0a8ade33-1308-4fbe-994d-9516f1e9ef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:22.651187 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1371/2760] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:46:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:46:22.662626 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb372a56-4c03-46e1-b9f5-daff9c9ba1cb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:22.668673 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-eb372a56-4c03-46e1-b9f5-daff9c9ba1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:22.687758 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:46:22.725095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb372a56-4c03-46e1-b9f5-daff9c9ba1cb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:22.729389 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d5725-d1dd-46b4-be42-847a063da562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:22.730045 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d5725-d1dd-46b4-be42-847a063da562 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:22.730325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d5725-d1dd-46b4-be42-847a063da562 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:22.730606 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d5725-d1dd-46b4-be42-847a063da562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:22.739290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d5725-d1dd-46b4-be42-847a063da562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:22.740728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d5725-d1dd-46b4-be42-847a063da562 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:22.750009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1390/2761] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:46:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:46:22.774736 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ade33-1308-4fbe-994d-9516f1e9ef0a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:22.794917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:46:22.839617 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ade33-1308-4fbe-994d-9516f1e9ef0a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:22.844393 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84aade-d09b-491a-9119-beea9b39a80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:22.845264 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84aade-d09b-491a-9119-beea9b39a80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:22.845537 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84aade-d09b-491a-9119-beea9b39a80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:22.845801 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84aade-d09b-491a-9119-beea9b39a80c admin admin] PATH_INFO: `/v3/users/9870490e013245eea1a80a304b5c016d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:22.847084 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84aade-d09b-491a-9119-beea9b39a80c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9870490e013245eea1a80a304b5c016d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:22.849015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84aade-d09b-491a-9119-beea9b39a80c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:23.048758 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4f84aade-d09b-491a-9119-beea9b39a80c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9870490e013245eea1a80a304b5c016d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:23.125395 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4f84aade-d09b-491a-9119-beea9b39a80c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9870490e013245eea1a80a304b5c016d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:23.133055 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4f84aade-d09b-491a-9119-beea9b39a80c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9870490e013245eea1a80a304b5c016d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:23.145588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4f84aade-d09b-491a-9119-beea9b39a80c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9870490e013245eea1a80a304b5c016d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:23.146283 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4f84aade-d09b-491a-9119-beea9b39a80c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9870490e013245eea1a80a304b5c016d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:23.153323 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1372/2762] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:46:22 2022] DELETE /identity/v3/users/9870490e013245eea1a80a304b5c016d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:46:23.158136 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac58621-2972-4a10-8811-2f88571c045e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:23.158464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac58621-2972-4a10-8811-2f88571c045e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:23.158841 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac58621-2972-4a10-8811-2f88571c045e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:23.176362 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-fac58621-2972-4a10-8811-2f88571c045e None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:46:23.177806 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fac58621-2972-4a10-8811-2f88571c045e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:23.246119 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1391/2763] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:46:23.256488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84aade-d09b-491a-9119-beea9b39a80c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:23.260809 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4f84aade-d09b-491a-9119-beea9b39a80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:23.320177 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84aade-d09b-491a-9119-beea9b39a80c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:23.323893 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a635ce-1056-4b89-809b-6994dc469bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:23.324535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a635ce-1056-4b89-809b-6994dc469bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:23.324810 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a635ce-1056-4b89-809b-6994dc469bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:23.325183 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a635ce-1056-4b89-809b-6994dc469bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:23.334267 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a635ce-1056-4b89-809b-6994dc469bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:23.335728 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a635ce-1056-4b89-809b-6994dc469bd1 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:23.345781 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1373/2764] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:46:23.813260 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac58621-2972-4a10-8811-2f88571c045e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:23.814790 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fac58621-2972-4a10-8811-2f88571c045e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:23.828477 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac58621-2972-4a10-8811-2f88571c045e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:23.834902 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2298d-75da-448f-a81f-5b8fa808db02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:23.834902 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2298d-75da-448f-a81f-5b8fa808db02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:23.835260 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2298d-75da-448f-a81f-5b8fa808db02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:23.835495 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2298d-75da-448f-a81f-5b8fa808db02 admin admin] PATH_INFO: `/v3/projects/550cf4856bb64705b84b76969e60811a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:23.836928 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2298d-75da-448f-a81f-5b8fa808db02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=550cf4856bb64705b84b76969e60811a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:23.839643 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2298d-75da-448f-a81f-5b8fa808db02 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:23.982081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ca2298d-75da-448f-a81f-5b8fa808db02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '550cf4856bb64705b84b76969e60811a', 'request_id': 'req-2ca2298d-75da-448f-a81f-5b8fa808db02'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:24.065228 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ca2298d-75da-448f-a81f-5b8fa808db02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '550cf4856bb64705b84b76969e60811a', 'request_id': 'req-2ca2298d-75da-448f-a81f-5b8fa808db02'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:24.071954 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ca2298d-75da-448f-a81f-5b8fa808db02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '550cf4856bb64705b84b76969e60811a', 'request_id': 'req-2ca2298d-75da-448f-a81f-5b8fa808db02'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:24.084234 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ca2298d-75da-448f-a81f-5b8fa808db02 admin admin] The token cache is being invalidate because project 550cf4856bb64705b84b76969e60811a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:46:24.084445 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ca2298d-75da-448f-a81f-5b8fa808db02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:24.085098 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2ca2298d-75da-448f-a81f-5b8fa808db02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:46:24.086655 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1392/2765] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:46:23 2022] DELETE /identity/v3/projects/550cf4856bb64705b84b76969e60811a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:46:24.092640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18692fe5-6cc0-4587-a54f-4ec818d51b66 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:24.096902 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18692fe5-6cc0-4587-a54f-4ec818d51b66 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:24.096902 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18692fe5-6cc0-4587-a54f-4ec818d51b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:24.111185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-18692fe5-6cc0-4587-a54f-4ec818d51b66 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:46:24.112372 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-18692fe5-6cc0-4587-a54f-4ec818d51b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:24.145896 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:46:24.170982 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1374/2766] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:46:24.178916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa66f2e-6f1f-4aa8-9a59-77b4540b52e2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:24.179235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa66f2e-6f1f-4aa8-9a59-77b4540b52e2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:24.179513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa66f2e-6f1f-4aa8-9a59-77b4540b52e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:24.198867 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-daa66f2e-6f1f-4aa8-9a59-77b4540b52e2 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:46:24.200083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-daa66f2e-6f1f-4aa8-9a59-77b4540b52e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:24.208881 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1393/2767] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:46:24.213854 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18692fe5-6cc0-4587-a54f-4ec818d51b66 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:24.224323 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18692fe5-6cc0-4587-a54f-4ec818d51b66 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:24.229943 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c84fd-4caa-4598-ae15-12209dcdc5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:24.230835 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c84fd-4caa-4598-ae15-12209dcdc5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:24.231313 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c84fd-4caa-4598-ae15-12209dcdc5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:24.231601 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c84fd-4caa-4598-ae15-12209dcdc5ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:24.232611 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c84fd-4caa-4598-ae15-12209dcdc5ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:46:24.232916 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c84fd-4caa-4598-ae15-12209dcdc5ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:24.234524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c84fd-4caa-4598-ae15-12209dcdc5ce admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:24.247614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1375/2768] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:46:24.252550 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa66f2e-6f1f-4aa8-9a59-77b4540b52e2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:24.262883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa66f2e-6f1f-4aa8-9a59-77b4540b52e2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:24.267511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce33eed-6599-4dad-bf2c-3779b27eb22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:24.268157 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce33eed-6599-4dad-bf2c-3779b27eb22e admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:24.268434 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce33eed-6599-4dad-bf2c-3779b27eb22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:24.268704 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce33eed-6599-4dad-bf2c-3779b27eb22e admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:24.269403 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce33eed-6599-4dad-bf2c-3779b27eb22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:24.271314 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce33eed-6599-4dad-bf2c-3779b27eb22e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:24.356494 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1394/2769] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:46:24 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:46:24.360688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c84fd-4caa-4598-ae15-12209dcdc5ce admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:24.371632 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c84fd-4caa-4598-ae15-12209dcdc5ce admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:24.430497 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a1090-c364-42c4-b28b-24a7e380bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:24.431265 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a1090-c364-42c4-b28b-24a7e380bb6b admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:24.431563 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a1090-c364-42c4-b28b-24a7e380bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:24.432479 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a1090-c364-42c4-b28b-24a7e380bb6b admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:24.433316 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a1090-c364-42c4-b28b-24a7e380bb6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:24.435466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a1090-c364-42c4-b28b-24a7e380bb6b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:24.525924 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1376/2770] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:46:24 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:46:24.530015 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce33eed-6599-4dad-bf2c-3779b27eb22e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:24.540470 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce33eed-6599-4dad-bf2c-3779b27eb22e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:24.545321 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bd736-eac8-46bc-969b-c0a850178dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:24.545993 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bd736-eac8-46bc-969b-c0a850178dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:24.546379 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bd736-eac8-46bc-969b-c0a850178dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:24.546666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bd736-eac8-46bc-969b-c0a850178dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:24.547425 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bd736-eac8-46bc-969b-c0a850178dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:24.549016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bd736-eac8-46bc-969b-c0a850178dd1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:24.560712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1395/2771] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:46:24.564666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a1090-c364-42c4-b28b-24a7e380bb6b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:24.576317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a1090-c364-42c4-b28b-24a7e380bb6b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:24.581163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf50821-8bc2-48b9-b65e-c94235c48f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:24.581789 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf50821-8bc2-48b9-b65e-c94235c48f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:24.582073 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf50821-8bc2-48b9-b65e-c94235c48f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:24.582352 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf50821-8bc2-48b9-b65e-c94235c48f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:24.583244 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf50821-8bc2-48b9-b65e-c94235c48f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:24.584851 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf50821-8bc2-48b9-b65e-c94235c48f13 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:24.595418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1377/2772] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:46:24.599614 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bd736-eac8-46bc-969b-c0a850178dd1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:24.610565 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bd736-eac8-46bc-969b-c0a850178dd1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:24.615324 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef635c78-b07b-44ef-9415-06965aceb9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:24.616212 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef635c78-b07b-44ef-9415-06965aceb9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:24.616490 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef635c78-b07b-44ef-9415-06965aceb9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:24.616765 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef635c78-b07b-44ef-9415-06965aceb9ae admin admin] PATH_INFO: `/v3/projects/b5736f1dad06412583f224f6229c0acf/users/e682fc08a23045e2ac331dbe97a71b29/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:24.619931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:46:24.638241 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef635c78-b07b-44ef-9415-06965aceb9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5736f1dad06412583f224f6229c0acf, user_id=e682fc08a23045e2ac331dbe97a71b29, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:24.641070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef635c78-b07b-44ef-9415-06965aceb9ae admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:24.717017 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1396/2773] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:46:24 2022] PUT /identity/v3/projects/b5736f1dad06412583f224f6229c0acf/users/e682fc08a23045e2ac331dbe97a71b29/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:46:24.722187 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f1fcf-7078-416a-85d4-a770e822cef2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:24.722478 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f1fcf-7078-416a-85d4-a770e822cef2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:24.722807 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f1fcf-7078-416a-85d4-a770e822cef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:24.741952 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-766f1fcf-7078-416a-85d4-a770e822cef2 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:46:24.743197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-766f1fcf-7078-416a-85d4-a770e822cef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:24.803109 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1378/2774] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:46:24.813422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef635c78-b07b-44ef-9415-06965aceb9ae admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:24.815442 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ef635c78-b07b-44ef-9415-06965aceb9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:24.874219 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef635c78-b07b-44ef-9415-06965aceb9ae admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:24.878088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32cfd6-6082-44e3-bbe0-e3f6012b4213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:24.878770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32cfd6-6082-44e3-bbe0-e3f6012b4213 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:24.879054 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32cfd6-6082-44e3-bbe0-e3f6012b4213 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:24.879352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32cfd6-6082-44e3-bbe0-e3f6012b4213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:24.889883 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32cfd6-6082-44e3-bbe0-e3f6012b4213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:24.891365 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32cfd6-6082-44e3-bbe0-e3f6012b4213 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:24.901547 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1397/2775] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:46:30.651471 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0504f3-1076-441c-ba96-0c75dcd71b38 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:30.654842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0504f3-1076-441c-ba96-0c75dcd71b38 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:30.654842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0504f3-1076-441c-ba96-0c75dcd71b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:30.683731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-dd0504f3-1076-441c-ba96-0c75dcd71b38 None None] MFA Rules not processed for user `e682fc08a23045e2ac331dbe97a71b29`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:46:30.685325 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dd0504f3-1076-441c-ba96-0c75dcd71b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:30.732262 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:46:30.767280 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1379/2776] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:46:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:46:30.772244 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32cfd6-6082-44e3-bbe0-e3f6012b4213 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:30.783773 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32cfd6-6082-44e3-bbe0-e3f6012b4213 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:30.788607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee5290-ece6-4b74-b12e-f8e1212cd970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:30.789360 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee5290-ece6-4b74-b12e-f8e1212cd970 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:30.789701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee5290-ece6-4b74-b12e-f8e1212cd970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:30.790037 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee5290-ece6-4b74-b12e-f8e1212cd970 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:30.790861 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee5290-ece6-4b74-b12e-f8e1212cd970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:30.794036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee5290-ece6-4b74-b12e-f8e1212cd970 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:30.890170 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1398/2777] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:46:30 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:46:30.893536 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0504f3-1076-441c-ba96-0c75dcd71b38 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:30.915247 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0504f3-1076-441c-ba96-0c75dcd71b38 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:30.993849 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cd4a6-e3ff-4f84-a0d6-8673aa1c4878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:30.995752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cd4a6-e3ff-4f84-a0d6-8673aa1c4878 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:30.995752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cd4a6-e3ff-4f84-a0d6-8673aa1c4878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:30.996205 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cd4a6-e3ff-4f84-a0d6-8673aa1c4878 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:30.996986 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cd4a6-e3ff-4f84-a0d6-8673aa1c4878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:30.998900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cd4a6-e3ff-4f84-a0d6-8673aa1c4878 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:31.089141 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1380/2778] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:46:30 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:46:31.094657 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee5290-ece6-4b74-b12e-f8e1212cd970 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:31.105824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee5290-ece6-4b74-b12e-f8e1212cd970 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:31.111527 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3c0f7-9c90-4393-a13d-7f7b69d8c1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:31.112267 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3c0f7-9c90-4393-a13d-7f7b69d8c1ef admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:31.112600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3c0f7-9c90-4393-a13d-7f7b69d8c1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:31.112806 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3c0f7-9c90-4393-a13d-7f7b69d8c1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:31.113525 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3c0f7-9c90-4393-a13d-7f7b69d8c1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:31.115207 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3c0f7-9c90-4393-a13d-7f7b69d8c1ef admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:31.128421 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1399/2779] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:46:31.133969 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cd4a6-e3ff-4f84-a0d6-8673aa1c4878 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:31.148497 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cd4a6-e3ff-4f84-a0d6-8673aa1c4878 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:31.154766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7c0f3-1d68-4c93-9275-8f39c1e125aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:31.155774 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7c0f3-1d68-4c93-9275-8f39c1e125aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:31.156059 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7c0f3-1d68-4c93-9275-8f39c1e125aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:31.156435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7c0f3-1d68-4c93-9275-8f39c1e125aa admin admin] PATH_INFO: `/v3/projects/6f33b0c25f4d4558b90b12c41a4401c1/users/fae6599bd47848c28e0f0112427b9a7d/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:31.175689 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7c0f3-1d68-4c93-9275-8f39c1e125aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f33b0c25f4d4558b90b12c41a4401c1, user_id=fae6599bd47848c28e0f0112427b9a7d, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:31.178582 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7c0f3-1d68-4c93-9275-8f39c1e125aa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:31.286344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1381/2780] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:46:31 2022] PUT /identity/v3/projects/6f33b0c25f4d4558b90b12c41a4401c1/users/fae6599bd47848c28e0f0112427b9a7d/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:46:31.290780 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3c0f7-9c90-4393-a13d-7f7b69d8c1ef admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:31.304959 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3c0f7-9c90-4393-a13d-7f7b69d8c1ef admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:31.365742 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0ebb9-930a-4028-8632-2d375285c64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:31.366660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0ebb9-930a-4028-8632-2d375285c64f admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:31.366660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0ebb9-930a-4028-8632-2d375285c64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:31.366660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0ebb9-930a-4028-8632-2d375285c64f admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:31.366660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0ebb9-930a-4028-8632-2d375285c64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:31.366660 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0ebb9-930a-4028-8632-2d375285c64f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:31.381829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1400/2781] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:46:31.388282 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7c0f3-1d68-4c93-9275-8f39c1e125aa admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:31.406830 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7c0f3-1d68-4c93-9275-8f39c1e125aa admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:31.411634 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e2295-e56a-455c-a5ba-cdd8a8060cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:31.412552 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e2295-e56a-455c-a5ba-cdd8a8060cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:31.412828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e2295-e56a-455c-a5ba-cdd8a8060cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:31.413093 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e2295-e56a-455c-a5ba-cdd8a8060cc0 admin admin] PATH_INFO: `/v3/projects/6f33b0c25f4d4558b90b12c41a4401c1/users/fae6599bd47848c28e0f0112427b9a7d/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:31.416053 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e2295-e56a-455c-a5ba-cdd8a8060cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f33b0c25f4d4558b90b12c41a4401c1, user_id=fae6599bd47848c28e0f0112427b9a7d, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:31.419622 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e2295-e56a-455c-a5ba-cdd8a8060cc0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:31.437456 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1382/2782] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:46:31 2022] PUT /identity/v3/projects/6f33b0c25f4d4558b90b12c41a4401c1/users/fae6599bd47848c28e0f0112427b9a7d/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:46:37.315968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72e349-0a10-47c8-bb15-61e36402c46b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:37.316436 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72e349-0a10-47c8-bb15-61e36402c46b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:37.316556 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72e349-0a10-47c8-bb15-61e36402c46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:37.347740 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1b72e349-0a10-47c8-bb15-61e36402c46b None None] MFA Rules not processed for user `fae6599bd47848c28e0f0112427b9a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:46:37.349071 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1b72e349-0a10-47c8-bb15-61e36402c46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:37.395291 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:46:37.471029 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1401/2783] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:46:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:46:37.496212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e2295-e56a-455c-a5ba-cdd8a8060cc0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:37.498464 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8b9e2295-e56a-455c-a5ba-cdd8a8060cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:37.591555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e2295-e56a-455c-a5ba-cdd8a8060cc0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:37.597470 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4422355-7a11-43e9-942f-d8215ab5c794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:37.598188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4422355-7a11-43e9-942f-d8215ab5c794 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:37.598410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4422355-7a11-43e9-942f-d8215ab5c794 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:37.598735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4422355-7a11-43e9-942f-d8215ab5c794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:37.628453 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:46:37.664147 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4422355-7a11-43e9-942f-d8215ab5c794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:37.665696 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4422355-7a11-43e9-942f-d8215ab5c794 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:37.675935 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1383/2784] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:46:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:46:40.292755 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39696154-3f8a-4502-9252-f1cdcb511da0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:40.293274 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39696154-3f8a-4502-9252-f1cdcb511da0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:40.293400 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39696154-3f8a-4502-9252-f1cdcb511da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:40.310571 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-39696154-3f8a-4502-9252-f1cdcb511da0 None None] MFA Rules not processed for user `e682fc08a23045e2ac331dbe97a71b29`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:46:40.311828 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-39696154-3f8a-4502-9252-f1cdcb511da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:40.318692 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1402/2785] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:46:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:46:47.716451 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=16 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:46:50.305332 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=15 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:46:55.162995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4422355-7a11-43e9-942f-d8215ab5c794 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:55.164442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a4422355-7a11-43e9-942f-d8215ab5c794 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:55.229065 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4422355-7a11-43e9-942f-d8215ab5c794 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:55.233606 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501355cf-fa9f-4647-882e-ec90acef5d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:55.238421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501355cf-fa9f-4647-882e-ec90acef5d20 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:55.238421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501355cf-fa9f-4647-882e-ec90acef5d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:55.238421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501355cf-fa9f-4647-882e-ec90acef5d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:55.238421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-501355cf-fa9f-4647-882e-ec90acef5d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:55.247950 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501355cf-fa9f-4647-882e-ec90acef5d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:55.249446 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501355cf-fa9f-4647-882e-ec90acef5d20 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:55.259399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1384/2786] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:46:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:46:56.299501 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39696154-3f8a-4502-9252-f1cdcb511da0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:56.301383 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-39696154-3f8a-4502-9252-f1cdcb511da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:56.383662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39696154-3f8a-4502-9252-f1cdcb511da0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:56.393640 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89143f15-a0a1-4cb4-b4ac-8ee8fc2c765a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc616ed904d43d2b160b8d2766f7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:56.394348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89143f15-a0a1-4cb4-b4ac-8ee8fc2c765a service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:56.394586 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89143f15-a0a1-4cb4-b4ac-8ee8fc2c765a service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:56.394996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89143f15-a0a1-4cb4-b4ac-8ee8fc2c765a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:56.396762 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-89143f15-a0a1-4cb4-b4ac-8ee8fc2c765a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:56.410652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89143f15-a0a1-4cb4-b4ac-8ee8fc2c765a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:56.412569 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89143f15-a0a1-4cb4-b4ac-8ee8fc2c765a service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:56.423711 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1403/2787] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:46:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:46:58.729790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501355cf-fa9f-4647-882e-ec90acef5d20 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:46:58.731314 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-501355cf-fa9f-4647-882e-ec90acef5d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:58.754710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501355cf-fa9f-4647-882e-ec90acef5d20 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:46:58.761145 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badad004-b7d6-4847-861a-28232db47798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:46:58.765977 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badad004-b7d6-4847-861a-28232db47798 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:46:58.766288 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badad004-b7d6-4847-861a-28232db47798 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:46:58.766498 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badad004-b7d6-4847-861a-28232db47798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:46:58.769664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-badad004-b7d6-4847-861a-28232db47798 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:46:58.784400 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badad004-b7d6-4847-861a-28232db47798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:46:58.789848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badad004-b7d6-4847-861a-28232db47798 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:46:58.798904 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1385/2788] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:46:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:47:00.216759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89143f15-a0a1-4cb4-b4ac-8ee8fc2c765a service placement] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:00.228218 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89143f15-a0a1-4cb4-b4ac-8ee8fc2c765a service placement] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:00.235236 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53969131-3dce-42d2-8f8d-f86f410ea040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:00.236600 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53969131-3dce-42d2-8f8d-f86f410ea040 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:00.236982 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53969131-3dce-42d2-8f8d-f86f410ea040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:00.237421 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53969131-3dce-42d2-8f8d-f86f410ea040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:00.239622 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-53969131-3dce-42d2-8f8d-f86f410ea040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:00.254833 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53969131-3dce-42d2-8f8d-f86f410ea040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:00.256422 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53969131-3dce-42d2-8f8d-f86f410ea040 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:00.268770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1404/2789] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:47:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:47:07.701650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badad004-b7d6-4847-861a-28232db47798 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:07.715620 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badad004-b7d6-4847-861a-28232db47798 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:07.721754 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b45fe-6d60-4d8a-9595-a6245ffdf7dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:07.722220 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b45fe-6d60-4d8a-9595-a6245ffdf7dc service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:07.722568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b45fe-6d60-4d8a-9595-a6245ffdf7dc service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:07.722951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b45fe-6d60-4d8a-9595-a6245ffdf7dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:07.724845 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-333b45fe-6d60-4d8a-9595-a6245ffdf7dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:07.740593 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b45fe-6d60-4d8a-9595-a6245ffdf7dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:07.742698 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b45fe-6d60-4d8a-9595-a6245ffdf7dc service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:07.756059 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1386/2790] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:47:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:47:09.828034 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53969131-3dce-42d2-8f8d-f86f410ea040 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:09.829480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-53969131-3dce-42d2-8f8d-f86f410ea040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:09.898331 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53969131-3dce-42d2-8f8d-f86f410ea040 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:09.902912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aaf57b-7d27-468b-9c02-e6b963335518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:09.903784 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aaf57b-7d27-468b-9c02-e6b963335518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:09.904055 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aaf57b-7d27-468b-9c02-e6b963335518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:09.906974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aaf57b-7d27-468b-9c02-e6b963335518 admin admin] PATH_INFO: `/v3/users/aa8989cc123649c9ae39499036eadd31` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:09.906974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aaf57b-7d27-468b-9c02-e6b963335518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa8989cc123649c9ae39499036eadd31)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:09.907441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aaf57b-7d27-468b-9c02-e6b963335518 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:10.160285 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-00aaf57b-7d27-468b-9c02-e6b963335518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa8989cc123649c9ae39499036eadd31'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:10.242485 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-00aaf57b-7d27-468b-9c02-e6b963335518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa8989cc123649c9ae39499036eadd31'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:10.243136 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-00aaf57b-7d27-468b-9c02-e6b963335518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa8989cc123649c9ae39499036eadd31'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:10.256550 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-00aaf57b-7d27-468b-9c02-e6b963335518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa8989cc123649c9ae39499036eadd31'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:10.261811 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:10.263886 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-00aaf57b-7d27-468b-9c02-e6b963335518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa8989cc123649c9ae39499036eadd31'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:10.271060 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1405/2791] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:47:09 2022] DELETE /identity/v3/users/aa8989cc123649c9ae39499036eadd31 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:47:10.520755 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b45fe-6d60-4d8a-9595-a6245ffdf7dc service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:10.531422 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b45fe-6d60-4d8a-9595-a6245ffdf7dc service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:10.603309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97264571-ec05-4313-85e4-3f39c8bb2ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:10.604209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97264571-ec05-4313-85e4-3f39c8bb2ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:10.605380 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97264571-ec05-4313-85e4-3f39c8bb2ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:10.605380 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97264571-ec05-4313-85e4-3f39c8bb2ab6 admin admin] PATH_INFO: `/v3/projects/9211b1008bf44eadbeb1dafeaf423784` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:10.606163 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97264571-ec05-4313-85e4-3f39c8bb2ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9211b1008bf44eadbeb1dafeaf423784)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:10.608202 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97264571-ec05-4313-85e4-3f39c8bb2ab6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:10.708786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-97264571-ec05-4313-85e4-3f39c8bb2ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9211b1008bf44eadbeb1dafeaf423784', 'request_id': 'req-97264571-ec05-4313-85e4-3f39c8bb2ab6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:10.715323 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-97264571-ec05-4313-85e4-3f39c8bb2ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9211b1008bf44eadbeb1dafeaf423784', 'request_id': 'req-97264571-ec05-4313-85e4-3f39c8bb2ab6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:10.793086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-97264571-ec05-4313-85e4-3f39c8bb2ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9211b1008bf44eadbeb1dafeaf423784', 'request_id': 'req-97264571-ec05-4313-85e4-3f39c8bb2ab6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:10.812253 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-97264571-ec05-4313-85e4-3f39c8bb2ab6 admin admin] The token cache is being invalidate because project 9211b1008bf44eadbeb1dafeaf423784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:47:10.812534 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-97264571-ec05-4313-85e4-3f39c8bb2ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:10.813177 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-97264571-ec05-4313-85e4-3f39c8bb2ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:10.814994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1387/2792] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:47:10 2022] DELETE /identity/v3/projects/9211b1008bf44eadbeb1dafeaf423784 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:47:10.822311 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894b4c9-1a51-49b9-8c1a-d276420ed461 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:10.824571 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894b4c9-1a51-49b9-8c1a-d276420ed461 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:10.824571 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894b4c9-1a51-49b9-8c1a-d276420ed461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:10.836744 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97264571-ec05-4313-85e4-3f39c8bb2ab6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:10.838190 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-97264571-ec05-4313-85e4-3f39c8bb2ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:10.844530 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8894b4c9-1a51-49b9-8c1a-d276420ed461 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:47:10.845834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8894b4c9-1a51-49b9-8c1a-d276420ed461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:10.849996 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:10.907423 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97264571-ec05-4313-85e4-3f39c8bb2ab6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:10.912584 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923ca2d-cf0a-4f8f-8585-29521f0de75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:10.913236 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923ca2d-cf0a-4f8f-8585-29521f0de75e service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:10.913512 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923ca2d-cf0a-4f8f-8585-29521f0de75e service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:10.913786 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923ca2d-cf0a-4f8f-8585-29521f0de75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:10.914950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1406/2793] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:47:10.915948 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e923ca2d-cf0a-4f8f-8585-29521f0de75e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:10.922701 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04758ae5-e154-43e3-ad4f-621b3a4b2ecc None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:10.923057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04758ae5-e154-43e3-ad4f-621b3a4b2ecc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:10.923340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04758ae5-e154-43e3-ad4f-621b3a4b2ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:10.943428 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-04758ae5-e154-43e3-ad4f-621b3a4b2ecc None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:47:10.944659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-04758ae5-e154-43e3-ad4f-621b3a4b2ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:10.952834 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1407/2794] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:47:10.957835 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04758ae5-e154-43e3-ad4f-621b3a4b2ecc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:10.971604 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04758ae5-e154-43e3-ad4f-621b3a4b2ecc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:10.973753 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da4192-a38c-4340-9c90-5a63375f6124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:10.974429 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da4192-a38c-4340-9c90-5a63375f6124 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:10.974734 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da4192-a38c-4340-9c90-5a63375f6124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:10.975011 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da4192-a38c-4340-9c90-5a63375f6124 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:10.975778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da4192-a38c-4340-9c90-5a63375f6124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:47:10.976083 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da4192-a38c-4340-9c90-5a63375f6124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:10.977832 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da4192-a38c-4340-9c90-5a63375f6124 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:10.991857 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923ca2d-cf0a-4f8f-8585-29521f0de75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:10.996191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923ca2d-cf0a-4f8f-8585-29521f0de75e service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:11.000479 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1408/2795] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:47:11.002179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da4192-a38c-4340-9c90-5a63375f6124 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:11.008745 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1388/2796] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:47:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:47:11.013807 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da4192-a38c-4340-9c90-5a63375f6124 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:11.019968 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d55a9f-af52-47ed-998b-044f890a14dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:11.020632 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d55a9f-af52-47ed-998b-044f890a14dd admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:11.020913 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d55a9f-af52-47ed-998b-044f890a14dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:11.021185 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d55a9f-af52-47ed-998b-044f890a14dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:11.021895 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d55a9f-af52-47ed-998b-044f890a14dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:11.023849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d55a9f-af52-47ed-998b-044f890a14dd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:11.132997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1409/2797] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:47:11 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:47:11.137365 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923ca2d-cf0a-4f8f-8585-29521f0de75e service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:11.148846 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923ca2d-cf0a-4f8f-8585-29521f0de75e service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:11.213193 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9b664-6622-46da-9c0c-7f53b0f504a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:11.213859 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9b664-6622-46da-9c0c-7f53b0f504a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:11.214135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9b664-6622-46da-9c0c-7f53b0f504a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:11.214404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9b664-6622-46da-9c0c-7f53b0f504a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:11.215125 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9b664-6622-46da-9c0c-7f53b0f504a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:11.217035 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9b664-6622-46da-9c0c-7f53b0f504a4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:11.324992 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1389/2798] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:47:11 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:47:11.329042 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d55a9f-af52-47ed-998b-044f890a14dd admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:11.339761 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d55a9f-af52-47ed-998b-044f890a14dd admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:11.345206 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef4056-0b19-4f29-b94e-e6fe0414dcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:11.345907 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef4056-0b19-4f29-b94e-e6fe0414dcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:11.346187 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef4056-0b19-4f29-b94e-e6fe0414dcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:11.346467 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef4056-0b19-4f29-b94e-e6fe0414dcc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:11.347238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef4056-0b19-4f29-b94e-e6fe0414dcc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:11.348845 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef4056-0b19-4f29-b94e-e6fe0414dcc4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:11.359492 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1410/2799] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:47:11.364167 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9b664-6622-46da-9c0c-7f53b0f504a4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:11.375012 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9b664-6622-46da-9c0c-7f53b0f504a4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:11.380932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5367b1-0b75-4493-a069-30b749e50f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:11.381616 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5367b1-0b75-4493-a069-30b749e50f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:11.381892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5367b1-0b75-4493-a069-30b749e50f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:11.382164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5367b1-0b75-4493-a069-30b749e50f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:11.382923 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5367b1-0b75-4493-a069-30b749e50f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:11.385212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5367b1-0b75-4493-a069-30b749e50f6c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:11.399842 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1390/2800] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:47:11.401200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef4056-0b19-4f29-b94e-e6fe0414dcc4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:11.412183 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef4056-0b19-4f29-b94e-e6fe0414dcc4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:11.417567 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dace03-ebae-4994-854d-4fd0642202b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:11.418494 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dace03-ebae-4994-854d-4fd0642202b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:11.418808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dace03-ebae-4994-854d-4fd0642202b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:11.419088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dace03-ebae-4994-854d-4fd0642202b3 admin admin] PATH_INFO: `/v3/projects/06e3bcbc7a84448c9bc4c8ff47344bb9/users/dc90f50397ca4b6ca668041b041affa0/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:11.443214 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dace03-ebae-4994-854d-4fd0642202b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e3bcbc7a84448c9bc4c8ff47344bb9, user_id=dc90f50397ca4b6ca668041b041affa0, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:11.446186 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dace03-ebae-4994-854d-4fd0642202b3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:11.513941 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1411/2801] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:47:11 2022] PUT /identity/v3/projects/06e3bcbc7a84448c9bc4c8ff47344bb9/users/dc90f50397ca4b6ca668041b041affa0/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:47:11.524450 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e5ea2-ddba-4cd9-954e-61a4dae23625 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:11.525558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e5ea2-ddba-4cd9-954e-61a4dae23625 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:11.525558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e5ea2-ddba-4cd9-954e-61a4dae23625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:11.555139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3d4e5ea2-ddba-4cd9-954e-61a4dae23625 None None] MFA Rules not processed for user `dc90f50397ca4b6ca668041b041affa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:47:11.558083 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3d4e5ea2-ddba-4cd9-954e-61a4dae23625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:11.582603 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:11.633184 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1391/2802] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:47:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:47:11.641546 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dace03-ebae-4994-854d-4fd0642202b3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:11.643894 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-58dace03-ebae-4994-854d-4fd0642202b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:11.722226 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dace03-ebae-4994-854d-4fd0642202b3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:11.726318 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3226b36-486e-4f5f-9da1-dcd1efcc6bff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:11.727093 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3226b36-486e-4f5f-9da1-dcd1efcc6bff service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:11.727575 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3226b36-486e-4f5f-9da1-dcd1efcc6bff service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:11.727913 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3226b36-486e-4f5f-9da1-dcd1efcc6bff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:11.738482 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3226b36-486e-4f5f-9da1-dcd1efcc6bff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:11.740099 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3226b36-486e-4f5f-9da1-dcd1efcc6bff service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:11.750177 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1412/2803] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:47:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:47:13.086837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e5ea2-ddba-4cd9-954e-61a4dae23625 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:13.088384 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3d4e5ea2-ddba-4cd9-954e-61a4dae23625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:13.167949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e5ea2-ddba-4cd9-954e-61a4dae23625 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:13.174100 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c00bb-834c-44a4-bee8-48b5235ce5e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3fd38ebb5514af686204d0b02a91edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:13.175561 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c00bb-834c-44a4-bee8-48b5235ce5e5 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:13.175846 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c00bb-834c-44a4-bee8-48b5235ce5e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:13.176187 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c00bb-834c-44a4-bee8-48b5235ce5e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:13.178137 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cc7c00bb-834c-44a4-bee8-48b5235ce5e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:13.193347 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c00bb-834c-44a4-bee8-48b5235ce5e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:13.195148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c00bb-834c-44a4-bee8-48b5235ce5e5 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:13.208420 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1392/2804] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:47:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:47:21.520946 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3226b36-486e-4f5f-9da1-dcd1efcc6bff service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:21.545590 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:21.607153 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3226b36-486e-4f5f-9da1-dcd1efcc6bff service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:21.614137 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4134ecc-e1b5-44cc-b7d2-dcf627dbd7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:21.615057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4134ecc-e1b5-44cc-b7d2-dcf627dbd7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:21.615338 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4134ecc-e1b5-44cc-b7d2-dcf627dbd7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:21.615612 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4134ecc-e1b5-44cc-b7d2-dcf627dbd7f0 admin admin] PATH_INFO: `/v3/users/dc90f50397ca4b6ca668041b041affa0` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:21.616857 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4134ecc-e1b5-44cc-b7d2-dcf627dbd7f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc90f50397ca4b6ca668041b041affa0)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:21.618829 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4134ecc-e1b5-44cc-b7d2-dcf627dbd7f0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:21.886205 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d4134ecc-e1b5-44cc-b7d2-dcf627dbd7f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc90f50397ca4b6ca668041b041affa0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:21.987064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d4134ecc-e1b5-44cc-b7d2-dcf627dbd7f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc90f50397ca4b6ca668041b041affa0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:21.987686 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d4134ecc-e1b5-44cc-b7d2-dcf627dbd7f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc90f50397ca4b6ca668041b041affa0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:22.001020 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d4134ecc-e1b5-44cc-b7d2-dcf627dbd7f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc90f50397ca4b6ca668041b041affa0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:22.008873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d4134ecc-e1b5-44cc-b7d2-dcf627dbd7f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc90f50397ca4b6ca668041b041affa0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:22.014899 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1413/2805] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:47:21 2022] DELETE /identity/v3/users/dc90f50397ca4b6ca668041b041affa0 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:47:22.022070 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914ecd6-02a8-4c45-971d-006554bd4035 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:22.022070 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914ecd6-02a8-4c45-971d-006554bd4035 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:22.023547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914ecd6-02a8-4c45-971d-006554bd4035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:22.044688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2914ecd6-02a8-4c45-971d-006554bd4035 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:47:22.046044 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2914ecd6-02a8-4c45-971d-006554bd4035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:22.106922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1393/2806] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:47:22.117335 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4134ecc-e1b5-44cc-b7d2-dcf627dbd7f0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:22.118820 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d4134ecc-e1b5-44cc-b7d2-dcf627dbd7f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:22.177852 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4134ecc-e1b5-44cc-b7d2-dcf627dbd7f0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:22.181541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79feb228-85fc-4f85-935f-ca8532c6e6d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:22.182186 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feb228-85fc-4f85-935f-ca8532c6e6d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:22.182464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feb228-85fc-4f85-935f-ca8532c6e6d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:22.182761 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feb228-85fc-4f85-935f-ca8532c6e6d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:22.192854 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79feb228-85fc-4f85-935f-ca8532c6e6d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:22.194306 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79feb228-85fc-4f85-935f-ca8532c6e6d2 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:22.205473 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1414/2807] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:47:22.662016 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914ecd6-02a8-4c45-971d-006554bd4035 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:22.666561 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2914ecd6-02a8-4c45-971d-006554bd4035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:22.678847 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914ecd6-02a8-4c45-971d-006554bd4035 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:22.683775 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb8f0b-5ca9-4321-843f-44617afe774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:22.684615 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb8f0b-5ca9-4321-843f-44617afe774f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:22.684888 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb8f0b-5ca9-4321-843f-44617afe774f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:22.685161 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb8f0b-5ca9-4321-843f-44617afe774f admin admin] PATH_INFO: `/v3/projects/06e3bcbc7a84448c9bc4c8ff47344bb9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:22.686418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb8f0b-5ca9-4321-843f-44617afe774f admin admin] RBAC: Authorizing `identity:delete_project(project_id=06e3bcbc7a84448c9bc4c8ff47344bb9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:22.688383 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb8f0b-5ca9-4321-843f-44617afe774f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:22.801800 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:22.805008 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3eb8f0b-5ca9-4321-843f-44617afe774f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06e3bcbc7a84448c9bc4c8ff47344bb9', 'request_id': 'req-c3eb8f0b-5ca9-4321-843f-44617afe774f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:22.811543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3eb8f0b-5ca9-4321-843f-44617afe774f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06e3bcbc7a84448c9bc4c8ff47344bb9', 'request_id': 'req-c3eb8f0b-5ca9-4321-843f-44617afe774f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:22.912990 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3eb8f0b-5ca9-4321-843f-44617afe774f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06e3bcbc7a84448c9bc4c8ff47344bb9', 'request_id': 'req-c3eb8f0b-5ca9-4321-843f-44617afe774f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:22.923965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3eb8f0b-5ca9-4321-843f-44617afe774f admin admin] The token cache is being invalidate because project 06e3bcbc7a84448c9bc4c8ff47344bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:47:22.924284 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3eb8f0b-5ca9-4321-843f-44617afe774f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:22.925104 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c3eb8f0b-5ca9-4321-843f-44617afe774f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:22.926689 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1394/2808] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:47:22 2022] DELETE /identity/v3/projects/06e3bcbc7a84448c9bc4c8ff47344bb9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:47:22.931929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb94a4f-3a30-48d0-98aa-2f7edcb0009c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:22.932462 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb94a4f-3a30-48d0-98aa-2f7edcb0009c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:22.932462 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb94a4f-3a30-48d0-98aa-2f7edcb0009c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:22.952675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2eb94a4f-3a30-48d0-98aa-2f7edcb0009c None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:47:22.953807 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2eb94a4f-3a30-48d0-98aa-2f7edcb0009c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:22.996671 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:23.016918 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1415/2809] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:47:23.036001 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8a1f7-654b-45cc-a694-ebc41bc5e095 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:23.036573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8a1f7-654b-45cc-a694-ebc41bc5e095 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:23.036573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8a1f7-654b-45cc-a694-ebc41bc5e095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:23.055886 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-83c8a1f7-654b-45cc-a694-ebc41bc5e095 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:47:23.057094 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-83c8a1f7-654b-45cc-a694-ebc41bc5e095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:23.065618 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1395/2810] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:47:23.070361 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb94a4f-3a30-48d0-98aa-2f7edcb0009c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:23.081131 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb94a4f-3a30-48d0-98aa-2f7edcb0009c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:23.087036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2612894-66d6-47b3-b08a-30f329ad45dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:23.087714 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612894-66d6-47b3-b08a-30f329ad45dc admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:23.087994 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612894-66d6-47b3-b08a-30f329ad45dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:23.088268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612894-66d6-47b3-b08a-30f329ad45dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:23.089008 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2612894-66d6-47b3-b08a-30f329ad45dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:47:23.089312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2612894-66d6-47b3-b08a-30f329ad45dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:23.090981 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2612894-66d6-47b3-b08a-30f329ad45dc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:23.103498 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1416/2811] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:47:23.107938 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8a1f7-654b-45cc-a694-ebc41bc5e095 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:23.117778 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8a1f7-654b-45cc-a694-ebc41bc5e095 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:23.122547 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5acafd-3b52-4ec6-a6fa-73d97d51b335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:23.123449 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5acafd-3b52-4ec6-a6fa-73d97d51b335 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:23.123734 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5acafd-3b52-4ec6-a6fa-73d97d51b335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:23.124002 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5acafd-3b52-4ec6-a6fa-73d97d51b335 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:23.124704 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5acafd-3b52-4ec6-a6fa-73d97d51b335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:23.126609 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5acafd-3b52-4ec6-a6fa-73d97d51b335 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:23.217330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1396/2812] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:47:23 2022] POST /identity/v3/projects => generated 357 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:47:23.221871 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2612894-66d6-47b3-b08a-30f329ad45dc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:23.232726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2612894-66d6-47b3-b08a-30f329ad45dc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:23.293423 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da9734-6631-4402-a557-3936f65cf87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:23.294109 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da9734-6631-4402-a557-3936f65cf87b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:23.294385 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da9734-6631-4402-a557-3936f65cf87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:23.294659 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da9734-6631-4402-a557-3936f65cf87b admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:23.295442 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da9734-6631-4402-a557-3936f65cf87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:23.297293 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da9734-6631-4402-a557-3936f65cf87b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:23.404712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1417/2813] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:47:23 2022] POST /identity/v3/users => generated 279 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:47:23.409158 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5acafd-3b52-4ec6-a6fa-73d97d51b335 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:23.419901 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5acafd-3b52-4ec6-a6fa-73d97d51b335 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:23.425238 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23e5a9-8e88-4582-a8b8-aa9b76c6302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:23.425909 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e5a9-8e88-4582-a8b8-aa9b76c6302c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:23.426190 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e5a9-8e88-4582-a8b8-aa9b76c6302c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:23.426462 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e5a9-8e88-4582-a8b8-aa9b76c6302c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:23.427234 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23e5a9-8e88-4582-a8b8-aa9b76c6302c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:23.428831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23e5a9-8e88-4582-a8b8-aa9b76c6302c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:23.440598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1397/2814] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:47:23.444901 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da9734-6631-4402-a557-3936f65cf87b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:23.455067 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da9734-6631-4402-a557-3936f65cf87b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:23.460077 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1dd68a-b02c-418e-b9b2-e19cf2003e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:23.460738 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1dd68a-b02c-418e-b9b2-e19cf2003e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:23.461020 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1dd68a-b02c-418e-b9b2-e19cf2003e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:23.461298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1dd68a-b02c-418e-b9b2-e19cf2003e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:23.462023 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1dd68a-b02c-418e-b9b2-e19cf2003e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:23.464116 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1dd68a-b02c-418e-b9b2-e19cf2003e10 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:23.473947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1418/2815] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:47:23.478113 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23e5a9-8e88-4582-a8b8-aa9b76c6302c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:23.488872 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23e5a9-8e88-4582-a8b8-aa9b76c6302c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:23.493665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d9590-87ae-4afd-988e-81a68fcdf25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:23.494565 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d9590-87ae-4afd-988e-81a68fcdf25d admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:23.494873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d9590-87ae-4afd-988e-81a68fcdf25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:23.495149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d9590-87ae-4afd-988e-81a68fcdf25d admin admin] PATH_INFO: `/v3/projects/968b83e436c5449c98c50ce90f3ad608/users/4a8797b9cb4242b1b8849c58ea763d52/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:23.511299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d9590-87ae-4afd-988e-81a68fcdf25d admin admin] RBAC: Authorizing `identity:create_grant(project_id=968b83e436c5449c98c50ce90f3ad608, user_id=4a8797b9cb4242b1b8849c58ea763d52, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:23.513961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d9590-87ae-4afd-988e-81a68fcdf25d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:23.576095 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1398/2816] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:47:23 2022] PUT /identity/v3/projects/968b83e436c5449c98c50ce90f3ad608/users/4a8797b9cb4242b1b8849c58ea763d52/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:47:23.587801 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f608129-a56f-472c-bd62-9bfc92467873 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:23.588120 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f608129-a56f-472c-bd62-9bfc92467873 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:23.588378 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f608129-a56f-472c-bd62-9bfc92467873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:23.616187 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8f608129-a56f-472c-bd62-9bfc92467873 None None] MFA Rules not processed for user `4a8797b9cb4242b1b8849c58ea763d52`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:47:23.621070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8f608129-a56f-472c-bd62-9bfc92467873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:23.682947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1419/2817] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:47:23 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:47:23.687790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d9590-87ae-4afd-988e-81a68fcdf25d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:23.751707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d9590-87ae-4afd-988e-81a68fcdf25d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:23.757150 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee3d30-ae6c-49b4-97b6-2d66e9c76178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:23.757811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee3d30-ae6c-49b4-97b6-2d66e9c76178 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:23.758092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee3d30-ae6c-49b4-97b6-2d66e9c76178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:23.758368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee3d30-ae6c-49b4-97b6-2d66e9c76178 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:23.759118 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee3d30-ae6c-49b4-97b6-2d66e9c76178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:23.761030 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee3d30-ae6c-49b4-97b6-2d66e9c76178 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:23.884949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1399/2818] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:47:23 2022] POST /identity/v3/projects => generated 355 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:47:23.889109 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f608129-a56f-472c-bd62-9bfc92467873 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:23.901146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f608129-a56f-472c-bd62-9bfc92467873 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:23.945287 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:23.966496 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dae69-52f5-41a8-a68d-112980db0910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:23.967390 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dae69-52f5-41a8-a68d-112980db0910 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:23.967782 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dae69-52f5-41a8-a68d-112980db0910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:23.968232 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dae69-52f5-41a8-a68d-112980db0910 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:23.969503 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dae69-52f5-41a8-a68d-112980db0910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:23.973715 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dae69-52f5-41a8-a68d-112980db0910 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:24.105970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1420/2819] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:47:23 2022] POST /identity/v3/users => generated 284 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:47:24.107549 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee3d30-ae6c-49b4-97b6-2d66e9c76178 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:24.119666 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee3d30-ae6c-49b4-97b6-2d66e9c76178 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:24.124410 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb74a4-8171-449c-9f17-3a7608907f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:24.125078 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb74a4-8171-449c-9f17-3a7608907f7c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:24.125354 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb74a4-8171-449c-9f17-3a7608907f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:24.125641 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb74a4-8171-449c-9f17-3a7608907f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:24.126351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb74a4-8171-449c-9f17-3a7608907f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:24.129280 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb74a4-8171-449c-9f17-3a7608907f7c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:24.140943 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1400/2820] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:47:24.145936 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dae69-52f5-41a8-a68d-112980db0910 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:24.156432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dae69-52f5-41a8-a68d-112980db0910 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:24.161345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1d144-7889-4bda-b91e-912a9670b64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:24.162233 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1d144-7889-4bda-b91e-912a9670b64b admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:24.162514 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1d144-7889-4bda-b91e-912a9670b64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:24.162818 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1d144-7889-4bda-b91e-912a9670b64b admin admin] PATH_INFO: `/v3/projects/daa6b4c2230b49949a7247b138dad4cf/users/40880e80f82f442dbd7353c22c83fbb5/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:24.179287 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1d144-7889-4bda-b91e-912a9670b64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa6b4c2230b49949a7247b138dad4cf, user_id=40880e80f82f442dbd7353c22c83fbb5, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:24.181956 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1d144-7889-4bda-b91e-912a9670b64b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:24.285676 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1421/2821] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:47:24 2022] PUT /identity/v3/projects/daa6b4c2230b49949a7247b138dad4cf/users/40880e80f82f442dbd7353c22c83fbb5/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:47:24.289392 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb74a4-8171-449c-9f17-3a7608907f7c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:24.300621 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb74a4-8171-449c-9f17-3a7608907f7c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:24.346971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:24.365371 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085be6d-774f-48b9-a424-177e9fca128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:24.365973 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085be6d-774f-48b9-a424-177e9fca128e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:24.366257 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085be6d-774f-48b9-a424-177e9fca128e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:24.366532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085be6d-774f-48b9-a424-177e9fca128e admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:24.367504 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085be6d-774f-48b9-a424-177e9fca128e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:24.369078 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085be6d-774f-48b9-a424-177e9fca128e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:24.382083 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1401/2822] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:47:24.386439 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1d144-7889-4bda-b91e-912a9670b64b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:24.398986 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1d144-7889-4bda-b91e-912a9670b64b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:24.404310 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f088261-0496-41a5-9cfb-0ed8d541b19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:24.405222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f088261-0496-41a5-9cfb-0ed8d541b19d admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:24.405503 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f088261-0496-41a5-9cfb-0ed8d541b19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:24.405775 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f088261-0496-41a5-9cfb-0ed8d541b19d admin admin] PATH_INFO: `/v3/projects/daa6b4c2230b49949a7247b138dad4cf/users/40880e80f82f442dbd7353c22c83fbb5/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:24.407937 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f088261-0496-41a5-9cfb-0ed8d541b19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa6b4c2230b49949a7247b138dad4cf, user_id=40880e80f82f442dbd7353c22c83fbb5, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:24.411174 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f088261-0496-41a5-9cfb-0ed8d541b19d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:24.422175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1422/2823] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:47:24 2022] PUT /identity/v3/projects/daa6b4c2230b49949a7247b138dad4cf/users/40880e80f82f442dbd7353c22c83fbb5/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:47:24.437676 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f4da2-a5dc-424b-a03f-91c4edd2b18b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:24.437959 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f4da2-a5dc-424b-a03f-91c4edd2b18b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:24.438238 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f4da2-a5dc-424b-a03f-91c4edd2b18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:24.466398 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ba4f4da2-a5dc-424b-a03f-91c4edd2b18b None None] MFA Rules not processed for user `40880e80f82f442dbd7353c22c83fbb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:47:24.467656 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ba4f4da2-a5dc-424b-a03f-91c4edd2b18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:24.539657 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1402/2824] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:47:24 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:47:24.552505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f088261-0496-41a5-9cfb-0ed8d541b19d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:24.554352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9f088261-0496-41a5-9cfb-0ed8d541b19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:24.616140 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f088261-0496-41a5-9cfb-0ed8d541b19d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:24.619756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d064d4a-7d39-4e07-ae0b-f5852f0b4d8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:24.620395 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d064d4a-7d39-4e07-ae0b-f5852f0b4d8f service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:24.620670 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d064d4a-7d39-4e07-ae0b-f5852f0b4d8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:24.620938 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d064d4a-7d39-4e07-ae0b-f5852f0b4d8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:24.630616 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d064d4a-7d39-4e07-ae0b-f5852f0b4d8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:24.632057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d064d4a-7d39-4e07-ae0b-f5852f0b4d8f service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:24.644712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1423/2825] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:47:24 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:47:24.875709 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f4da2-a5dc-424b-a03f-91c4edd2b18b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:24.886925 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f4da2-a5dc-424b-a03f-91c4edd2b18b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:24.890600 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211dfbb-6569-4bb5-9bac-2b9b8fb54af4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:24.894892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211dfbb-6569-4bb5-9bac-2b9b8fb54af4 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:24.894892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211dfbb-6569-4bb5-9bac-2b9b8fb54af4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:24.894892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211dfbb-6569-4bb5-9bac-2b9b8fb54af4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:24.950522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211dfbb-6569-4bb5-9bac-2b9b8fb54af4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:24.952003 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211dfbb-6569-4bb5-9bac-2b9b8fb54af4 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:24.961809 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1403/2826] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:47:24 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:47:34.639666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=52,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:34.957541 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=71 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:42.594328 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d064d4a-7d39-4e07-ae0b-f5852f0b4d8f service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:42.659168 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d064d4a-7d39-4e07-ae0b-f5852f0b4d8f service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:42.663791 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cd602-ae72-4a5b-b947-46e9c6159ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:42.664664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cd602-ae72-4a5b-b947-46e9c6159ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:42.664944 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cd602-ae72-4a5b-b947-46e9c6159ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:42.665215 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cd602-ae72-4a5b-b947-46e9c6159ddb admin admin] PATH_INFO: `/v3/users/4a8797b9cb4242b1b8849c58ea763d52` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:42.666406 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cd602-ae72-4a5b-b947-46e9c6159ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8797b9cb4242b1b8849c58ea763d52)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:42.668353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cd602-ae72-4a5b-b947-46e9c6159ddb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:42.835669 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-956cd602-ae72-4a5b-b947-46e9c6159ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8797b9cb4242b1b8849c58ea763d52'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:42.917442 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-956cd602-ae72-4a5b-b947-46e9c6159ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8797b9cb4242b1b8849c58ea763d52'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:42.918046 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-956cd602-ae72-4a5b-b947-46e9c6159ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8797b9cb4242b1b8849c58ea763d52'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:42.931587 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-956cd602-ae72-4a5b-b947-46e9c6159ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8797b9cb4242b1b8849c58ea763d52'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:42.939033 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-956cd602-ae72-4a5b-b947-46e9c6159ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8797b9cb4242b1b8849c58ea763d52'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:42.946770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1424/2827] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:47:42 2022] DELETE /identity/v3/users/4a8797b9cb4242b1b8849c58ea763d52 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:47:42.951099 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802f884-5662-4e49-8081-7768e025e16d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:42.951559 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802f884-5662-4e49-8081-7768e025e16d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:42.951667 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802f884-5662-4e49-8081-7768e025e16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:42.968933 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6802f884-5662-4e49-8081-7768e025e16d None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:47:42.970128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6802f884-5662-4e49-8081-7768e025e16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:43.031013 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1404/2828] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:47:43.041053 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cd602-ae72-4a5b-b947-46e9c6159ddb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:43.044646 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-956cd602-ae72-4a5b-b947-46e9c6159ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:43.101022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cd602-ae72-4a5b-b947-46e9c6159ddb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:43.104572 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfb7c7-df74-485a-a3cb-a73e47bb902b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:43.107599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfb7c7-df74-485a-a3cb-a73e47bb902b service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:43.107599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfb7c7-df74-485a-a3cb-a73e47bb902b service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:43.107599 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfb7c7-df74-485a-a3cb-a73e47bb902b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:43.115501 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfb7c7-df74-485a-a3cb-a73e47bb902b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:43.116914 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfb7c7-df74-485a-a3cb-a73e47bb902b service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:43.126499 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1425/2829] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:47:43.530957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802f884-5662-4e49-8081-7768e025e16d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:43.532421 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6802f884-5662-4e49-8081-7768e025e16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:43.544610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802f884-5662-4e49-8081-7768e025e16d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:43.551330 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff295382-4143-4313-91bf-a5d070655cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:43.552391 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff295382-4143-4313-91bf-a5d070655cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:43.552680 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff295382-4143-4313-91bf-a5d070655cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:43.552949 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff295382-4143-4313-91bf-a5d070655cbe admin admin] PATH_INFO: `/v3/projects/968b83e436c5449c98c50ce90f3ad608` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:43.554350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff295382-4143-4313-91bf-a5d070655cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=968b83e436c5449c98c50ce90f3ad608)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:43.556840 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff295382-4143-4313-91bf-a5d070655cbe admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:43.672733 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ff295382-4143-4313-91bf-a5d070655cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '968b83e436c5449c98c50ce90f3ad608', 'request_id': 'req-ff295382-4143-4313-91bf-a5d070655cbe'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:43.679664 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ff295382-4143-4313-91bf-a5d070655cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '968b83e436c5449c98c50ce90f3ad608', 'request_id': 'req-ff295382-4143-4313-91bf-a5d070655cbe'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:43.763676 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ff295382-4143-4313-91bf-a5d070655cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '968b83e436c5449c98c50ce90f3ad608', 'request_id': 'req-ff295382-4143-4313-91bf-a5d070655cbe'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:43.776114 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ff295382-4143-4313-91bf-a5d070655cbe admin admin] The token cache is being invalidate because project 968b83e436c5449c98c50ce90f3ad608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:47:43.776404 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ff295382-4143-4313-91bf-a5d070655cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:43.777064 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ff295382-4143-4313-91bf-a5d070655cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:43.778703 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1405/2830] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:47:43 2022] DELETE /identity/v3/projects/968b83e436c5449c98c50ce90f3ad608 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:47:43.782813 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfb7c7-df74-485a-a3cb-a73e47bb902b service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:43.793675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfb7c7-df74-485a-a3cb-a73e47bb902b service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:43.812277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:43.853074 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf86ef-1a5c-46f2-9cd3-27e0f110ea8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:43.853974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf86ef-1a5c-46f2-9cd3-27e0f110ea8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:43.854248 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf86ef-1a5c-46f2-9cd3-27e0f110ea8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:43.854517 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf86ef-1a5c-46f2-9cd3-27e0f110ea8e admin admin] PATH_INFO: `/v3/users/40880e80f82f442dbd7353c22c83fbb5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:43.855720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf86ef-1a5c-46f2-9cd3-27e0f110ea8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=40880e80f82f442dbd7353c22c83fbb5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:43.857693 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf86ef-1a5c-46f2-9cd3-27e0f110ea8e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:44.098102 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7acf86ef-1a5c-46f2-9cd3-27e0f110ea8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40880e80f82f442dbd7353c22c83fbb5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:44.175290 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7acf86ef-1a5c-46f2-9cd3-27e0f110ea8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40880e80f82f442dbd7353c22c83fbb5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:44.175912 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7acf86ef-1a5c-46f2-9cd3-27e0f110ea8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40880e80f82f442dbd7353c22c83fbb5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:44.188405 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7acf86ef-1a5c-46f2-9cd3-27e0f110ea8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40880e80f82f442dbd7353c22c83fbb5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:44.195571 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7acf86ef-1a5c-46f2-9cd3-27e0f110ea8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40880e80f82f442dbd7353c22c83fbb5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:44.201779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1426/2831] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:47:43 2022] DELETE /identity/v3/users/40880e80f82f442dbd7353c22c83fbb5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:47:44.651246 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff295382-4143-4313-91bf-a5d070655cbe admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:44.652732 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ff295382-4143-4313-91bf-a5d070655cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:44.667811 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff295382-4143-4313-91bf-a5d070655cbe admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:44.727499 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532265a4-1e15-4c39-b427-8875595f7b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:44.728425 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532265a4-1e15-4c39-b427-8875595f7b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:44.728708 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532265a4-1e15-4c39-b427-8875595f7b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:44.728978 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532265a4-1e15-4c39-b427-8875595f7b53 admin admin] PATH_INFO: `/v3/projects/daa6b4c2230b49949a7247b138dad4cf` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:44.730162 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532265a4-1e15-4c39-b427-8875595f7b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa6b4c2230b49949a7247b138dad4cf)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:44.732097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532265a4-1e15-4c39-b427-8875595f7b53 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:44.817693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:44.834411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-532265a4-1e15-4c39-b427-8875595f7b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa6b4c2230b49949a7247b138dad4cf', 'request_id': 'req-532265a4-1e15-4c39-b427-8875595f7b53'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:44.840624 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-532265a4-1e15-4c39-b427-8875595f7b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa6b4c2230b49949a7247b138dad4cf', 'request_id': 'req-532265a4-1e15-4c39-b427-8875595f7b53'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:44.923693 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-532265a4-1e15-4c39-b427-8875595f7b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa6b4c2230b49949a7247b138dad4cf', 'request_id': 'req-532265a4-1e15-4c39-b427-8875595f7b53'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:44.935249 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-532265a4-1e15-4c39-b427-8875595f7b53 admin admin] The token cache is being invalidate because project daa6b4c2230b49949a7247b138dad4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:47:44.935535 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-532265a4-1e15-4c39-b427-8875595f7b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:44.936179 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-532265a4-1e15-4c39-b427-8875595f7b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:47:44.937745 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1406/2832] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:47:44 2022] DELETE /identity/v3/projects/daa6b4c2230b49949a7247b138dad4cf => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:47:44.944070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ba6a1-1857-47f8-b3eb-8d1dc5564a78 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:44.944677 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ba6a1-1857-47f8-b3eb-8d1dc5564a78 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:44.944677 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ba6a1-1857-47f8-b3eb-8d1dc5564a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:44.963327 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-504ba6a1-1857-47f8-b3eb-8d1dc5564a78 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:47:44.964531 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-504ba6a1-1857-47f8-b3eb-8d1dc5564a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:45.024420 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1427/2833] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:47:45.032457 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396a21e-73f9-41a8-95b5-266e2f786d83 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:45.032739 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396a21e-73f9-41a8-95b5-266e2f786d83 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:45.033052 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396a21e-73f9-41a8-95b5-266e2f786d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:45.051748 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2396a21e-73f9-41a8-95b5-266e2f786d83 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:47:45.052932 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2396a21e-73f9-41a8-95b5-266e2f786d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:45.061112 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1407/2834] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:47:45.066368 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ba6a1-1857-47f8-b3eb-8d1dc5564a78 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:45.076251 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ba6a1-1857-47f8-b3eb-8d1dc5564a78 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:45.081345 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9fcfe-e3e7-4fd9-8b9f-ed83d71dc194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:45.082036 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9fcfe-e3e7-4fd9-8b9f-ed83d71dc194 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:45.082319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9fcfe-e3e7-4fd9-8b9f-ed83d71dc194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:45.082593 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9fcfe-e3e7-4fd9-8b9f-ed83d71dc194 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:45.083359 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9fcfe-e3e7-4fd9-8b9f-ed83d71dc194 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:47:45.083666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9fcfe-e3e7-4fd9-8b9f-ed83d71dc194 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:45.085271 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9fcfe-e3e7-4fd9-8b9f-ed83d71dc194 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:45.097161 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1428/2835] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:47:45.101831 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396a21e-73f9-41a8-95b5-266e2f786d83 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:45.112155 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396a21e-73f9-41a8-95b5-266e2f786d83 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:45.116866 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f115ff-18d2-480b-862a-d7389b9fa455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:45.117524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f115ff-18d2-480b-862a-d7389b9fa455 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:45.117804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f115ff-18d2-480b-862a-d7389b9fa455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:45.118073 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f115ff-18d2-480b-862a-d7389b9fa455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:45.118941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f115ff-18d2-480b-862a-d7389b9fa455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:45.120721 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f115ff-18d2-480b-862a-d7389b9fa455 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:45.229039 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1408/2836] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:47:45 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:47:45.233197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9fcfe-e3e7-4fd9-8b9f-ed83d71dc194 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:45.244047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9fcfe-e3e7-4fd9-8b9f-ed83d71dc194 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:45.271111 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:45.302632 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ae9db-f475-4e67-a924-7d4815e8b27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:45.303355 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ae9db-f475-4e67-a924-7d4815e8b27c admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:45.303637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ae9db-f475-4e67-a924-7d4815e8b27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:45.303908 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ae9db-f475-4e67-a924-7d4815e8b27c admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:45.304606 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ae9db-f475-4e67-a924-7d4815e8b27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:45.306551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ae9db-f475-4e67-a924-7d4815e8b27c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:45.410261 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1429/2837] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:47:45 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:47:45.414477 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f115ff-18d2-480b-862a-d7389b9fa455 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:45.425362 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f115ff-18d2-480b-862a-d7389b9fa455 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:45.429994 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c742004-75b9-4f2f-acb8-221879616f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:45.430650 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c742004-75b9-4f2f-acb8-221879616f52 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:45.430961 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c742004-75b9-4f2f-acb8-221879616f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:45.431230 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c742004-75b9-4f2f-acb8-221879616f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:45.435295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c742004-75b9-4f2f-acb8-221879616f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:45.435295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c742004-75b9-4f2f-acb8-221879616f52 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:45.445387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1409/2838] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:47:45.449541 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ae9db-f475-4e67-a924-7d4815e8b27c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:45.460548 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ae9db-f475-4e67-a924-7d4815e8b27c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:45.465299 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a97a1e-d53f-43e9-9808-d243169685da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:45.465998 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a97a1e-d53f-43e9-9808-d243169685da admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:45.466274 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a97a1e-d53f-43e9-9808-d243169685da admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:45.466543 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a97a1e-d53f-43e9-9808-d243169685da admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:45.467335 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a97a1e-d53f-43e9-9808-d243169685da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:45.468956 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a97a1e-d53f-43e9-9808-d243169685da admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:45.480337 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1430/2839] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:47:45.484692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c742004-75b9-4f2f-acb8-221879616f52 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:45.495513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c742004-75b9-4f2f-acb8-221879616f52 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:45.500486 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e672d8b-f438-4252-8a88-85ac125ad19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:45.502735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e672d8b-f438-4252-8a88-85ac125ad19a admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:45.502735 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e672d8b-f438-4252-8a88-85ac125ad19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:45.503053 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e672d8b-f438-4252-8a88-85ac125ad19a admin admin] PATH_INFO: `/v3/projects/f3937c134e1e409b81a3c6a488934a58/users/90df5cb2577c4e9b9110620d6836abe0/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:45.524913 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e672d8b-f438-4252-8a88-85ac125ad19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3937c134e1e409b81a3c6a488934a58, user_id=90df5cb2577c4e9b9110620d6836abe0, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:45.527572 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e672d8b-f438-4252-8a88-85ac125ad19a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:45.603902 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1410/2840] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:47:45 2022] PUT /identity/v3/projects/f3937c134e1e409b81a3c6a488934a58/users/90df5cb2577c4e9b9110620d6836abe0/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:47:45.614393 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c01c41-6386-418e-a1b0-f95a999edba8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:45.614705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c01c41-6386-418e-a1b0-f95a999edba8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:45.614978 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c01c41-6386-418e-a1b0-f95a999edba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:45.643596 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-27c01c41-6386-418e-a1b0-f95a999edba8 None None] MFA Rules not processed for user `90df5cb2577c4e9b9110620d6836abe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:47:45.644920 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-27c01c41-6386-418e-a1b0-f95a999edba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:45.711060 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1431/2841] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:47:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:47:45.719649 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e672d8b-f438-4252-8a88-85ac125ad19a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:45.783765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e672d8b-f438-4252-8a88-85ac125ad19a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:45.788344 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19956772-f84a-41ee-8b19-c14104a55522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:45.789014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19956772-f84a-41ee-8b19-c14104a55522 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:45.789299 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19956772-f84a-41ee-8b19-c14104a55522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:45.789573 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19956772-f84a-41ee-8b19-c14104a55522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:45.790260 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19956772-f84a-41ee-8b19-c14104a55522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:45.792197 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19956772-f84a-41ee-8b19-c14104a55522 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:45.880177 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1411/2842] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:47:45 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:47:45.884330 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c01c41-6386-418e-a1b0-f95a999edba8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:45.895195 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c01c41-6386-418e-a1b0-f95a999edba8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:45.951831 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d33f3-6622-40b1-a122-e419a83538fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:45.952489 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d33f3-6622-40b1-a122-e419a83538fd admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:45.952756 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d33f3-6622-40b1-a122-e419a83538fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:45.953122 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d33f3-6622-40b1-a122-e419a83538fd admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:45.953748 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d33f3-6622-40b1-a122-e419a83538fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:45.956295 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d33f3-6622-40b1-a122-e419a83538fd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:46.061789 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1432/2843] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:47:45 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:47:46.065207 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19956772-f84a-41ee-8b19-c14104a55522 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:46.076220 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19956772-f84a-41ee-8b19-c14104a55522 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:46.081583 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d46e6-eadd-4a65-9abe-d8075f27bfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:46.082302 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d46e6-eadd-4a65-9abe-d8075f27bfae admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:46.082562 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d46e6-eadd-4a65-9abe-d8075f27bfae admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:46.082869 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d46e6-eadd-4a65-9abe-d8075f27bfae admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:46.083602 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d46e6-eadd-4a65-9abe-d8075f27bfae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:46.085274 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d46e6-eadd-4a65-9abe-d8075f27bfae admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:46.097323 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1412/2844] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:47:46.101720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d33f3-6622-40b1-a122-e419a83538fd admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:46.113006 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d33f3-6622-40b1-a122-e419a83538fd admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:46.117777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c049a7-7a43-47d5-ae4d-8989317eb261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:46.118651 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c049a7-7a43-47d5-ae4d-8989317eb261 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:46.118964 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c049a7-7a43-47d5-ae4d-8989317eb261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:46.119238 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c049a7-7a43-47d5-ae4d-8989317eb261 admin admin] PATH_INFO: `/v3/projects/55c54810ea794336a3a44ef136c5c428/users/470af79784eb46969a54fc15ae9c2404/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:46.135480 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c049a7-7a43-47d5-ae4d-8989317eb261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c54810ea794336a3a44ef136c5c428, user_id=470af79784eb46969a54fc15ae9c2404, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:46.138224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c049a7-7a43-47d5-ae4d-8989317eb261 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:46.221768 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1433/2845] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:47:46 2022] PUT /identity/v3/projects/55c54810ea794336a3a44ef136c5c428/users/470af79784eb46969a54fc15ae9c2404/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:47:46.225900 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d46e6-eadd-4a65-9abe-d8075f27bfae admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:46.236092 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d46e6-eadd-4a65-9abe-d8075f27bfae admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:46.256586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:46.294903 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c3fd5-91ab-4d6a-931c-eb8c9f1f407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:46.295577 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c3fd5-91ab-4d6a-931c-eb8c9f1f407f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:46.295860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c3fd5-91ab-4d6a-931c-eb8c9f1f407f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:46.296135 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c3fd5-91ab-4d6a-931c-eb8c9f1f407f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:46.296894 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c3fd5-91ab-4d6a-931c-eb8c9f1f407f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:46.298586 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c3fd5-91ab-4d6a-931c-eb8c9f1f407f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:46.309936 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1413/2846] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:47:46.315088 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c049a7-7a43-47d5-ae4d-8989317eb261 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:46.320617 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:46.326376 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c049a7-7a43-47d5-ae4d-8989317eb261 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:46.331836 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcc9e1-9e0a-44d1-b6e4-bc3a8c548119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:46.332726 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcc9e1-9e0a-44d1-b6e4-bc3a8c548119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:46.333005 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcc9e1-9e0a-44d1-b6e4-bc3a8c548119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:46.333279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcc9e1-9e0a-44d1-b6e4-bc3a8c548119 admin admin] PATH_INFO: `/v3/projects/55c54810ea794336a3a44ef136c5c428/users/470af79784eb46969a54fc15ae9c2404/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:46.335623 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcc9e1-9e0a-44d1-b6e4-bc3a8c548119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c54810ea794336a3a44ef136c5c428, user_id=470af79784eb46969a54fc15ae9c2404, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:46.338285 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcc9e1-9e0a-44d1-b6e4-bc3a8c548119 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:46.349569 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1434/2847] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:47:46 2022] PUT /identity/v3/projects/55c54810ea794336a3a44ef136c5c428/users/470af79784eb46969a54fc15ae9c2404/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:47:46.361057 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16d865-b80f-4b87-b390-472d1c8c0d71 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:46.361960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16d865-b80f-4b87-b390-472d1c8c0d71 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:46.362168 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16d865-b80f-4b87-b390-472d1c8c0d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:46.388402 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cc16d865-b80f-4b87-b390-472d1c8c0d71 None None] MFA Rules not processed for user `470af79784eb46969a54fc15ae9c2404`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:47:46.389614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cc16d865-b80f-4b87-b390-472d1c8c0d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:46.461864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1414/2848] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:47:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:47:46.473519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcc9e1-9e0a-44d1-b6e4-bc3a8c548119 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:46.475279 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-aedcc9e1-9e0a-44d1-b6e4-bc3a8c548119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:47:46.532875 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcc9e1-9e0a-44d1-b6e4-bc3a8c548119 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:46.538288 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62789fd3-c71e-4fc1-80c7-726cfce843ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:46.539173 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62789fd3-c71e-4fc1-80c7-726cfce843ba service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:46.539551 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62789fd3-c71e-4fc1-80c7-726cfce843ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:46.539931 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62789fd3-c71e-4fc1-80c7-726cfce843ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:46.598645 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62789fd3-c71e-4fc1-80c7-726cfce843ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:46.600050 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62789fd3-c71e-4fc1-80c7-726cfce843ba service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:46.609597 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1435/2849] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:47:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:47:49.747011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16d865-b80f-4b87-b390-472d1c8c0d71 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:47:49.757327 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16d865-b80f-4b87-b390-472d1c8c0d71 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:47:49.761015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5f182-ecda-431b-8bdd-099566133d4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:47:49.761680 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5f182-ecda-431b-8bdd-099566133d4b service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:47:49.761968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5f182-ecda-431b-8bdd-099566133d4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:47:49.762230 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5f182-ecda-431b-8bdd-099566133d4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:47:49.772176 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5f182-ecda-431b-8bdd-099566133d4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:47:49.773614 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5f182-ecda-431b-8bdd-099566133d4b service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:47:49.784174 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1415/2850] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:47:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:47:56.605235 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:47:59.779012 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=58 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:04.692300 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62789fd3-c71e-4fc1-80c7-726cfce843ba service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:04.759855 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62789fd3-c71e-4fc1-80c7-726cfce843ba service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:04.764619 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743c714-b8c4-4785-ab31-87ca57fd9c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:04.765565 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743c714-b8c4-4785-ab31-87ca57fd9c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:04.765846 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743c714-b8c4-4785-ab31-87ca57fd9c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:04.766117 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743c714-b8c4-4785-ab31-87ca57fd9c2f admin admin] PATH_INFO: `/v3/users/90df5cb2577c4e9b9110620d6836abe0` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:04.767353 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743c714-b8c4-4785-ab31-87ca57fd9c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=90df5cb2577c4e9b9110620d6836abe0)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:04.769273 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743c714-b8c4-4785-ab31-87ca57fd9c2f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:04.965095 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e743c714-b8c4-4785-ab31-87ca57fd9c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90df5cb2577c4e9b9110620d6836abe0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:05.043024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e743c714-b8c4-4785-ab31-87ca57fd9c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90df5cb2577c4e9b9110620d6836abe0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:05.043639 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e743c714-b8c4-4785-ab31-87ca57fd9c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90df5cb2577c4e9b9110620d6836abe0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:05.059889 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e743c714-b8c4-4785-ab31-87ca57fd9c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90df5cb2577c4e9b9110620d6836abe0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:05.067070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e743c714-b8c4-4785-ab31-87ca57fd9c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90df5cb2577c4e9b9110620d6836abe0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:05.073796 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1436/2851] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:48:04 2022] DELETE /identity/v3/users/90df5cb2577c4e9b9110620d6836abe0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:05.078442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c692d02-6e45-445a-94b0-bdc5eb2f2de2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:05.078993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c692d02-6e45-445a-94b0-bdc5eb2f2de2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:05.079106 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c692d02-6e45-445a-94b0-bdc5eb2f2de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:05.100317 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3c692d02-6e45-445a-94b0-bdc5eb2f2de2 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:48:05.101517 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3c692d02-6e45-445a-94b0-bdc5eb2f2de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:05.162843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1416/2852] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:48:05.172774 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743c714-b8c4-4785-ab31-87ca57fd9c2f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:05.174469 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e743c714-b8c4-4785-ab31-87ca57fd9c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:05.232452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743c714-b8c4-4785-ab31-87ca57fd9c2f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:05.236456 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd5aac-a396-45f9-aaab-7521f904f353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:05.237024 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd5aac-a396-45f9-aaab-7521f904f353 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:05.237309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd5aac-a396-45f9-aaab-7521f904f353 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:05.237586 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd5aac-a396-45f9-aaab-7521f904f353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:05.247016 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd5aac-a396-45f9-aaab-7521f904f353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:05.248446 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd5aac-a396-45f9-aaab-7521f904f353 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:05.259022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1437/2853] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:48:05.679428 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c692d02-6e45-445a-94b0-bdc5eb2f2de2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:05.680866 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3c692d02-6e45-445a-94b0-bdc5eb2f2de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:05.696442 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c692d02-6e45-445a-94b0-bdc5eb2f2de2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:05.702271 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13138d-c1fa-420e-95a9-85b34f80ac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:05.703191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13138d-c1fa-420e-95a9-85b34f80ac84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:05.703494 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13138d-c1fa-420e-95a9-85b34f80ac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:05.703768 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13138d-c1fa-420e-95a9-85b34f80ac84 admin admin] PATH_INFO: `/v3/projects/f3937c134e1e409b81a3c6a488934a58` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:05.705089 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13138d-c1fa-420e-95a9-85b34f80ac84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3937c134e1e409b81a3c6a488934a58)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:05.706911 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13138d-c1fa-420e-95a9-85b34f80ac84 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:05.839352 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a13138d-c1fa-420e-95a9-85b34f80ac84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3937c134e1e409b81a3c6a488934a58', 'request_id': 'req-9a13138d-c1fa-420e-95a9-85b34f80ac84'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:05.846511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a13138d-c1fa-420e-95a9-85b34f80ac84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3937c134e1e409b81a3c6a488934a58', 'request_id': 'req-9a13138d-c1fa-420e-95a9-85b34f80ac84'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:05.899692 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a13138d-c1fa-420e-95a9-85b34f80ac84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3937c134e1e409b81a3c6a488934a58', 'request_id': 'req-9a13138d-c1fa-420e-95a9-85b34f80ac84'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:05.910797 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a13138d-c1fa-420e-95a9-85b34f80ac84 admin admin] The token cache is being invalidate because project f3937c134e1e409b81a3c6a488934a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:48:05.911086 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a13138d-c1fa-420e-95a9-85b34f80ac84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:05.914405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a13138d-c1fa-420e-95a9-85b34f80ac84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:05.914405 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1417/2854] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:48:05 2022] DELETE /identity/v3/projects/f3937c134e1e409b81a3c6a488934a58 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:05.917280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd5aac-a396-45f9-aaab-7521f904f353 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:05.928239 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd5aac-a396-45f9-aaab-7521f904f353 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:05.946397 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:05.984152 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f9248-b9a1-45a8-b2c1-d45176257dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:05.985294 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f9248-b9a1-45a8-b2c1-d45176257dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:05.986511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f9248-b9a1-45a8-b2c1-d45176257dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:05.986944 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f9248-b9a1-45a8-b2c1-d45176257dc3 admin admin] PATH_INFO: `/v3/users/470af79784eb46969a54fc15ae9c2404` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:05.988417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f9248-b9a1-45a8-b2c1-d45176257dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=470af79784eb46969a54fc15ae9c2404)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:05.990400 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f9248-b9a1-45a8-b2c1-d45176257dc3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:06.148962 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1a0f9248-b9a1-45a8-b2c1-d45176257dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '470af79784eb46969a54fc15ae9c2404'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:06.225801 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1a0f9248-b9a1-45a8-b2c1-d45176257dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '470af79784eb46969a54fc15ae9c2404'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:06.226479 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1a0f9248-b9a1-45a8-b2c1-d45176257dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '470af79784eb46969a54fc15ae9c2404'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:06.239987 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1a0f9248-b9a1-45a8-b2c1-d45176257dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '470af79784eb46969a54fc15ae9c2404'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:06.246970 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1a0f9248-b9a1-45a8-b2c1-d45176257dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '470af79784eb46969a54fc15ae9c2404'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:06.253494 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1438/2855] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:48:05 2022] DELETE /identity/v3/users/470af79784eb46969a54fc15ae9c2404 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:06.639078 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13138d-c1fa-420e-95a9-85b34f80ac84 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:06.640585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9a13138d-c1fa-420e-95a9-85b34f80ac84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:06.654017 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13138d-c1fa-420e-95a9-85b34f80ac84 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:06.712928 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c393b9-b3c4-4283-8fa3-b5b9c446dc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:06.713702 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c393b9-b3c4-4283-8fa3-b5b9c446dc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:06.713977 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c393b9-b3c4-4283-8fa3-b5b9c446dc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:06.714248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c393b9-b3c4-4283-8fa3-b5b9c446dc63 admin admin] PATH_INFO: `/v3/projects/55c54810ea794336a3a44ef136c5c428` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:06.715459 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c393b9-b3c4-4283-8fa3-b5b9c446dc63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c54810ea794336a3a44ef136c5c428)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:06.717382 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c393b9-b3c4-4283-8fa3-b5b9c446dc63 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:06.798707 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:06.815957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-72c393b9-b3c4-4283-8fa3-b5b9c446dc63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c54810ea794336a3a44ef136c5c428', 'request_id': 'req-72c393b9-b3c4-4283-8fa3-b5b9c446dc63'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:06.823329 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-72c393b9-b3c4-4283-8fa3-b5b9c446dc63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c54810ea794336a3a44ef136c5c428', 'request_id': 'req-72c393b9-b3c4-4283-8fa3-b5b9c446dc63'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:06.893965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-72c393b9-b3c4-4283-8fa3-b5b9c446dc63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c54810ea794336a3a44ef136c5c428', 'request_id': 'req-72c393b9-b3c4-4283-8fa3-b5b9c446dc63'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:06.904937 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-72c393b9-b3c4-4283-8fa3-b5b9c446dc63 admin admin] The token cache is being invalidate because project 55c54810ea794336a3a44ef136c5c428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:48:06.905435 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-72c393b9-b3c4-4283-8fa3-b5b9c446dc63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:06.906619 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-72c393b9-b3c4-4283-8fa3-b5b9c446dc63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:06.909336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1418/2856] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:48:06 2022] DELETE /identity/v3/projects/55c54810ea794336a3a44ef136c5c428 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:06.914523 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c69019-2211-48e6-adbd-1c0560ca4fb1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:06.916519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c69019-2211-48e6-adbd-1c0560ca4fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:06.916519 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c69019-2211-48e6-adbd-1c0560ca4fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:06.933554 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-76c69019-2211-48e6-adbd-1c0560ca4fb1 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:48:06.934806 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-76c69019-2211-48e6-adbd-1c0560ca4fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:06.995586 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1439/2857] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:48:07.003794 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398ccff-5e3e-40ca-aa92-098c98ec46dd None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:07.004097 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398ccff-5e3e-40ca-aa92-098c98ec46dd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:07.004351 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398ccff-5e3e-40ca-aa92-098c98ec46dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:07.024613 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e398ccff-5e3e-40ca-aa92-098c98ec46dd None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:48:07.025847 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e398ccff-5e3e-40ca-aa92-098c98ec46dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:07.035016 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1419/2858] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:48:07.039471 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c69019-2211-48e6-adbd-1c0560ca4fb1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:07.049212 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c69019-2211-48e6-adbd-1c0560ca4fb1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:07.053899 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cedf6b-16f2-4a13-8e01-b69b1126c75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:07.054556 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cedf6b-16f2-4a13-8e01-b69b1126c75e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:07.054871 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cedf6b-16f2-4a13-8e01-b69b1126c75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:07.055147 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cedf6b-16f2-4a13-8e01-b69b1126c75e admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:07.055873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cedf6b-16f2-4a13-8e01-b69b1126c75e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:48:07.056179 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cedf6b-16f2-4a13-8e01-b69b1126c75e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:07.057778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cedf6b-16f2-4a13-8e01-b69b1126c75e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:07.069503 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1440/2859] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:48:07.074011 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398ccff-5e3e-40ca-aa92-098c98ec46dd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:07.084060 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398ccff-5e3e-40ca-aa92-098c98ec46dd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:07.089149 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13df729-7172-47b4-8100-f81d15637404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:07.089818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13df729-7172-47b4-8100-f81d15637404 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:07.090096 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13df729-7172-47b4-8100-f81d15637404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:07.090368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13df729-7172-47b4-8100-f81d15637404 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:07.091105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13df729-7172-47b4-8100-f81d15637404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:07.093032 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13df729-7172-47b4-8100-f81d15637404 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:07.250399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1420/2860] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:48:07 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:48:07.255550 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cedf6b-16f2-4a13-8e01-b69b1126c75e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:07.266062 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cedf6b-16f2-4a13-8e01-b69b1126c75e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:07.294564 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:07.328242 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cf1b5-b873-4186-818f-5a185e23beb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:07.328919 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cf1b5-b873-4186-818f-5a185e23beb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:07.330047 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cf1b5-b873-4186-818f-5a185e23beb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:07.330209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cf1b5-b873-4186-818f-5a185e23beb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:07.330953 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cf1b5-b873-4186-818f-5a185e23beb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:07.332929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cf1b5-b873-4186-818f-5a185e23beb6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:07.444821 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1441/2861] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:48:07 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:48:07.449142 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13df729-7172-47b4-8100-f81d15637404 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:07.462387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13df729-7172-47b4-8100-f81d15637404 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:07.467128 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56819a0a-b973-4905-b997-63b8304b70b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:07.467837 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56819a0a-b973-4905-b997-63b8304b70b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:07.468127 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56819a0a-b973-4905-b997-63b8304b70b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:07.468401 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56819a0a-b973-4905-b997-63b8304b70b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:07.469134 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56819a0a-b973-4905-b997-63b8304b70b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:07.470766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56819a0a-b973-4905-b997-63b8304b70b1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:07.481502 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1421/2862] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:48:07.487971 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cf1b5-b873-4186-818f-5a185e23beb6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:07.498170 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cf1b5-b873-4186-818f-5a185e23beb6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:07.504553 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0ac5b-a186-4d66-a81e-1c851254c978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:07.505453 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0ac5b-a186-4d66-a81e-1c851254c978 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:07.505933 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0ac5b-a186-4d66-a81e-1c851254c978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:07.506573 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0ac5b-a186-4d66-a81e-1c851254c978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:07.507340 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0ac5b-a186-4d66-a81e-1c851254c978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:07.508971 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0ac5b-a186-4d66-a81e-1c851254c978 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:07.520020 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1442/2863] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:48:07.524433 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56819a0a-b973-4905-b997-63b8304b70b1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:07.534778 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56819a0a-b973-4905-b997-63b8304b70b1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:07.539275 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179159c0-b4db-4ca2-b611-57ea62e1372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:07.540139 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179159c0-b4db-4ca2-b611-57ea62e1372f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:07.540416 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179159c0-b4db-4ca2-b611-57ea62e1372f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:07.540683 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179159c0-b4db-4ca2-b611-57ea62e1372f admin admin] PATH_INFO: `/v3/projects/d7ae0b8f9bd24cf0ac9221494df23478/users/84f86a3856de44ce853f8fe6829f4d28/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:07.555942 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179159c0-b4db-4ca2-b611-57ea62e1372f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ae0b8f9bd24cf0ac9221494df23478, user_id=84f86a3856de44ce853f8fe6829f4d28, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:07.558558 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179159c0-b4db-4ca2-b611-57ea62e1372f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:07.615133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1422/2864] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:48:07 2022] PUT /identity/v3/projects/d7ae0b8f9bd24cf0ac9221494df23478/users/84f86a3856de44ce853f8fe6829f4d28/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:07.679517 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077098b5-c39e-407d-bc71-3470e1780113 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:07.679872 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077098b5-c39e-407d-bc71-3470e1780113 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:07.680151 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077098b5-c39e-407d-bc71-3470e1780113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:07.708197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-077098b5-c39e-407d-bc71-3470e1780113 None None] MFA Rules not processed for user `84f86a3856de44ce853f8fe6829f4d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:48:07.709424 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-077098b5-c39e-407d-bc71-3470e1780113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:07.785644 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1443/2865] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:48:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:48:07.797013 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179159c0-b4db-4ca2-b611-57ea62e1372f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:07.799426 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-179159c0-b4db-4ca2-b611-57ea62e1372f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:07.885272 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179159c0-b4db-4ca2-b611-57ea62e1372f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:07.889598 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b2f51-54ee-45d7-b7cb-279476af297f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc7e1bc2eb943eba57a0009635de70d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:07.890228 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b2f51-54ee-45d7-b7cb-279476af297f service glance] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:07.890610 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b2f51-54ee-45d7-b7cb-279476af297f service glance] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:07.890818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b2f51-54ee-45d7-b7cb-279476af297f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:07.899508 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b2f51-54ee-45d7-b7cb-279476af297f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:07.902188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b2f51-54ee-45d7-b7cb-279476af297f service glance] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:07.912427 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1423/2866] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:48:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:48:17.782911 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:17.907350 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=6,keystone:SELECT=76,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:22.876936 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077098b5-c39e-407d-bc71-3470e1780113 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:22.939677 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077098b5-c39e-407d-bc71-3470e1780113 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:22.945629 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22378b2-fd75-493b-97c9-ab32a995c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:22.946500 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22378b2-fd75-493b-97c9-ab32a995c6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:22.946811 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22378b2-fd75-493b-97c9-ab32a995c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:22.947081 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22378b2-fd75-493b-97c9-ab32a995c6c2 admin admin] PATH_INFO: `/v3/users/84f86a3856de44ce853f8fe6829f4d28` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:22.948289 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22378b2-fd75-493b-97c9-ab32a995c6c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f86a3856de44ce853f8fe6829f4d28)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:22.950198 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22378b2-fd75-493b-97c9-ab32a995c6c2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:23.107803 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d22378b2-fd75-493b-97c9-ab32a995c6c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f86a3856de44ce853f8fe6829f4d28'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:23.162277 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d22378b2-fd75-493b-97c9-ab32a995c6c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f86a3856de44ce853f8fe6829f4d28'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:23.162929 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d22378b2-fd75-493b-97c9-ab32a995c6c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f86a3856de44ce853f8fe6829f4d28'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:23.176778 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d22378b2-fd75-493b-97c9-ab32a995c6c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f86a3856de44ce853f8fe6829f4d28'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:23.187760 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d22378b2-fd75-493b-97c9-ab32a995c6c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f86a3856de44ce853f8fe6829f4d28'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:23.195190 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1444/2867] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:48:22 2022] DELETE /identity/v3/users/84f86a3856de44ce853f8fe6829f4d28 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:23.200045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfe134-daf6-44b8-8b53-6e3e59f9fcca None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:23.200532 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfe134-daf6-44b8-8b53-6e3e59f9fcca None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:23.200642 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfe134-daf6-44b8-8b53-6e3e59f9fcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:23.218860 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-20bfe134-daf6-44b8-8b53-6e3e59f9fcca None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:48:23.220095 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-20bfe134-daf6-44b8-8b53-6e3e59f9fcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:23.287848 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1424/2868] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:48:23.322897 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22378b2-fd75-493b-97c9-ab32a995c6c2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:23.324366 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d22378b2-fd75-493b-97c9-ab32a995c6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:23.386735 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22378b2-fd75-493b-97c9-ab32a995c6c2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:23.390385 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36eae32-7784-4989-876b-091a79ced5a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:23.391087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eae32-7784-4989-876b-091a79ced5a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:23.391364 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eae32-7784-4989-876b-091a79ced5a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:23.391635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eae32-7784-4989-876b-091a79ced5a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:23.401326 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36eae32-7784-4989-876b-091a79ced5a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:23.402790 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36eae32-7784-4989-876b-091a79ced5a4 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:23.412311 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1445/2869] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:48:23.838658 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfe134-daf6-44b8-8b53-6e3e59f9fcca None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:23.840252 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-20bfe134-daf6-44b8-8b53-6e3e59f9fcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:23.854960 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfe134-daf6-44b8-8b53-6e3e59f9fcca None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:23.860133 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dae206-0be5-464e-9bbd-d12993e0f669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:23.860952 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dae206-0be5-464e-9bbd-d12993e0f669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:23.861216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dae206-0be5-464e-9bbd-d12993e0f669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:23.861488 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dae206-0be5-464e-9bbd-d12993e0f669 admin admin] PATH_INFO: `/v3/projects/d7ae0b8f9bd24cf0ac9221494df23478` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:23.862699 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dae206-0be5-464e-9bbd-d12993e0f669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ae0b8f9bd24cf0ac9221494df23478)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:23.865388 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dae206-0be5-464e-9bbd-d12993e0f669 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:23.987444 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b7dae206-0be5-464e-9bbd-d12993e0f669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ae0b8f9bd24cf0ac9221494df23478', 'request_id': 'req-b7dae206-0be5-464e-9bbd-d12993e0f669'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:23.994852 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b7dae206-0be5-464e-9bbd-d12993e0f669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ae0b8f9bd24cf0ac9221494df23478', 'request_id': 'req-b7dae206-0be5-464e-9bbd-d12993e0f669'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:24.071068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b7dae206-0be5-464e-9bbd-d12993e0f669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ae0b8f9bd24cf0ac9221494df23478', 'request_id': 'req-b7dae206-0be5-464e-9bbd-d12993e0f669'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:24.083965 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b7dae206-0be5-464e-9bbd-d12993e0f669 admin admin] The token cache is being invalidate because project d7ae0b8f9bd24cf0ac9221494df23478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:48:24.084336 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b7dae206-0be5-464e-9bbd-d12993e0f669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:24.085068 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b7dae206-0be5-464e-9bbd-d12993e0f669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:24.086971 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1425/2870] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:48:23 2022] DELETE /identity/v3/projects/d7ae0b8f9bd24cf0ac9221494df23478 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:24.092280 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2170ed-9ad4-4417-9055-f18933bbb2ae None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:24.092796 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2170ed-9ad4-4417-9055-f18933bbb2ae None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:24.092922 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2170ed-9ad4-4417-9055-f18933bbb2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:24.111721 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9d2170ed-9ad4-4417-9055-f18933bbb2ae None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:48:24.112917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9d2170ed-9ad4-4417-9055-f18933bbb2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:24.130441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:24.174585 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1446/2871] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:48:24.182724 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5378c6-60f5-47e3-9c08-994caceca0d9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:24.183018 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5378c6-60f5-47e3-9c08-994caceca0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:24.183295 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5378c6-60f5-47e3-9c08-994caceca0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:24.202781 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-fa5378c6-60f5-47e3-9c08-994caceca0d9 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:48:24.204001 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fa5378c6-60f5-47e3-9c08-994caceca0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:24.212864 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1426/2872] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:48:24.217252 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2170ed-9ad4-4417-9055-f18933bbb2ae None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:24.227881 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2170ed-9ad4-4417-9055-f18933bbb2ae None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:24.232516 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf33ffb-414c-40e3-909f-b5d79fece4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:24.233177 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf33ffb-414c-40e3-909f-b5d79fece4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:24.233452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf33ffb-414c-40e3-909f-b5d79fece4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:24.233751 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf33ffb-414c-40e3-909f-b5d79fece4b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:24.234452 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf33ffb-414c-40e3-909f-b5d79fece4b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:48:24.234858 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf33ffb-414c-40e3-909f-b5d79fece4b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:24.236464 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf33ffb-414c-40e3-909f-b5d79fece4b5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:24.249705 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1447/2873] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:48:24.254376 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5378c6-60f5-47e3-9c08-994caceca0d9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:24.263691 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5378c6-60f5-47e3-9c08-994caceca0d9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:24.268310 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b687e-b350-487e-b3cd-b4cde20a6462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:24.268984 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b687e-b350-487e-b3cd-b4cde20a6462 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:24.269264 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b687e-b350-487e-b3cd-b4cde20a6462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:24.269556 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b687e-b350-487e-b3cd-b4cde20a6462 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:24.270855 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b687e-b350-487e-b3cd-b4cde20a6462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:24.272748 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b687e-b350-487e-b3cd-b4cde20a6462 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:24.364685 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1427/2874] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:48:24 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:48:24.368950 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf33ffb-414c-40e3-909f-b5d79fece4b5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:24.380615 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf33ffb-414c-40e3-909f-b5d79fece4b5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:24.438812 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a5481-f795-4008-a281-1287c5e5b2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:24.439488 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5481-f795-4008-a281-1287c5e5b2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:24.439770 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5481-f795-4008-a281-1287c5e5b2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:24.440045 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5481-f795-4008-a281-1287c5e5b2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:24.440808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a5481-f795-4008-a281-1287c5e5b2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:24.443257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a5481-f795-4008-a281-1287c5e5b2c2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:24.516618 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1448/2875] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:48:24 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:48:24.520710 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b687e-b350-487e-b3cd-b4cde20a6462 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:24.531828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b687e-b350-487e-b3cd-b4cde20a6462 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:24.536635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c7ff3-b20e-4a86-9880-6ad5637af244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:24.537294 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c7ff3-b20e-4a86-9880-6ad5637af244 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:24.537565 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c7ff3-b20e-4a86-9880-6ad5637af244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:24.537840 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c7ff3-b20e-4a86-9880-6ad5637af244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:24.538566 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c7ff3-b20e-4a86-9880-6ad5637af244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:24.540188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c7ff3-b20e-4a86-9880-6ad5637af244 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:24.551640 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1428/2876] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:48:24.556125 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a5481-f795-4008-a281-1287c5e5b2c2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:24.567568 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a5481-f795-4008-a281-1287c5e5b2c2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:24.572683 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec86ab-ad3f-4c22-b496-9333f4bcede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:24.573301 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec86ab-ad3f-4c22-b496-9333f4bcede6 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:24.574059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec86ab-ad3f-4c22-b496-9333f4bcede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:24.574059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec86ab-ad3f-4c22-b496-9333f4bcede6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:24.574582 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec86ab-ad3f-4c22-b496-9333f4bcede6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:24.576224 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec86ab-ad3f-4c22-b496-9333f4bcede6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:24.587430 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1449/2877] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:48:24.591892 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c7ff3-b20e-4a86-9880-6ad5637af244 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:24.602191 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c7ff3-b20e-4a86-9880-6ad5637af244 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:24.606882 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033b00b-6b6c-4a76-afc4-17862cebbd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:24.607766 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033b00b-6b6c-4a76-afc4-17862cebbd29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:24.608042 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033b00b-6b6c-4a76-afc4-17862cebbd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:24.608309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033b00b-6b6c-4a76-afc4-17862cebbd29 admin admin] PATH_INFO: `/v3/projects/205163e70e0941ccaee0c3d871783a71/users/6d9d97380c5b41dc989b76058be9a305/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:24.623659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033b00b-6b6c-4a76-afc4-17862cebbd29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=205163e70e0941ccaee0c3d871783a71, user_id=6d9d97380c5b41dc989b76058be9a305, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:24.626308 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033b00b-6b6c-4a76-afc4-17862cebbd29 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:24.728425 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1429/2878] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:48:24 2022] PUT /identity/v3/projects/205163e70e0941ccaee0c3d871783a71/users/6d9d97380c5b41dc989b76058be9a305/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:24.739449 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ebac5-188e-4286-ad76-e1e4652e9d76 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:24.739734 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ebac5-188e-4286-ad76-e1e4652e9d76 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:24.739997 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ebac5-188e-4286-ad76-e1e4652e9d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:24.766989 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-307ebac5-188e-4286-ad76-e1e4652e9d76 None None] MFA Rules not processed for user `6d9d97380c5b41dc989b76058be9a305`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:48:24.768116 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-307ebac5-188e-4286-ad76-e1e4652e9d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:24.831720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1450/2879] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:48:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:48:24.837340 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033b00b-6b6c-4a76-afc4-17862cebbd29 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:24.858705 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:24.901218 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033b00b-6b6c-4a76-afc4-17862cebbd29 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:24.905922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454f2e6-c5b8-407c-901d-7f33c1dd274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:24.906595 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454f2e6-c5b8-407c-901d-7f33c1dd274d admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:24.906909 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454f2e6-c5b8-407c-901d-7f33c1dd274d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:24.907185 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454f2e6-c5b8-407c-901d-7f33c1dd274d admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:24.907877 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454f2e6-c5b8-407c-901d-7f33c1dd274d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:24.909814 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454f2e6-c5b8-407c-901d-7f33c1dd274d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:25.025545 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1430/2880] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:48:24 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:48:25.032284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ebac5-188e-4286-ad76-e1e4652e9d76 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:25.043901 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ebac5-188e-4286-ad76-e1e4652e9d76 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:25.057097 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:25.104663 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0000fb6-55d3-4545-b105-ac08b83fb7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:25.105370 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0000fb6-55d3-4545-b105-ac08b83fb7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:25.105601 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0000fb6-55d3-4545-b105-ac08b83fb7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:25.105876 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0000fb6-55d3-4545-b105-ac08b83fb7c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:25.106570 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0000fb6-55d3-4545-b105-ac08b83fb7c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:25.108675 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0000fb6-55d3-4545-b105-ac08b83fb7c0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:25.265772 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1451/2881] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:48:25 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:48:25.269809 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454f2e6-c5b8-407c-901d-7f33c1dd274d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:25.280409 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454f2e6-c5b8-407c-901d-7f33c1dd274d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:25.284951 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc137a-92ae-4ab0-83ba-d29bb113cc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:25.286469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc137a-92ae-4ab0-83ba-d29bb113cc1e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:25.286469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc137a-92ae-4ab0-83ba-d29bb113cc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:25.286799 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc137a-92ae-4ab0-83ba-d29bb113cc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:25.287551 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc137a-92ae-4ab0-83ba-d29bb113cc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:25.289169 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc137a-92ae-4ab0-83ba-d29bb113cc1e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:25.300216 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1431/2882] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:48:25.305110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0000fb6-55d3-4545-b105-ac08b83fb7c0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:25.315110 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0000fb6-55d3-4545-b105-ac08b83fb7c0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:25.319849 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cd647-b300-44e1-8861-6a043341164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:25.320725 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cd647-b300-44e1-8861-6a043341164f admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:25.321022 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cd647-b300-44e1-8861-6a043341164f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:25.321291 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cd647-b300-44e1-8861-6a043341164f admin admin] PATH_INFO: `/v3/projects/0869e436093042febdcc29d417235b79/users/77799c544ab5467fa6bb4accdb979f1e/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:25.336566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cd647-b300-44e1-8861-6a043341164f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0869e436093042febdcc29d417235b79, user_id=77799c544ab5467fa6bb4accdb979f1e, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:25.339352 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cd647-b300-44e1-8861-6a043341164f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:25.425384 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1452/2883] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:48:25 2022] PUT /identity/v3/projects/0869e436093042febdcc29d417235b79/users/77799c544ab5467fa6bb4accdb979f1e/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:25.430306 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc137a-92ae-4ab0-83ba-d29bb113cc1e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:25.440857 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc137a-92ae-4ab0-83ba-d29bb113cc1e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:25.497568 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5337ff-ed88-4a38-88aa-5ecc1b138907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:25.498233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5337ff-ed88-4a38-88aa-5ecc1b138907 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:25.498513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5337ff-ed88-4a38-88aa-5ecc1b138907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:25.498828 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5337ff-ed88-4a38-88aa-5ecc1b138907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:25.499555 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5337ff-ed88-4a38-88aa-5ecc1b138907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:25.501161 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5337ff-ed88-4a38-88aa-5ecc1b138907 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:25.511181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1432/2884] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:48:25.515400 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cd647-b300-44e1-8861-6a043341164f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:25.526294 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cd647-b300-44e1-8861-6a043341164f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:25.530916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428d3cc-752b-4df1-aff9-b742bdb50b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:25.531728 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428d3cc-752b-4df1-aff9-b742bdb50b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:25.532002 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428d3cc-752b-4df1-aff9-b742bdb50b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:25.532269 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428d3cc-752b-4df1-aff9-b742bdb50b24 admin admin] PATH_INFO: `/v3/projects/0869e436093042febdcc29d417235b79/users/77799c544ab5467fa6bb4accdb979f1e/roles/ca62bd2769af4a27b40a9368b3b11406` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:25.534292 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428d3cc-752b-4df1-aff9-b742bdb50b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0869e436093042febdcc29d417235b79, user_id=77799c544ab5467fa6bb4accdb979f1e, role_id=ca62bd2769af4a27b40a9368b3b11406)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:25.537740 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428d3cc-752b-4df1-aff9-b742bdb50b24 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:25.548432 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1453/2885] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:48:25 2022] PUT /identity/v3/projects/0869e436093042febdcc29d417235b79/users/77799c544ab5467fa6bb4accdb979f1e/roles/ca62bd2769af4a27b40a9368b3b11406 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:25.559952 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22f297-3bd9-4ac2-97e5-c0235d02bbb6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:25.561337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22f297-3bd9-4ac2-97e5-c0235d02bbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:25.561337 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22f297-3bd9-4ac2-97e5-c0235d02bbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:25.588225 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-da22f297-3bd9-4ac2-97e5-c0235d02bbb6 None None] MFA Rules not processed for user `77799c544ab5467fa6bb4accdb979f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:48:25.590195 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-da22f297-3bd9-4ac2-97e5-c0235d02bbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:25.658309 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1433/2886] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:48:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:48:25.669732 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428d3cc-752b-4df1-aff9-b742bdb50b24 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:25.671441 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b428d3cc-752b-4df1-aff9-b742bdb50b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:25.729009 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428d3cc-752b-4df1-aff9-b742bdb50b24 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:25.732704 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d634e-65bd-4d53-abe9-891d42633546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:25.733348 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d634e-65bd-4d53-abe9-891d42633546 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:25.733637 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d634e-65bd-4d53-abe9-891d42633546 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:25.733917 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d634e-65bd-4d53-abe9-891d42633546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:25.792373 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d634e-65bd-4d53-abe9-891d42633546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:25.793734 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d634e-65bd-4d53-abe9-891d42633546 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:25.803064 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1454/2887] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:48:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:48:28.814588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22f297-3bd9-4ac2-97e5-c0235d02bbb6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:28.832365 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:28.890238 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22f297-3bd9-4ac2-97e5-c0235d02bbb6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:28.895539 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569772c3-d7f9-44f6-83be-9f557db8e01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:28.896409 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569772c3-d7f9-44f6-83be-9f557db8e01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:28.896687 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569772c3-d7f9-44f6-83be-9f557db8e01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:28.896957 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569772c3-d7f9-44f6-83be-9f557db8e01a admin admin] PATH_INFO: `/v3/users/6d9d97380c5b41dc989b76058be9a305` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:28.898161 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569772c3-d7f9-44f6-83be-9f557db8e01a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d9d97380c5b41dc989b76058be9a305)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:28.900132 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569772c3-d7f9-44f6-83be-9f557db8e01a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:29.135790 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-569772c3-d7f9-44f6-83be-9f557db8e01a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d9d97380c5b41dc989b76058be9a305'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:29.202087 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-569772c3-d7f9-44f6-83be-9f557db8e01a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d9d97380c5b41dc989b76058be9a305'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:29.210349 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-569772c3-d7f9-44f6-83be-9f557db8e01a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d9d97380c5b41dc989b76058be9a305'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:29.222411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-569772c3-d7f9-44f6-83be-9f557db8e01a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d9d97380c5b41dc989b76058be9a305'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:29.223804 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-569772c3-d7f9-44f6-83be-9f557db8e01a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d9d97380c5b41dc989b76058be9a305'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:29.229850 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1434/2888] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:48:28 2022] DELETE /identity/v3/users/6d9d97380c5b41dc989b76058be9a305 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:29.234534 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba633a-e858-499d-8661-b647487bdafa None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:29.235055 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba633a-e858-499d-8661-b647487bdafa None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:29.235154 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba633a-e858-499d-8661-b647487bdafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:29.253284 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e7ba633a-e858-499d-8661-b647487bdafa None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:48:29.254562 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e7ba633a-e858-499d-8661-b647487bdafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:29.274419 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:29.317679 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1455/2889] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:48:29.327415 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569772c3-d7f9-44f6-83be-9f557db8e01a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:29.328905 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-569772c3-d7f9-44f6-83be-9f557db8e01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:29.386912 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569772c3-d7f9-44f6-83be-9f557db8e01a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:29.390501 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d85c2d-4ab0-4bf5-80ef-9672b75bdac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:29.391188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d85c2d-4ab0-4bf5-80ef-9672b75bdac6 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:29.391469 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d85c2d-4ab0-4bf5-80ef-9672b75bdac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:29.391748 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d85c2d-4ab0-4bf5-80ef-9672b75bdac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:29.402188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d85c2d-4ab0-4bf5-80ef-9672b75bdac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:29.403652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d85c2d-4ab0-4bf5-80ef-9672b75bdac6 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:29.414102 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1435/2890] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:48:29.849257 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba633a-e858-499d-8661-b647487bdafa None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:29.850759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e7ba633a-e858-499d-8661-b647487bdafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:29.864458 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba633a-e858-499d-8661-b647487bdafa None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:29.869937 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b867d-9b4e-472d-b509-7a568bb23e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:29.870896 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b867d-9b4e-472d-b509-7a568bb23e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:29.871177 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b867d-9b4e-472d-b509-7a568bb23e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:29.871526 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b867d-9b4e-472d-b509-7a568bb23e05 admin admin] PATH_INFO: `/v3/projects/205163e70e0941ccaee0c3d871783a71` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:29.872664 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b867d-9b4e-472d-b509-7a568bb23e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=205163e70e0941ccaee0c3d871783a71)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:29.874563 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b867d-9b4e-472d-b509-7a568bb23e05 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:29.977846 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ed3b867d-9b4e-472d-b509-7a568bb23e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205163e70e0941ccaee0c3d871783a71', 'request_id': 'req-ed3b867d-9b4e-472d-b509-7a568bb23e05'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:30.047662 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ed3b867d-9b4e-472d-b509-7a568bb23e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205163e70e0941ccaee0c3d871783a71', 'request_id': 'req-ed3b867d-9b4e-472d-b509-7a568bb23e05'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:30.055025 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ed3b867d-9b4e-472d-b509-7a568bb23e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205163e70e0941ccaee0c3d871783a71', 'request_id': 'req-ed3b867d-9b4e-472d-b509-7a568bb23e05'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:30.067461 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ed3b867d-9b4e-472d-b509-7a568bb23e05 admin admin] The token cache is being invalidate because project 205163e70e0941ccaee0c3d871783a71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:48:30.070636 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ed3b867d-9b4e-472d-b509-7a568bb23e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:30.070636 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ed3b867d-9b4e-472d-b509-7a568bb23e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:30.070636 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1456/2891] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:48:29 2022] DELETE /identity/v3/projects/205163e70e0941ccaee0c3d871783a71 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:30.074233 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d85c2d-4ab0-4bf5-80ef-9672b75bdac6 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:30.084492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d85c2d-4ab0-4bf5-80ef-9672b75bdac6 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:30.121418 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:30.146331 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dc8fd-8d10-44a7-aebe-a17daa7dfaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:30.147258 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dc8fd-8d10-44a7-aebe-a17daa7dfaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:30.147542 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dc8fd-8d10-44a7-aebe-a17daa7dfaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:30.147818 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dc8fd-8d10-44a7-aebe-a17daa7dfaae admin admin] PATH_INFO: `/v3/users/77799c544ab5467fa6bb4accdb979f1e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:30.149343 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dc8fd-8d10-44a7-aebe-a17daa7dfaae admin admin] RBAC: Authorizing `identity:delete_user(user_id=77799c544ab5467fa6bb4accdb979f1e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:30.152006 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dc8fd-8d10-44a7-aebe-a17daa7dfaae admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:30.319993 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c79dc8fd-8d10-44a7-aebe-a17daa7dfaae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77799c544ab5467fa6bb4accdb979f1e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:30.401902 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c79dc8fd-8d10-44a7-aebe-a17daa7dfaae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77799c544ab5467fa6bb4accdb979f1e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:30.409362 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c79dc8fd-8d10-44a7-aebe-a17daa7dfaae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77799c544ab5467fa6bb4accdb979f1e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:30.421752 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c79dc8fd-8d10-44a7-aebe-a17daa7dfaae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77799c544ab5467fa6bb4accdb979f1e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:30.422399 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c79dc8fd-8d10-44a7-aebe-a17daa7dfaae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77799c544ab5467fa6bb4accdb979f1e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:30.429015 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1436/2892] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:48:30 2022] DELETE /identity/v3/users/77799c544ab5467fa6bb4accdb979f1e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:30.867339 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b867d-9b4e-472d-b509-7a568bb23e05 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:30.869934 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ed3b867d-9b4e-472d-b509-7a568bb23e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:30.884104 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b867d-9b4e-472d-b509-7a568bb23e05 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:30.950078 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1f37b-d61d-482f-84cd-c4a871c1aa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:30.950977 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1f37b-d61d-482f-84cd-c4a871c1aa2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:30.951256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1f37b-d61d-482f-84cd-c4a871c1aa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:30.951550 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1f37b-d61d-482f-84cd-c4a871c1aa2d admin admin] PATH_INFO: `/v3/projects/0869e436093042febdcc29d417235b79` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:30.952743 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1f37b-d61d-482f-84cd-c4a871c1aa2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0869e436093042febdcc29d417235b79)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:30.954707 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1f37b-d61d-482f-84cd-c4a871c1aa2d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:31.056175 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-24c1f37b-d61d-482f-84cd-c4a871c1aa2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0869e436093042febdcc29d417235b79', 'request_id': 'req-24c1f37b-d61d-482f-84cd-c4a871c1aa2d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:31.057914 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:31.138638 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-24c1f37b-d61d-482f-84cd-c4a871c1aa2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0869e436093042febdcc29d417235b79', 'request_id': 'req-24c1f37b-d61d-482f-84cd-c4a871c1aa2d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:31.144860 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-24c1f37b-d61d-482f-84cd-c4a871c1aa2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0869e436093042febdcc29d417235b79', 'request_id': 'req-24c1f37b-d61d-482f-84cd-c4a871c1aa2d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:31.156209 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-24c1f37b-d61d-482f-84cd-c4a871c1aa2d admin admin] The token cache is being invalidate because project 0869e436093042febdcc29d417235b79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:48:31.156494 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-24c1f37b-d61d-482f-84cd-c4a871c1aa2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:31.157127 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-24c1f37b-d61d-482f-84cd-c4a871c1aa2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:31.158712 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1457/2893] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:48:30 2022] DELETE /identity/v3/projects/0869e436093042febdcc29d417235b79 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:48:31.164164 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d75db-5c2f-4d7b-99a9-ef22e6206885 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:31.164645 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d75db-5c2f-4d7b-99a9-ef22e6206885 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:31.164753 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d75db-5c2f-4d7b-99a9-ef22e6206885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:31.183201 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a25d75db-5c2f-4d7b-99a9-ef22e6206885 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:48:31.184407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a25d75db-5c2f-4d7b-99a9-ef22e6206885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:31.246368 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1437/2894] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:48:31.254443 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6f394-3341-43c7-902c-786b1f6c98a6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:31.254777 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6f394-3341-43c7-902c-786b1f6c98a6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:31.255065 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6f394-3341-43c7-902c-786b1f6c98a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:31.273566 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-72f6f394-3341-43c7-902c-786b1f6c98a6 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:48:31.274838 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-72f6f394-3341-43c7-902c-786b1f6c98a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:31.282824 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1458/2895] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:48:31.287596 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d75db-5c2f-4d7b-99a9-ef22e6206885 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:31.297271 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d75db-5c2f-4d7b-99a9-ef22e6206885 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:31.302694 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a689c-fe7f-4f9f-8ada-611576d7f22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:31.303355 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a689c-fe7f-4f9f-8ada-611576d7f22c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:31.303635 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a689c-fe7f-4f9f-8ada-611576d7f22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:31.303911 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a689c-fe7f-4f9f-8ada-611576d7f22c admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:31.304636 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a689c-fe7f-4f9f-8ada-611576d7f22c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:48:31.304941 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a689c-fe7f-4f9f-8ada-611576d7f22c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:31.306543 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a689c-fe7f-4f9f-8ada-611576d7f22c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:31.318874 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1438/2896] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Jul 20 19:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:48:31.325148 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6f394-3341-43c7-902c-786b1f6c98a6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:31.334969 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6f394-3341-43c7-902c-786b1f6c98a6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:31.339987 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20844a5d-eeb4-4b76-952b-a69804f8eab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:31.340666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20844a5d-eeb4-4b76-952b-a69804f8eab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:31.340947 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20844a5d-eeb4-4b76-952b-a69804f8eab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:31.341222 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20844a5d-eeb4-4b76-952b-a69804f8eab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:31.342256 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20844a5d-eeb4-4b76-952b-a69804f8eab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:31.343878 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20844a5d-eeb4-4b76-952b-a69804f8eab0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:31.433270 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1459/2897] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Jul 20 19:48:31 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:48:31.437873 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a689c-fe7f-4f9f-8ada-611576d7f22c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:31.448266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a689c-fe7f-4f9f-8ada-611576d7f22c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:31.491204 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:31.506313 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cc279-8079-4b6f-9c18-781a1dfee208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:31.507014 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cc279-8079-4b6f-9c18-781a1dfee208 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:31.507296 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cc279-8079-4b6f-9c18-781a1dfee208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:31.507567 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cc279-8079-4b6f-9c18-781a1dfee208 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:31.508266 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cc279-8079-4b6f-9c18-781a1dfee208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:31.510251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cc279-8079-4b6f-9c18-781a1dfee208 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:31.579697 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1439/2898] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Jul 20 19:48:31 2022] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:48:31.584307 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20844a5d-eeb4-4b76-952b-a69804f8eab0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:31.594795 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20844a5d-eeb4-4b76-952b-a69804f8eab0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:31.600193 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10601e-4dbd-4f83-9baf-f06387478620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:31.600853 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10601e-4dbd-4f83-9baf-f06387478620 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:31.601128 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10601e-4dbd-4f83-9baf-f06387478620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:31.601440 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10601e-4dbd-4f83-9baf-f06387478620 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:31.602164 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10601e-4dbd-4f83-9baf-f06387478620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:31.603796 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10601e-4dbd-4f83-9baf-f06387478620 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:31.616672 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1460/2899] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:48:31.620995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cc279-8079-4b6f-9c18-781a1dfee208 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:31.632217 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cc279-8079-4b6f-9c18-781a1dfee208 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:31.637066 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490da7bb-f475-4d60-abea-19a15260f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:31.637729 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490da7bb-f475-4d60-abea-19a15260f8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:31.638010 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490da7bb-f475-4d60-abea-19a15260f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:31.638289 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490da7bb-f475-4d60-abea-19a15260f8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:31.639061 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490da7bb-f475-4d60-abea-19a15260f8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:31.640765 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490da7bb-f475-4d60-abea-19a15260f8e8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:31.651977 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1440/2900] 10.222.0.16 () {58 vars in 1121 bytes} [Wed Jul 20 19:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:48:31.656313 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10601e-4dbd-4f83-9baf-f06387478620 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:31.666873 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10601e-4dbd-4f83-9baf-f06387478620 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:31.672068 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c315121-b6a0-44dc-9f70-2944e8828a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:31.672990 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c315121-b6a0-44dc-9f70-2944e8828a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:31.674713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c315121-b6a0-44dc-9f70-2944e8828a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:31.674713 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c315121-b6a0-44dc-9f70-2944e8828a05 admin admin] PATH_INFO: `/v3/projects/1e279ccaaeb143549faf1bb7b36e5229/users/b4d1d0d5f42a4ee086fde38992878bd2/roles/9b386d2d84ef4d3b9f9401c95f06c53b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:31.689915 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c315121-b6a0-44dc-9f70-2944e8828a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e279ccaaeb143549faf1bb7b36e5229, user_id=b4d1d0d5f42a4ee086fde38992878bd2, role_id=9b386d2d84ef4d3b9f9401c95f06c53b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:31.693187 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c315121-b6a0-44dc-9f70-2944e8828a05 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:31.768733 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1461/2901] 10.222.0.16 () {60 vars in 1482 bytes} [Wed Jul 20 19:48:31 2022] PUT /identity/v3/projects/1e279ccaaeb143549faf1bb7b36e5229/users/b4d1d0d5f42a4ee086fde38992878bd2/roles/9b386d2d84ef4d3b9f9401c95f06c53b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:31.780660 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccdb00-8792-4efd-99a8-9cc721bbcad6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:31.780939 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccdb00-8792-4efd-99a8-9cc721bbcad6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:31.781212 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccdb00-8792-4efd-99a8-9cc721bbcad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:31.808585 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e2ccdb00-8792-4efd-99a8-9cc721bbcad6 None None] MFA Rules not processed for user `b4d1d0d5f42a4ee086fde38992878bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:48:31.809785 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e2ccdb00-8792-4efd-99a8-9cc721bbcad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:31.874313 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1441/2902] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:48:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:48:31.885130 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c315121-b6a0-44dc-9f70-2944e8828a05 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:31.886966 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3c315121-b6a0-44dc-9f70-2944e8828a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:31.943699 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c315121-b6a0-44dc-9f70-2944e8828a05 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:31.947335 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f980d-3611-478a-aebc-449a68e85532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fcf925f9ec45b3b2cbea7e6acc0522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:31.947980 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f980d-3611-478a-aebc-449a68e85532 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:31.948263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f980d-3611-478a-aebc-449a68e85532 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:31.948542 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f980d-3611-478a-aebc-449a68e85532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:31.956925 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f980d-3611-478a-aebc-449a68e85532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:31.958513 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f980d-3611-478a-aebc-449a68e85532 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:31.967354 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1462/2903] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:48:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:48:41.871522 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:41.963400 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=59 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:43.519968 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccdb00-8792-4efd-99a8-9cc721bbcad6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:43.588503 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccdb00-8792-4efd-99a8-9cc721bbcad6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:43.589298 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fe65a-051d-4f26-bedf-8e3cd42ccccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:43.590173 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fe65a-051d-4f26-bedf-8e3cd42ccccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:43.590441 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fe65a-051d-4f26-bedf-8e3cd42ccccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:43.590730 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fe65a-051d-4f26-bedf-8e3cd42ccccf admin admin] PATH_INFO: `/v3/users/b4d1d0d5f42a4ee086fde38992878bd2` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:43.591917 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fe65a-051d-4f26-bedf-8e3cd42ccccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d1d0d5f42a4ee086fde38992878bd2)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:43.593843 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fe65a-051d-4f26-bedf-8e3cd42ccccf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:43.747154 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f38fe65a-051d-4f26-bedf-8e3cd42ccccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d1d0d5f42a4ee086fde38992878bd2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:43.802069 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f38fe65a-051d-4f26-bedf-8e3cd42ccccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d1d0d5f42a4ee086fde38992878bd2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:43.810770 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f38fe65a-051d-4f26-bedf-8e3cd42ccccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d1d0d5f42a4ee086fde38992878bd2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:43.825364 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f38fe65a-051d-4f26-bedf-8e3cd42ccccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d1d0d5f42a4ee086fde38992878bd2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:43.826111 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f38fe65a-051d-4f26-bedf-8e3cd42ccccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d1d0d5f42a4ee086fde38992878bd2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:43.833064 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1442/2904] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:48:43 2022] DELETE /identity/v3/users/b4d1d0d5f42a4ee086fde38992878bd2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:43.837808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a88e8f-a518-4dbc-be52-399492470b07 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:43.838300 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a88e8f-a518-4dbc-be52-399492470b07 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:43.838417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a88e8f-a518-4dbc-be52-399492470b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:43.856343 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-57a88e8f-a518-4dbc-be52-399492470b07 None None] MFA Rules not processed for user `bc14ede82e87407488accc3a9acc26ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:48:43.857465 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-57a88e8f-a518-4dbc-be52-399492470b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:43.919665 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1463/2905] 10.222.0.16 () {58 vars in 957 bytes} [Wed Jul 20 19:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:48:43.929954 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fe65a-051d-4f26-bedf-8e3cd42ccccf admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:43.931513 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f38fe65a-051d-4f26-bedf-8e3cd42ccccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:44.003411 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fe65a-051d-4f26-bedf-8e3cd42ccccf admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:44.009188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67348bd-5139-45cf-897b-1531455e2b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:44.009955 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67348bd-5139-45cf-897b-1531455e2b89 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:44.010239 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67348bd-5139-45cf-897b-1531455e2b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:44.010516 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67348bd-5139-45cf-897b-1531455e2b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:44.021671 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67348bd-5139-45cf-897b-1531455e2b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:44.023209 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67348bd-5139-45cf-897b-1531455e2b89 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:44.034148 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1443/2906] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:48:44.481808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a88e8f-a518-4dbc-be52-399492470b07 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:48:44.481808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-57a88e8f-a518-4dbc-be52-399492470b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:48:44.492996 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a88e8f-a518-4dbc-be52-399492470b07 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:48:44.498346 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:48:44.499268 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:48:44.499550 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:48:44.499865 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513 admin admin] PATH_INFO: `/v3/projects/1e279ccaaeb143549faf1bb7b36e5229` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:48:44.501114 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e279ccaaeb143549faf1bb7b36e5229)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:48:44.503577 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:48:44.608458 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e279ccaaeb143549faf1bb7b36e5229', 'request_id': 'req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:44.658544 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e279ccaaeb143549faf1bb7b36e5229', 'request_id': 'req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:44.664840 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e279ccaaeb143549faf1bb7b36e5229', 'request_id': 'req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:44.676695 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513 admin admin] The token cache is being invalidate because project 1e279ccaaeb143549faf1bb7b36e5229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:48:44.677607 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:44.677757 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:48:44.679392 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1464/2907] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:48:44 2022] DELETE /identity/v3/projects/1e279ccaaeb143549faf1bb7b36e5229 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:48:54.029289 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:48:54.673309 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:49:21.972915 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67348bd-5139-45cf-897b-1531455e2b89 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:49:21.981663 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67348bd-5139-45cf-897b-1531455e2b89 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:49:22.031511 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d28e39-eb5c-42c9-9a30-d907aa18a3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:49:22.032076 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d28e39-eb5c-42c9-9a30-d907aa18a3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:49:22.032387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d28e39-eb5c-42c9-9a30-d907aa18a3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:49:22.032688 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d28e39-eb5c-42c9-9a30-d907aa18a3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:49:22.035237 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f7d28e39-eb5c-42c9-9a30-d907aa18a3c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:49:22.045455 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d28e39-eb5c-42c9-9a30-d907aa18a3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:49:22.046921 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d28e39-eb5c-42c9-9a30-d907aa18a3c6 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:49:22.055045 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1444/2908] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:49:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:49:22.390722 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:49:22.392961 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:49:22.405505 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d7bfc-8ced-47cd-a8f7-2c88b88b8513 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:49:22.410310 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36a7bd-4673-4364-a9aa-3b8548a62de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:49:22.410527 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36a7bd-4673-4364-a9aa-3b8548a62de6 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:49:22.410820 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36a7bd-4673-4364-a9aa-3b8548a62de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:49:22.411093 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36a7bd-4673-4364-a9aa-3b8548a62de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:49:22.412983 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fb36a7bd-4673-4364-a9aa-3b8548a62de6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:49:22.423993 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36a7bd-4673-4364-a9aa-3b8548a62de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:49:22.426087 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36a7bd-4673-4364-a9aa-3b8548a62de6 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:49:22.434515 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1465/2909] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:49:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:49:22.515865 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d28e39-eb5c-42c9-9a30-d907aa18a3c6 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:49:22.517333 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f7d28e39-eb5c-42c9-9a30-d907aa18a3c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:49:22.527995 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d28e39-eb5c-42c9-9a30-d907aa18a3c6 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:49:22.531665 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbd64f-a6b4-467e-ae14-5a0791ec3370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:49:22.532315 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbd64f-a6b4-467e-ae14-5a0791ec3370 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:49:22.532588 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbd64f-a6b4-467e-ae14-5a0791ec3370 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:49:22.532856 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbd64f-a6b4-467e-ae14-5a0791ec3370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:49:22.534939 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8fcbd64f-a6b4-467e-ae14-5a0791ec3370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:49:22.608308 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbd64f-a6b4-467e-ae14-5a0791ec3370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:49:22.609659 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbd64f-a6b4-467e-ae14-5a0791ec3370 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:49:22.621438 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1445/2910] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:49:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:49:32.430846 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=6 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:49:32.616668 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=60 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:50:00.438146 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36a7bd-4673-4364-a9aa-3b8548a62de6 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:50:00.447439 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fb36a7bd-4673-4364-a9aa-3b8548a62de6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:50:00.511831 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36a7bd-4673-4364-a9aa-3b8548a62de6 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:50:00.517054 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9631f99-49bf-4e87-8c5e-5d1cf11802b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc616ed904d43d2b160b8d2766f7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:50:00.517759 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9631f99-49bf-4e87-8c5e-5d1cf11802b1 service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:50:00.518063 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9631f99-49bf-4e87-8c5e-5d1cf11802b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:50:00.518440 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9631f99-49bf-4e87-8c5e-5d1cf11802b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:50:00.520361 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d9631f99-49bf-4e87-8c5e-5d1cf11802b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:50:00.534545 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9631f99-49bf-4e87-8c5e-5d1cf11802b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:50:00.536263 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9631f99-49bf-4e87-8c5e-5d1cf11802b1 service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:50:00.547141 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1466/2911] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:50:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:50:10.543197 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=32 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:50:54.099986 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbd64f-a6b4-467e-ae14-5a0791ec3370 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:50:54.108652 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbd64f-a6b4-467e-ae14-5a0791ec3370 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:50:54.113105 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d4d4a-c7e1-465b-9da2-8c41451c8038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454b9259519c4332a8a36131c8273786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:50:54.113776 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d4d4a-c7e1-465b-9da2-8c41451c8038 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:50:54.114053 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d4d4a-c7e1-465b-9da2-8c41451c8038 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:50:54.114339 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d4d4a-c7e1-465b-9da2-8c41451c8038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:50:54.116094 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a95d4d4a-c7e1-465b-9da2-8c41451c8038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:50:54.131157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d4d4a-c7e1-465b-9da2-8c41451c8038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:50:54.136922 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d4d4a-c7e1-465b-9da2-8c41451c8038 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:50:54.144118 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1446/2912] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:50:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:50:59.496010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9631f99-49bf-4e87-8c5e-5d1cf11802b1 service placement] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:50:59.507720 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9631f99-49bf-4e87-8c5e-5d1cf11802b1 service placement] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:50:59.514117 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6ad3c-d967-4366-b7ab-477355d683c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc616ed904d43d2b160b8d2766f7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:50:59.514830 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6ad3c-d967-4366-b7ab-477355d683c0 service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:50:59.515164 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6ad3c-d967-4366-b7ab-477355d683c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:50:59.515391 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6ad3c-d967-4366-b7ab-477355d683c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:50:59.518200 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a0f6ad3c-d967-4366-b7ab-477355d683c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:50:59.538417 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6ad3c-d967-4366-b7ab-477355d683c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:50:59.539974 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6ad3c-d967-4366-b7ab-477355d683c0 service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:50:59.550808 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1467/2913] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:50:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:51:03.393119 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d4d4a-c7e1-465b-9da2-8c41451c8038 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:51:03.398194 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a95d4d4a-c7e1-465b-9da2-8c41451c8038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:51:03.410181 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d4d4a-c7e1-465b-9da2-8c41451c8038 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:51:03.416761 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07734e7d-b89b-46e8-b89b-97569e68ad4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc616ed904d43d2b160b8d2766f7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:51:03.417474 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07734e7d-b89b-46e8-b89b-97569e68ad4b service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:51:03.417758 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07734e7d-b89b-46e8-b89b-97569e68ad4b service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:51:03.418036 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07734e7d-b89b-46e8-b89b-97569e68ad4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:51:03.420067 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-07734e7d-b89b-46e8-b89b-97569e68ad4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:51:03.434726 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07734e7d-b89b-46e8-b89b-97569e68ad4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:51:03.436348 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07734e7d-b89b-46e8-b89b-97569e68ad4b service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:51:03.448499 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1447/2914] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:51:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:51:03.532635 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6ad3c-d967-4366-b7ab-477355d683c0 service placement] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:51:03.534258 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a0f6ad3c-d967-4366-b7ab-477355d683c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:51:03.608010 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6ad3c-d967-4366-b7ab-477355d683c0 service placement] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:51:03.614204 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb89e1-a500-4e6f-bbd4-07eca6ee87a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:51:03.615059 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb89e1-a500-4e6f-bbd4-07eca6ee87a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:51:03.615337 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb89e1-a500-4e6f-bbd4-07eca6ee87a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:51:03.615609 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb89e1-a500-4e6f-bbd4-07eca6ee87a6 admin admin] PATH_INFO: `/v3/users/e682fc08a23045e2ac331dbe97a71b29` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:51:03.616851 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb89e1-a500-4e6f-bbd4-07eca6ee87a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e682fc08a23045e2ac331dbe97a71b29)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:51:03.619871 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb89e1-a500-4e6f-bbd4-07eca6ee87a6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:51:03.793411 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0bcb89e1-a500-4e6f-bbd4-07eca6ee87a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e682fc08a23045e2ac331dbe97a71b29'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:03.872892 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0bcb89e1-a500-4e6f-bbd4-07eca6ee87a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e682fc08a23045e2ac331dbe97a71b29'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:03.873589 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0bcb89e1-a500-4e6f-bbd4-07eca6ee87a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e682fc08a23045e2ac331dbe97a71b29'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:03.889014 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0bcb89e1-a500-4e6f-bbd4-07eca6ee87a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e682fc08a23045e2ac331dbe97a71b29'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:03.897903 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0bcb89e1-a500-4e6f-bbd4-07eca6ee87a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e682fc08a23045e2ac331dbe97a71b29'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:03.906069 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1468/2915] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:51:03 2022] DELETE /identity/v3/users/e682fc08a23045e2ac331dbe97a71b29 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:51:04.218466 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07734e7d-b89b-46e8-b89b-97569e68ad4b service placement] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:51:04.232940 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07734e7d-b89b-46e8-b89b-97569e68ad4b service placement] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:51:04.320363 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92318c1-3bd0-4ae5-b598-55a402eb1310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:51:04.321248 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92318c1-3bd0-4ae5-b598-55a402eb1310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:51:04.321407 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92318c1-3bd0-4ae5-b598-55a402eb1310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:51:04.321759 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92318c1-3bd0-4ae5-b598-55a402eb1310 admin admin] PATH_INFO: `/v3/projects/b5736f1dad06412583f224f6229c0acf` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:51:04.323486 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92318c1-3bd0-4ae5-b598-55a402eb1310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5736f1dad06412583f224f6229c0acf)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:51:04.326059 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92318c1-3bd0-4ae5-b598-55a402eb1310 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:51:04.461251 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c92318c1-3bd0-4ae5-b598-55a402eb1310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5736f1dad06412583f224f6229c0acf', 'request_id': 'req-c92318c1-3bd0-4ae5-b598-55a402eb1310'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:04.468273 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c92318c1-3bd0-4ae5-b598-55a402eb1310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5736f1dad06412583f224f6229c0acf', 'request_id': 'req-c92318c1-3bd0-4ae5-b598-55a402eb1310'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:04.564425 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c92318c1-3bd0-4ae5-b598-55a402eb1310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5736f1dad06412583f224f6229c0acf', 'request_id': 'req-c92318c1-3bd0-4ae5-b598-55a402eb1310'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:04.579972 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c92318c1-3bd0-4ae5-b598-55a402eb1310 admin admin] The token cache is being invalidate because project b5736f1dad06412583f224f6229c0acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:51:04.579972 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c92318c1-3bd0-4ae5-b598-55a402eb1310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:04.579972 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c92318c1-3bd0-4ae5-b598-55a402eb1310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:04.581028 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1448/2916] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:51:04 2022] DELETE /identity/v3/projects/b5736f1dad06412583f224f6229c0acf => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:51:04.585319 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb89e1-a500-4e6f-bbd4-07eca6ee87a6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:51:04.586916 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0bcb89e1-a500-4e6f-bbd4-07eca6ee87a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:51:04.602768 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb89e1-a500-4e6f-bbd4-07eca6ee87a6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:51:04.668116 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6a343-236d-4c96-bf7c-93f9a6daaeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:51:04.669298 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6a343-236d-4c96-bf7c-93f9a6daaeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:51:04.669694 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6a343-236d-4c96-bf7c-93f9a6daaeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:51:04.670003 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6a343-236d-4c96-bf7c-93f9a6daaeb6 admin admin] PATH_INFO: `/v3/users/fae6599bd47848c28e0f0112427b9a7d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:51:04.671486 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6a343-236d-4c96-bf7c-93f9a6daaeb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae6599bd47848c28e0f0112427b9a7d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:51:04.674666 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6a343-236d-4c96-bf7c-93f9a6daaeb6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:51:04.681132 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:51:04.940057 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-daa6a343-236d-4c96-bf7c-93f9a6daaeb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae6599bd47848c28e0f0112427b9a7d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:05.015208 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-daa6a343-236d-4c96-bf7c-93f9a6daaeb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae6599bd47848c28e0f0112427b9a7d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:05.016070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-daa6a343-236d-4c96-bf7c-93f9a6daaeb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae6599bd47848c28e0f0112427b9a7d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:05.030535 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-daa6a343-236d-4c96-bf7c-93f9a6daaeb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae6599bd47848c28e0f0112427b9a7d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:05.039325 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-daa6a343-236d-4c96-bf7c-93f9a6daaeb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae6599bd47848c28e0f0112427b9a7d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:05.046344 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1469/2917] 10.222.0.16 () {58 vars in 1223 bytes} [Wed Jul 20 19:51:04 2022] DELETE /identity/v3/users/fae6599bd47848c28e0f0112427b9a7d => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:51:05.286157 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92318c1-3bd0-4ae5-b598-55a402eb1310 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:51:05.290492 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c92318c1-3bd0-4ae5-b598-55a402eb1310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:51:05.301987 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92318c1-3bd0-4ae5-b598-55a402eb1310 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:51:05.373413 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece4de5-3412-4565-b8a5-0ab1017dd16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc14ede82e87407488accc3a9acc26ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ff1600e760429b9e38b7ac11d31b62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:51:05.374592 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece4de5-3412-4565-b8a5-0ab1017dd16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:51:05.375188 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece4de5-3412-4565-b8a5-0ab1017dd16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:51:05.375524 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece4de5-3412-4565-b8a5-0ab1017dd16f admin admin] PATH_INFO: `/v3/projects/6f33b0c25f4d4558b90b12c41a4401c1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:51:05.377287 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece4de5-3412-4565-b8a5-0ab1017dd16f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f33b0c25f4d4558b90b12c41a4401c1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:51:05.380098 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece4de5-3412-4565-b8a5-0ab1017dd16f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:51:05.388880 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:51:05.502158 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0ece4de5-3412-4565-b8a5-0ab1017dd16f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f33b0c25f4d4558b90b12c41a4401c1', 'request_id': 'req-0ece4de5-3412-4565-b8a5-0ab1017dd16f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:05.508731 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0ece4de5-3412-4565-b8a5-0ab1017dd16f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f33b0c25f4d4558b90b12c41a4401c1', 'request_id': 'req-0ece4de5-3412-4565-b8a5-0ab1017dd16f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:05.586989 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0ece4de5-3412-4565-b8a5-0ab1017dd16f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f33b0c25f4d4558b90b12c41a4401c1', 'request_id': 'req-0ece4de5-3412-4565-b8a5-0ab1017dd16f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:05.598353 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0ece4de5-3412-4565-b8a5-0ab1017dd16f admin admin] The token cache is being invalidate because project 6f33b0c25f4d4558b90b12c41a4401c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:51:05.602387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0ece4de5-3412-4565-b8a5-0ab1017dd16f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:05.602387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0ece4de5-3412-4565-b8a5-0ab1017dd16f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:51:05.602387 dv-cinder-835384-16-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1449/2918] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Jul 20 19:51:05 2022] DELETE /identity/v3/projects/6f33b0c25f4d4558b90b12c41a4401c1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:51:15.042400 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:51:15.594875 dv-cinder-835384-16-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:55:05.472779 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6a343-236d-4c96-bf7c-93f9a6daaeb6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:55:05.474275 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-daa6a343-236d-4c96-bf7c-93f9a6daaeb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:55:05.635722 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6a343-236d-4c96-bf7c-93f9a6daaeb6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:55:05.701652 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95618e1e-58ef-48da-af97-abf4ccaa3aab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbc616ed904d43d2b160b8d2766f7bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50abbf0c38634795be669ec69da1f06d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:55:05.702511 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95618e1e-58ef-48da-af97-abf4ccaa3aab service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:55:05.702825 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95618e1e-58ef-48da-af97-abf4ccaa3aab service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:55:05.703219 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95618e1e-58ef-48da-af97-abf4ccaa3aab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:55:05.705135 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-95618e1e-58ef-48da-af97-abf4ccaa3aab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:55:05.717331 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95618e1e-58ef-48da-af97-abf4ccaa3aab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:55:05.719312 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95618e1e-58ef-48da-af97-abf4ccaa3aab service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:55:05.732070 dv-cinder-835384-16-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1470/2919] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jul 20 19:55:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:55:15.726159 dv-cinder-835384-16-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}